Jul 28 17:16:52.443405 ip-10-0-140-52 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 17:16:52.909506 ip-10-0-140-52 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:16:52.909506 ip-10-0-140-52 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 17:16:52.909506 ip-10-0-140-52 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:16:52.909506 ip-10-0-140-52 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 17:16:52.909506 ip-10-0-140-52 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:16:52.910257 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.909578    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 17:16:52.915188 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915168    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:16:52.915188 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915186    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:16:52.915188 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915190    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915194    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915197    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915201    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915210    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915214    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915219    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915222    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915225    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915228    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915232    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915235    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915238    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915241    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915244    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915247    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915250    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915253    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915256    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:16:52.915289 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915259    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915263    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915265    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915268    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915271    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915274    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915278    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915282    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915286    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915289    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915292    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915295    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915299    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915302    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915305    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915308    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915310    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915314    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915318    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:16:52.915772 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915321    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915324    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915327    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915329    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915332    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915335    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915338    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915341    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915344    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915346    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915349    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915351    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915354    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915357    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915359    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915363    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915366    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915369    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915372    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915375    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:16:52.916287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915378    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915381    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915384    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915386    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915389    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915392    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915394    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915397    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915400    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915403    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915405    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915409    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915412    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915415    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915420    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915423    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915427    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915430    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915433    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915435    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:16:52.916815 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915438    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915441    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915444    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915448    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915452    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915455    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915459    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915463    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915466    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915469    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915472    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915475    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915477    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915480    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915483    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915486    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915489    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915492    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.915495    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916314    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:16:52.917354 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916321    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916324    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916327    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916330    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916334    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916339    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916344    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916347    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916350    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916354    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916357    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916359    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916362    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916365    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916368    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916371    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916374    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916377    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916386    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916390    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:16:52.917873 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916392    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916396    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916399    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916401    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916404    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916407    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916410    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916413    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916415    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916418    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916421    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916423    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916426    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916429    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916432    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916435    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916437    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916441    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916443    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:16:52.918428 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916446    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916449    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916451    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916455    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916458    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916461    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916464    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916467    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916469    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916472    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916475    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916479    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916483    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916487    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916490    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916494    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916497    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916499    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916502    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916505    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:16:52.918937 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916508    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916510    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916513    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916516    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916518    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916521    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916524    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916526    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916529    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916532    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916534    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916538    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916540    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916544    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916548    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916552    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916554    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916557    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916560    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:16:52.919486 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916562    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916565    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916568    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916571    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916573    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916577    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916580    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916583    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916585    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916588    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916591    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916594    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916596    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916599    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916601    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916604    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916607    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916610    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916612    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.916615    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:16:52.920015 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917488    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917495    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917499    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917503    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917506    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917509    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917512    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917516    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917521    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917525    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917529    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917533    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917536    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917540    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917543    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917546    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917553    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917557    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917560    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:16:52.920581 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917563    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917566    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917569    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917571    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917575    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917578    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917581    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917583    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917586    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917589    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917592    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917595    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917597    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917600    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917603    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917605    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917608    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917611    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917614    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917617    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:16:52.921109 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917620    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917623    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917626    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917629    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917631    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917634    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917637    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917639    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917642    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917646    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917649    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917652    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917654    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917658    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917661    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917664    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917667    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917670    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917672    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917675    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:16:52.921641 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917678    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917681    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917683    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917686    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917689    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917692    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917694    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917697    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917700    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917703    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917707    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917710    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917713    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917716    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917719    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917722    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917724    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917727    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917730    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917732    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:16:52.922189 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917735    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917740    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917743    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917746    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917748    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917751    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917754    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917756    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917760    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917763    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917766    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917769    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917772    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917774    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917777    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917779    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917782    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917786    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917790    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:16:52.922760 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.917793    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917863    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917871    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917878    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917883    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917888    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917892    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917897    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917901    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917905    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917908    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917913    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917916    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917920    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917924    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917928    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917931    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917934    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917937    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917942    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917945    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917949    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917953    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917956    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 17:16:52.923272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917960    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917964    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917967    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917970    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917974    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917977    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917981    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917984    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917987    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917991    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917995    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.917998    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918001    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918005    2574 flags.go:64] FLAG: --enable-server="true"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918008    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918013    2574 flags.go:64] FLAG: --event-burst="100"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918017    2574 flags.go:64] FLAG: --event-qps="50"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918020    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918023    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918026    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918031    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918034    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918039    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918043    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918046    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 17:16:52.923919 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918049    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918053    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918056    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918059    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918064    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918068    2574 flags.go:64] FLAG: --feature-gates=""
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918072    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918075    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918078    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918082    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918085    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918089    2574 flags.go:64] FLAG: --help="false"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918092    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-140-52.ec2.internal"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918096    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918099    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918102    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918106    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918109    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918112    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918115    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918118    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918122    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918125    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918129    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 17:16:52.924627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918132    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918135    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918138    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918154    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918157    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918162    2574 flags.go:64] FLAG: --lock-file=""
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918165    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918168    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918172    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918178    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918181    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918184    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918192    2574 flags.go:64] FLAG: --logging-format="text"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918195    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918199    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918202    2574 flags.go:64] FLAG: --manifest-url=""
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918206    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918210    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918214    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918218    2574 flags.go:64] FLAG: --max-pods="110"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918222    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918225    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918228    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918232    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918235    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 17:16:52.925271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918238    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918241    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918248    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918251    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918255    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918258    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918262    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918268    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918271    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918274    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918277    2574 flags.go:64] FLAG: --port="10250"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918281    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918284    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-066bb0bd053d38b87"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918289    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918293    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918296    2574 flags.go:64] FLAG: --register-node="true"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918299    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918303    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918306    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918310    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918314    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918318    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918321    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918325    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918328    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 17:16:52.926053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918331    2574 flags.go:64] FLAG: --runonce="false"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918334    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918337    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918340    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918344    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918347    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918351    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918354    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918357    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918360    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918364    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918367    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918370    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918373    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918376    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918380    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918385    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918388    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918391    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918396    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918400    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918403    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918406    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918410    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918413    2574 flags.go:64] FLAG: --v="2"
Jul 28 17:16:52.926786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918417    2574 flags.go:64] FLAG: --version="false"
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918423    2574 flags.go:64] FLAG: --vmodule=""
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918427    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.918431    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918552    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918555    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918559    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918561    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918564    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918568    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918571    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918573    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918576    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918579    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918582    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918585    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918588    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918590    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918593    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918596    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:16:52.927453 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918598    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918603    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918607    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918610    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918614    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918617    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918620    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918625    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918628    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918631    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918635    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918638    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918641    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918645    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918648    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918651    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918654    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918657    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918659    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:16:52.927981 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918662    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918665    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918667    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918670    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918673    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918676    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918679    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918681    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918684    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918687    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918691    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918695    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918698    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918701    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918703    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918706    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918709    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918712    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918714    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918717    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:16:52.928614 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918722    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918725    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918728    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918731    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918733    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918736    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918741    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918744    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918746    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918749    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918752    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918754    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918757    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918760    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918763    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918766    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918769    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918771    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918774    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918777    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:16:52.929139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918780    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918782    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918785    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918787    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918790    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918793    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918796    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918798    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918801    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918806    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918810    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918813    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918817    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918820    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918823    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918826    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918828    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918831    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918836    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:16:52.929681 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918839    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918841    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918844    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918847    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.918850    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.919550    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.927318    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.927333    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.927357    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.927366    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927431    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927436    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927439    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927443    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927446    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:16:52.930205 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927449    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927452    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927456    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927459    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927462    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927465    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927468    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927472    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927475    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927478    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927481    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927484    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927487    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927490    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927493    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927496    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927498    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927501    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927507    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927511    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:16:52.930605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927514    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927516    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927519    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927522    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927525    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927529    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927532    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927535    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927537    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927540    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927543    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927546    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927549    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927552    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927555    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927558    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927561    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927566    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927570    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:16:52.931381 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927573    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927576    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927580    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927583    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927586    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927589    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927592    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927594    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927598    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927600    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927604    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927607    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927610    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927612    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927615    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927618    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927620    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927624    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927627    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927629    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:16:52.932169 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927632    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927635    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927638    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927640    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927643    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927646    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927648    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927651    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927654    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927657    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927659    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927662    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927665    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927667    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927671    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927674    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927676    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927679    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927681    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927684    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:16:52.932756 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927687    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927690    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927694    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927698    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927701    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927705    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927708    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927711    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927714    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927717    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927720    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927723    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927726    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927729    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:16:52.933540 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927732    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.927738    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927858    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927863    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927866    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927869    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927872    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927875    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927878    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927881    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927884    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927886    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927889    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927893    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927895    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:16:52.933928 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927898    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927901    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927904    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927907    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927910    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927913    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927917    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927920    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927923    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927928    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927931    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927934    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927937    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927939    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927942    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927944    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927947    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927950    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927953    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927955    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:16:52.934514 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927958    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927961    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927963    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927966    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927969    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927971    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927974    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927977    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927979    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927982    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927985    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927988    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927991    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927995    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.927998    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928000    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928003    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928006    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928010    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:16:52.935071 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928014    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928018    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928021    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928024    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928027    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928031    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928033    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928036    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928039    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928042    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928052    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928056    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928059    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928062    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928064    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928067    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928070    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928073    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928076    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928078    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:16:52.935656 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928081    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928084    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928087    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928089    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928092    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928096    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928099    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928102    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928104    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928107    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928110    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928113    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928115    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928118    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928121    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928124    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928127    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928129    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928132    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928135    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:16:52.936247 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928138    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928155    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928159    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928163    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928165    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928168    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:52.928171    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.928177    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.928293    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.934054    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.935512    2574 server.go:1019] "Starting client certificate rotation"
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.935619    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:16:52.936806 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.935657    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:16:52.938269 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.938250    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:16:52.939533 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.939504    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:16:52.951849 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.951826    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 28 17:16:52.954529 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.954399    2574 log.go:25] "Validated CRI v1 image API"
Jul 28 17:16:52.955707 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.955688    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 17:16:52.958291 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.958260    2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c00c971e-3f3a-4e63-b7ac-3ac79e2a2404:/dev/nvme0n1p3 de54d80e-c3a8-4e50-b3e4-105199bfcfac:/dev/nvme0n1p4]
Jul 28 17:16:52.958369 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.958289    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 17:16:52.963722 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.963582    2574 manager.go:216] Machine: {Timestamp:2026-07-28 17:16:52.962191443 +0000 UTC m=+0.389970675 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113150 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec240b2e65e5cd46fe3c765fd67b4ce1 SystemUUID:ec240b2e-65e5-cd46-fe3c-765fd67b4ce1 BootID:180c185d-619d-498a-9d7f-6d17706fcfd9 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:f2:d3:1d:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:f2:d3:1d:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:b4:3a:04:ac:36 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 17:16:52.963722 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.963707    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 17:16:52.963938 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.963836    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 17:16:52.966751 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.966718    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 17:16:52.966944 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.966757    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 17:16:52.968232 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.968218    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 17:16:52.968295 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.968243    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 17:16:52.968295 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.968254    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:16:52.968921 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.968908    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:16:52.969817 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.969805    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 17:16:52.972694 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.972680    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:16:52.972838 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.972826    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 17:16:52.973587 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.973576    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 17:16:52.973643 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.973595    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 17:16:52.973643 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.973619    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 17:16:52.973643 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.973634    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 28 17:16:52.973758 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.973648    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 17:16:52.974042 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.974028    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:16:52.974118 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.974053    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:16:52.979459 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.976708    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 17:16:52.982156 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.982125    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 17:16:52.982223 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.982159    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 17:16:52.983905 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983894    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 17:16:52.983951 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983910    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 17:16:52.983951 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983916    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 17:16:52.983951 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983922    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 17:16:52.983951 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983933    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 17:16:52.983951 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983940    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 17:16:52.983951 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983951    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 17:16:52.984166 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983958    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 17:16:52.984166 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983966    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 17:16:52.984166 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983972    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 17:16:52.984166 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983981    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 17:16:52.984166 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.983987    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 17:16:52.984166 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.984008    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 17:16:52.984166 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.984014    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 17:16:52.987529 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.987515    2574 server.go:1268] "Started kubelet"
Jul 28 17:16:52.987661 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.987622    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 17:16:52.987661 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.987615    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 17:16:52.987813 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.987691    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 17:16:52.988503 ip-10-0-140-52 systemd[1]: Started Kubernetes Kubelet.
Jul 28 17:16:52.989257 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.989238    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 17:16:52.989917 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.989900    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 17:16:52.990183 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:52.990139    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 17:16:52.990270 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:52.990232    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 17:16:52.992376 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.992345    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 17:16:52.993207 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:52.993188    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 17:16:52.995987 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:52.994912    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-52.ec2.internal.18c6839d152ef408  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-52.ec2.internal,UID:ip-10-0-140-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-52.ec2.internal,},FirstTimestamp:2026-07-28 17:16:52.987483144 +0000 UTC m=+0.415262376,LastTimestamp:2026-07-28 17:16:52.987483144 +0000 UTC m=+0.415262376,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-52.ec2.internal,}"
Jul 28 17:16:52.998979 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:52.998957    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:16:53.000151 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.000124    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 17:16:53.000224 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.000189    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 17:16:53.000283 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.000258    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.000779 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.000757    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 17:16:53.000879 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.000801    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 17:16:53.000879 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.000817    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 17:16:53.000981 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.000904    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 17:16:53.000981 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.000914    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 17:16:53.001607 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.001590    2574 factory.go:55] Registering systemd factory
Jul 28 17:16:53.001673 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.001634    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 28 17:16:53.001876 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.001858    2574 factory.go:153] Registering CRI-O factory
Jul 28 17:16:53.001876 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.001877    2574 factory.go:223] Registration of the crio container factory successfully
Jul 28 17:16:53.001983 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.001924    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 17:16:53.001983 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.001945    2574 factory.go:103] Registering Raw factory
Jul 28 17:16:53.001983 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.001956    2574 manager.go:1196] Started watching for new ooms in manager
Jul 28 17:16:53.002238 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.002218    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 17:16:53.002369 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.002349    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 17:16:53.002369 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.002368    2574 manager.go:349] Starting recovery of all containers
Jul 28 17:16:53.016137 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.015973    2574 manager.go:354] Recovery completed
Jul 28 17:16:53.021666 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.021647    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:16:53.023723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.023591    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:16:53.023793 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.023740    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:16:53.023793 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.023755    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:16:53.024392 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.024378    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:16:53.024392 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.024377    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 17:16:53.024545 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.024398    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 17:16:53.024545 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.024415    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:16:53.025134 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.025112    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:16:53.025179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.025146    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:16:53.025179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.025161    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:16:53.027247 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.027234    2574 policy_none.go:49] "None policy: Start"
Jul 28 17:16:53.027302 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.027256    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 17:16:53.027302 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.027268    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 17:16:53.029516 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.029505    2574 policy_none.go:47] "Start"
Jul 28 17:16:53.032867 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.032769    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-52.ec2.internal.18c6839d1757eb25  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-52.ec2.internal,UID:ip-10-0-140-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-52.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-52.ec2.internal,},FirstTimestamp:2026-07-28 17:16:53.023722277 +0000 UTC m=+0.451501511,LastTimestamp:2026-07-28 17:16:53.023722277 +0000 UTC m=+0.451501511,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-52.ec2.internal,}"
Jul 28 17:16:53.035840 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.035772    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-52.ec2.internal.18c6839d1758528b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-52.ec2.internal,UID:ip-10-0-140-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-52.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-52.ec2.internal,},FirstTimestamp:2026-07-28 17:16:53.023748747 +0000 UTC m=+0.451527982,LastTimestamp:2026-07-28 17:16:53.023748747 +0000 UTC m=+0.451527982,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-52.ec2.internal,}"
Jul 28 17:16:53.044880 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.044799    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-52.ec2.internal.18c6839d17587f7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-52.ec2.internal,UID:ip-10-0-140-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-52.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-52.ec2.internal,},FirstTimestamp:2026-07-28 17:16:53.023760253 +0000 UTC m=+0.451539484,LastTimestamp:2026-07-28 17:16:53.023760253 +0000 UTC m=+0.451539484,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-52.ec2.internal,}"
Jul 28 17:16:53.056511 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.056434    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-52.ec2.internal.18c6839d1757eb25\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-52.ec2.internal.18c6839d1757eb25  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-52.ec2.internal,UID:ip-10-0-140-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-52.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-52.ec2.internal,},FirstTimestamp:2026-07-28 17:16:53.023722277 +0000 UTC m=+0.451501511,LastTimestamp:2026-07-28 17:16:53.025128891 +0000 UTC m=+0.452908126,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-52.ec2.internal,}"
Jul 28 17:16:53.065009 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.064993    2574 manager.go:337] "Starting Device Plugin manager"
Jul 28 17:16:53.065101 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.065035    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 17:16:53.065101 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.065046    2574 server.go:87] "Starting device plugin registration server"
Jul 28 17:16:53.065350 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.065336    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 17:16:53.065398 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.065355    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 17:16:53.065466 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.065447    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 17:16:53.065551 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.065537    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 17:16:53.065551 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.065548    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 17:16:53.066124 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.066104    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 17:16:53.066202 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.066167    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.067372 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.067286    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-52.ec2.internal.18c6839d1758528b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-52.ec2.internal.18c6839d1758528b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-52.ec2.internal,UID:ip-10-0-140-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-52.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-52.ec2.internal,},FirstTimestamp:2026-07-28 17:16:53.023748747 +0000 UTC m=+0.451527982,LastTimestamp:2026-07-28 17:16:53.025153324 +0000 UTC m=+0.452932561,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-52.ec2.internal,}"
Jul 28 17:16:53.076982 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.076908    2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-52.ec2.internal.18c6839d17587f7d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-52.ec2.internal.18c6839d17587f7d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-52.ec2.internal,UID:ip-10-0-140-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-52.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-52.ec2.internal,},FirstTimestamp:2026-07-28 17:16:53.023760253 +0000 UTC m=+0.451539484,LastTimestamp:2026-07-28 17:16:53.02516519 +0000 UTC m=+0.452944422,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-52.ec2.internal,}"
Jul 28 17:16:53.092978 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.092889    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-52.ec2.internal.18c6839d19f23185  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-52.ec2.internal,UID:ip-10-0-140-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-140-52.ec2.internal,},FirstTimestamp:2026-07-28 17:16:53.067387269 +0000 UTC m=+0.495166490,LastTimestamp:2026-07-28 17:16:53.067387269 +0000 UTC m=+0.495166490,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-52.ec2.internal,}"
Jul 28 17:16:53.139193 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.139154    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 17:16:53.140478 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.140449    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 17:16:53.140611 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.140499    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 17:16:53.140611 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.140527    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 17:16:53.140611 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.140576    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 17:16:53.143797 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.143777    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xs4h2"
Jul 28 17:16:53.150435 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.150412    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 28 17:16:53.150571 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.150503    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xs4h2"
Jul 28 17:16:53.166233 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.166174    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:16:53.167206 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.167175    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:16:53.167206 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.167208    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:16:53.167343 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.167221    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:16:53.167343 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.167255    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.185235 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.185208    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.185346 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.185236    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-52.ec2.internal\": node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.202486 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.202457    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.241611 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.241574    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal"]
Jul 28 17:16:53.241707 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.241660    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:16:53.242802 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.242785    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:16:53.242859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.242818    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:16:53.242859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.242830    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:16:53.245361 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.245348    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:16:53.245490 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.245476    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.245528 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.245509    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:16:53.246256 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.246239    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:16:53.246349 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.246271    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:16:53.246349 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.246276    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:16:53.246349 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.246291    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:16:53.246349 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.246293    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:16:53.246349 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.246300    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:16:53.248685 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.248659    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.248776 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.248694    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:16:53.249461 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.249445    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:16:53.249538 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.249473    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:16:53.249538 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.249484    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:16:53.268905 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.268880    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-52.ec2.internal\" not found" node="ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.273689 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.273674    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-52.ec2.internal\" not found" node="ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.302588 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.302552    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.302751 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.302601    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a7be853eabb2e477d6252d8cbc46b72-config\") pod \"kube-apiserver-proxy-ip-10-0-140-52.ec2.internal\" (UID: \"2a7be853eabb2e477d6252d8cbc46b72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.302751 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.302632    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ffa06e1665a7778d4ccba5e41bd423d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal\" (UID: \"7ffa06e1665a7778d4ccba5e41bd423d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.302751 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.302658    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ffa06e1665a7778d4ccba5e41bd423d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal\" (UID: \"7ffa06e1665a7778d4ccba5e41bd423d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.403082 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.403036    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.403229 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.403099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a7be853eabb2e477d6252d8cbc46b72-config\") pod \"kube-apiserver-proxy-ip-10-0-140-52.ec2.internal\" (UID: \"2a7be853eabb2e477d6252d8cbc46b72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.403229 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.403127    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ffa06e1665a7778d4ccba5e41bd423d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal\" (UID: \"7ffa06e1665a7778d4ccba5e41bd423d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.403229 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.403150    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ffa06e1665a7778d4ccba5e41bd423d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal\" (UID: \"7ffa06e1665a7778d4ccba5e41bd423d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.403229 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.403216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a7be853eabb2e477d6252d8cbc46b72-config\") pod \"kube-apiserver-proxy-ip-10-0-140-52.ec2.internal\" (UID: \"2a7be853eabb2e477d6252d8cbc46b72\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.403393 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.403240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ffa06e1665a7778d4ccba5e41bd423d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal\" (UID: \"7ffa06e1665a7778d4ccba5e41bd423d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.403393 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.403216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ffa06e1665a7778d4ccba5e41bd423d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal\" (UID: \"7ffa06e1665a7778d4ccba5e41bd423d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.503402 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.503327    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.572637 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.572585    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.577902 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.577884    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:53.604331 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.604298    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.707410 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.707366    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.808462 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.808433    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.909369 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:53.909338    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:53.919249 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.919222    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:16:53.936294 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.936259    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 17:16:53.936423 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:53.936400    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 17:16:54.009737 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:54.009703    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-52.ec2.internal\" not found"
Jul 28 17:16:54.094268 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.094175    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:16:54.100739 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.100716    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:54.118775 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.118748    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:16:54.120638 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.120623    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal"
Jul 28 17:16:54.133062 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.133042    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:16:54.156126 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.156083    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:11:53 +0000 UTC" deadline="2028-03-14 06:57:57.415177092 +0000 UTC"
Jul 28 17:16:54.156126 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.156122    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14269h41m3.259059369s"
Jul 28 17:16:54.338363 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:54.338327    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffa06e1665a7778d4ccba5e41bd423d.slice/crio-799af47420aab69577fefd1fa5e308d53024529dfa4ad5c0fc086406a6a47110 WatchSource:0}: Error finding container 799af47420aab69577fefd1fa5e308d53024529dfa4ad5c0fc086406a6a47110: Status 404 returned error can't find the container with id 799af47420aab69577fefd1fa5e308d53024529dfa4ad5c0fc086406a6a47110
Jul 28 17:16:54.338580 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:54.338527    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7be853eabb2e477d6252d8cbc46b72.slice/crio-09cd3a99c09da06c293ea003d977ccb719345460e27ec6654cd35948e227ef20 WatchSource:0}: Error finding container 09cd3a99c09da06c293ea003d977ccb719345460e27ec6654cd35948e227ef20: Status 404 returned error can't find the container with id 09cd3a99c09da06c293ea003d977ccb719345460e27ec6654cd35948e227ef20
Jul 28 17:16:54.342778 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.342761    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:16:54.362727 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.362705    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:16:54.418624 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.418595    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:16:54.977039 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.976999    2574 apiserver.go:52] "Watching apiserver"
Jul 28 17:16:54.986867 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.986832    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 17:16:54.989293 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.989254    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-77rmg","kube-system/konnectivity-agent-b74hg","kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb","openshift-image-registry/node-ca-z7pbf","openshift-network-diagnostics/network-check-target-xrgmh","openshift-network-operator/iptables-alerter-m4x6s","openshift-ovn-kubernetes/ovnkube-node-qbd6q","kube-system/global-pull-secret-syncer-9l299","openshift-cluster-node-tuning-operator/tuned-x7pq9","openshift-dns/node-resolver-7qqxm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal","openshift-multus/multus-additional-cni-plugins-lpb4n","openshift-multus/multus-lr8ct"]
Jul 28 17:16:54.992281 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.992257    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:54.994776 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.994446    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:54.996271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.995675    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:16:54.996271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.995892    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 17:16:54.996271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.995970    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-58r5s\""
Jul 28 17:16:54.996271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.996104    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 17:16:54.997116 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.996823    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:54.998797 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.997531    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 17:16:54.998797 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.997901    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 17:16:54.998797 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.998169    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 17:16:54.998797 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.998520    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g55cr\""
Jul 28 17:16:54.998797 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.998701    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 17:16:54.998797 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.998727    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 17:16:55.000551 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.999471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.000551 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:54.999818    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 17:16:55.000551 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.000241    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pch5h\""
Jul 28 17:16:55.001567 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.000905    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 17:16:55.002193 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.001811    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.004132 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.004096    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:16:55.004228 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.004170    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.004451    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.004480    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t8p6k\""
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.004719    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.005044    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.005056    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.005333    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.005413    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.006651    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rspxk\""
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.006738    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.006864 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.006820    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:16:55.008974 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.008916    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:55.009099 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.008988    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:16:55.012027 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.011467    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:16:55.015529 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.013966    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016451    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-cnibin\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-hostroot\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa9c7560-3e42-4d51-899a-460ddce48eda-host-slash\") pod \"iptables-alerter-m4x6s\" (UID: \"fa9c7560-3e42-4d51-899a-460ddce48eda\") " pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016545    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fpx5\" (UniqueName: \"kubernetes.io/projected/fa9c7560-3e42-4d51-899a-460ddce48eda-kube-api-access-2fpx5\") pod \"iptables-alerter-m4x6s\" (UID: \"fa9c7560-3e42-4d51-899a-460ddce48eda\") " pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4de10f76-be20-4f9f-b9b9-e5035874d200-cni-binary-copy\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016596    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-conf-dir\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-daemon-config\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016646    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0714666-577a-4238-828b-d307712d99a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016673    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrvkd\" (UniqueName: \"kubernetes.io/projected/f0714666-577a-4238-828b-d307712d99a6-kube-api-access-qrvkd\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016701    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-var-lib-kubelet\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016810    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-sys-fs\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016840    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mtnmv\""
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016849    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa9c7560-3e42-4d51-899a-460ddce48eda-iptables-alerter-script\") pod \"iptables-alerter-m4x6s\" (UID: \"fa9c7560-3e42-4d51-899a-460ddce48eda\") " pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016870    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-cnibin\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016915    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-os-release\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.017657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-os-release\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016969    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.016994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-device-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-system-cni-dir\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017076    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0714666-577a-4238-828b-d307712d99a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017092    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-run-netns\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-run-multus-certs\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017190    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017200    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-socket-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017231    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-etc-selinux\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tfr8\" (UniqueName: \"kubernetes.io/projected/3c630921-60fe-4480-ab51-ca22cee19605-kube-api-access-7tfr8\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btvpl\" (UniqueName: \"kubernetes.io/projected/9001436c-49c2-49d6-967a-2debaf26b00b-kube-api-access-btvpl\") pod \"node-ca-z7pbf\" (UID: \"9001436c-49c2-49d6-967a-2debaf26b00b\") " pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9001436c-49c2-49d6-967a-2debaf26b00b-host\") pod \"node-ca-z7pbf\" (UID: \"9001436c-49c2-49d6-967a-2debaf26b00b\") " pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-cni-dir\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-run-k8s-cni-cncf-io\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017928    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z9r66\""
Jul 28 17:16:55.018651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017934    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-var-lib-cni-bin\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.019503 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017958    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-etc-kubernetes\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.019503 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.017982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9001436c-49c2-49d6-967a-2debaf26b00b-serviceca\") pod \"node-ca-z7pbf\" (UID: \"9001436c-49c2-49d6-967a-2debaf26b00b\") " pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.019503 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.018014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-system-cni-dir\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.019503 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.018040    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-socket-dir-parent\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.019503 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.018066    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0714666-577a-4238-828b-d307712d99a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.019503 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.018098    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-var-lib-cni-multus\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.019503 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.018118    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 17:16:55.019503 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.018125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2jft\" (UniqueName: \"kubernetes.io/projected/4de10f76-be20-4f9f-b9b9-e5035874d200-kube-api-access-g2jft\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.019965 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.019507    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.021125 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.020091    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-registration-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.021252 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.021209    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:16:55.023526 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.023277    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 17:16:55.023526 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.023329    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 17:16:55.023526 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.023488    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ntdq4\""
Jul 28 17:16:55.024553 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.024518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.028869 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.028847    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 17:16:55.028965 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.028914    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 17:16:55.029074 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.029053    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 17:16:55.030394 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.030374    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 17:16:55.030535 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.030385    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r6lkq\""
Jul 28 17:16:55.030930 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.030914    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 17:16:55.031173 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.030927    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 17:16:55.048740 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.048694    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r45st"
Jul 28 17:16:55.060153 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.060114    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r45st"
Jul 28 17:16:55.102916 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.102886    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 17:16:55.121118 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121084    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-kubelet-config\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.121300 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121138    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.121300 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121163    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/307dbf09-689f-436e-9019-bfa20d6944c3-ovn-node-metrics-cert\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.121300 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121184    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/307dbf09-689f-436e-9019-bfa20d6944c3-ovnkube-script-lib\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.121300 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-os-release\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.121519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-device-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.121519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121360    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-device-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.121519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121315    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-os-release\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.121519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4jt8\" (UniqueName: \"kubernetes.io/projected/93a8f35e-919b-4c2b-ab51-54cce84896bf-kube-api-access-n4jt8\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:55.121519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121407    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftcjt\" (UniqueName: \"kubernetes.io/projected/444a7bef-5a16-4460-9321-8bebda825ffe-kube-api-access-ftcjt\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.121519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121435    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-slash\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.121519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121462    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-socket-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.121519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121489    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btvpl\" (UniqueName: \"kubernetes.io/projected/9001436c-49c2-49d6-967a-2debaf26b00b-kube-api-access-btvpl\") pod \"node-ca-z7pbf\" (UID: \"9001436c-49c2-49d6-967a-2debaf26b00b\") " pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-cni-netd\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9001436c-49c2-49d6-967a-2debaf26b00b-host\") pod \"node-ca-z7pbf\" (UID: \"9001436c-49c2-49d6-967a-2debaf26b00b\") " pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-cni-dir\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121650    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-socket-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-run-k8s-cni-cncf-io\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-etc-kubernetes\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121704    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9001436c-49c2-49d6-967a-2debaf26b00b-host\") pod \"node-ca-z7pbf\" (UID: \"9001436c-49c2-49d6-967a-2debaf26b00b\") " pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121724    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-sys\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121749    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6e7925a-b3c4-4064-925d-cdc5e31e48f1-hosts-file\") pod \"node-resolver-7qqxm\" (UID: \"f6e7925a-b3c4-4064-925d-cdc5e31e48f1\") " pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121767    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-run-k8s-cni-cncf-io\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121774    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-sysctl-conf\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-systemd\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121808    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-cni-dir\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121827    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-kubelet\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121820    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-etc-kubernetes\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121866    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bw6s\" (UniqueName: \"kubernetes.io/projected/307dbf09-689f-436e-9019-bfa20d6944c3-kube-api-access-2bw6s\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.121935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121913    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2jft\" (UniqueName: \"kubernetes.io/projected/4de10f76-be20-4f9f-b9b9-e5035874d200-kube-api-access-g2jft\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-run\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.121979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-run-netns\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122005    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-cni-bin\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-hostroot\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122108    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-daemon-config\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122145    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-hostroot\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122186    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrvkd\" (UniqueName: \"kubernetes.io/projected/f0714666-577a-4238-828b-d307712d99a6-kube-api-access-qrvkd\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122217    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa38da5b-d785-47e5-b319-87b782aad3e4-agent-certs\") pod \"konnectivity-agent-b74hg\" (UID: \"aa38da5b-d785-47e5-b319-87b782aad3e4\") " pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122269    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa38da5b-d785-47e5-b319-87b782aad3e4-konnectivity-ca\") pod \"konnectivity-agent-b74hg\" (UID: \"aa38da5b-d785-47e5-b319-87b782aad3e4\") " pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122294    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-var-lib-kubelet\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-host\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-sys-fs\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122367    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-os-release\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122435    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vxp8\" (UniqueName: \"kubernetes.io/projected/f6e7925a-b3c4-4064-925d-cdc5e31e48f1-kube-api-access-5vxp8\") pod \"node-resolver-7qqxm\" (UID: \"f6e7925a-b3c4-4064-925d-cdc5e31e48f1\") " pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.122824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122462    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122489    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-system-cni-dir\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122462    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-sys-fs\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122516    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-os-release\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0714666-577a-4238-828b-d307712d99a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122600    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-system-cni-dir\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122605    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122632    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-sysctl-d\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122671    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-run-systemd\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/307dbf09-689f-436e-9019-bfa20d6944c3-ovnkube-config\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122742    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-run-netns\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122769    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-run-multus-certs\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122772    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122807    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-etc-selinux\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tfr8\" (UniqueName: \"kubernetes.io/projected/3c630921-60fe-4480-ab51-ca22cee19605-kube-api-access-7tfr8\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122846    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-run-multus-certs\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.123475 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122807    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-daemon-config\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-systemd-units\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122899    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/307dbf09-689f-436e-9019-bfa20d6944c3-env-overrides\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122926    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-var-lib-cni-bin\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122952    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9001436c-49c2-49d6-967a-2debaf26b00b-serviceca\") pod \"node-ca-z7pbf\" (UID: \"9001436c-49c2-49d6-967a-2debaf26b00b\") " pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122980    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123008    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-lib-modules\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123034    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/444a7bef-5a16-4460-9321-8bebda825ffe-etc-tuned\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123059    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-var-lib-openvswitch\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-run-ovn\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122847    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-run-netns\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.122952    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-etc-selinux\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123116    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f0714666-577a-4238-828b-d307712d99a6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123111    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-node-log\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123183    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-system-cni-dir\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123260    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-var-lib-cni-bin\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123278    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-socket-dir-parent\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.124372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123321    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-system-cni-dir\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123369    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0714666-577a-4238-828b-d307712d99a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123385    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9001436c-49c2-49d6-967a-2debaf26b00b-serviceca\") pod \"node-ca-z7pbf\" (UID: \"9001436c-49c2-49d6-967a-2debaf26b00b\") " pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-socket-dir-parent\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123481    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-sysconfig\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123550    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-var-lib-cni-multus\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123576    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-registration-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123602    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-modprobe-d\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-cnibin\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123643    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c630921-60fe-4480-ab51-ca22cee19605-registration-dir\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123655    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa9c7560-3e42-4d51-899a-460ddce48eda-host-slash\") pod \"iptables-alerter-m4x6s\" (UID: \"fa9c7560-3e42-4d51-899a-460ddce48eda\") " pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123691    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-cnibin\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123697    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa9c7560-3e42-4d51-899a-460ddce48eda-host-slash\") pod \"iptables-alerter-m4x6s\" (UID: \"fa9c7560-3e42-4d51-899a-460ddce48eda\") " pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fpx5\" (UniqueName: \"kubernetes.io/projected/fa9c7560-3e42-4d51-899a-460ddce48eda-kube-api-access-2fpx5\") pod \"iptables-alerter-m4x6s\" (UID: \"fa9c7560-3e42-4d51-899a-460ddce48eda\") " pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-dbus\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123762    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/444a7bef-5a16-4460-9321-8bebda825ffe-tmp\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.125272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123629    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-var-lib-cni-multus\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123785    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6e7925a-b3c4-4064-925d-cdc5e31e48f1-tmp-dir\") pod \"node-resolver-7qqxm\" (UID: \"f6e7925a-b3c4-4064-925d-cdc5e31e48f1\") " pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123827    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-etc-openvswitch\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123856    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-run-openvswitch\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123873    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f0714666-577a-4238-828b-d307712d99a6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4de10f76-be20-4f9f-b9b9-e5035874d200-cni-binary-copy\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123926    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-conf-dir\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0714666-577a-4238-828b-d307712d99a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.123964    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-multus-conf-dir\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124004    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-kubernetes\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124082    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-log-socket\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124156    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-var-lib-kubelet\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124196    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa9c7560-3e42-4d51-899a-460ddce48eda-iptables-alerter-script\") pod \"iptables-alerter-m4x6s\" (UID: \"fa9c7560-3e42-4d51-899a-460ddce48eda\") " pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124225    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-cnibin\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124469    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4de10f76-be20-4f9f-b9b9-e5035874d200-cni-binary-copy\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124506    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0714666-577a-4238-828b-d307712d99a6-cni-binary-copy\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124537    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0714666-577a-4238-828b-d307712d99a6-cnibin\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.126109 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124561    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4de10f76-be20-4f9f-b9b9-e5035874d200-host-var-lib-kubelet\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.126976 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.124737    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa9c7560-3e42-4d51-899a-460ddce48eda-iptables-alerter-script\") pod \"iptables-alerter-m4x6s\" (UID: \"fa9c7560-3e42-4d51-899a-460ddce48eda\") " pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.129797 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.129771    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 17:16:55.133971 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.133947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btvpl\" (UniqueName: \"kubernetes.io/projected/9001436c-49c2-49d6-967a-2debaf26b00b-kube-api-access-btvpl\") pod \"node-ca-z7pbf\" (UID: \"9001436c-49c2-49d6-967a-2debaf26b00b\") " pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.133971 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.133958    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2jft\" (UniqueName: \"kubernetes.io/projected/4de10f76-be20-4f9f-b9b9-e5035874d200-kube-api-access-g2jft\") pod \"multus-lr8ct\" (UID: \"4de10f76-be20-4f9f-b9b9-e5035874d200\") " pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.134822 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.134794    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrvkd\" (UniqueName: \"kubernetes.io/projected/f0714666-577a-4238-828b-d307712d99a6-kube-api-access-qrvkd\") pod \"multus-additional-cni-plugins-lpb4n\" (UID: \"f0714666-577a-4238-828b-d307712d99a6\") " pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.138461 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.138439    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tfr8\" (UniqueName: \"kubernetes.io/projected/3c630921-60fe-4480-ab51-ca22cee19605-kube-api-access-7tfr8\") pod \"aws-ebs-csi-driver-node-wd5zb\" (UID: \"3c630921-60fe-4480-ab51-ca22cee19605\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.144666 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.144518    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fpx5\" (UniqueName: \"kubernetes.io/projected/fa9c7560-3e42-4d51-899a-460ddce48eda-kube-api-access-2fpx5\") pod \"iptables-alerter-m4x6s\" (UID: \"fa9c7560-3e42-4d51-899a-460ddce48eda\") " pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.146147 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.146077    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal" event={"ID":"7ffa06e1665a7778d4ccba5e41bd423d","Type":"ContainerStarted","Data":"799af47420aab69577fefd1fa5e308d53024529dfa4ad5c0fc086406a6a47110"}
Jul 28 17:16:55.148689 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.148663    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal" event={"ID":"2a7be853eabb2e477d6252d8cbc46b72","Type":"ContainerStarted","Data":"09cd3a99c09da06c293ea003d977ccb719345460e27ec6654cd35948e227ef20"}
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225143    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-kubernetes\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-log-socket\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225218    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-kubelet-config\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225265    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-kubernetes\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225267    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/307dbf09-689f-436e-9019-bfa20d6944c3-ovn-node-metrics-cert\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/307dbf09-689f-436e-9019-bfa20d6944c3-ovnkube-script-lib\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225348    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4jt8\" (UniqueName: \"kubernetes.io/projected/93a8f35e-919b-4c2b-ab51-54cce84896bf-kube-api-access-n4jt8\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftcjt\" (UniqueName: \"kubernetes.io/projected/444a7bef-5a16-4460-9321-8bebda825ffe-kube-api-access-ftcjt\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-slash\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225429    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-cni-netd\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225460    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-sys\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225481    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6e7925a-b3c4-4064-925d-cdc5e31e48f1-hosts-file\") pod \"node-resolver-7qqxm\" (UID: \"f6e7925a-b3c4-4064-925d-cdc5e31e48f1\") " pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-sysctl-conf\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225525    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-systemd\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225552    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-kubelet\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.225743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225576    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bw6s\" (UniqueName: \"kubernetes.io/projected/307dbf09-689f-436e-9019-bfa20d6944c3-kube-api-access-2bw6s\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.226618 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-run\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.226618 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225626    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-run-netns\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.226618 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-cni-bin\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.226618 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.225738    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-cni-bin\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227348    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227374    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227429    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa38da5b-d785-47e5-b319-87b782aad3e4-agent-certs\") pod \"konnectivity-agent-b74hg\" (UID: \"aa38da5b-d785-47e5-b319-87b782aad3e4\") " pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa38da5b-d785-47e5-b319-87b782aad3e4-konnectivity-ca\") pod \"konnectivity-agent-b74hg\" (UID: \"aa38da5b-d785-47e5-b319-87b782aad3e4\") " pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-var-lib-kubelet\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227529    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-host\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227565    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227596    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vxp8\" (UniqueName: \"kubernetes.io/projected/f6e7925a-b3c4-4064-925d-cdc5e31e48f1-kube-api-access-5vxp8\") pod \"node-resolver-7qqxm\" (UID: \"f6e7925a-b3c4-4064-925d-cdc5e31e48f1\") " pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227637    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-sysctl-d\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-run-systemd\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227713    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-log-socket\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227778    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/307dbf09-689f-436e-9019-bfa20d6944c3-ovnkube-script-lib\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.227852    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-kubelet\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228031    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-run\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228066    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-run-netns\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228111    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-kubelet-config\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228156    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-var-lib-kubelet\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.229114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228212    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-slash\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228391    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-sysctl-conf\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228466    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-host\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228599    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-sysctl-d\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228613    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-cni-netd\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228663    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6e7925a-b3c4-4064-925d-cdc5e31e48f1-hosts-file\") pod \"node-resolver-7qqxm\" (UID: \"f6e7925a-b3c4-4064-925d-cdc5e31e48f1\") " pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228720    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-sys\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.228725    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228785    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-run-systemd\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.228908    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs podName:93a8f35e-919b-4c2b-ab51-54cce84896bf nodeName:}" failed. No retries permitted until 2026-07-28 17:16:55.728874319 +0000 UTC m=+3.156653560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs") pod "network-metrics-daemon-77rmg" (UID: "93a8f35e-919b-4c2b-ab51-54cce84896bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.228915    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa38da5b-d785-47e5-b319-87b782aad3e4-konnectivity-ca\") pod \"konnectivity-agent-b74hg\" (UID: \"aa38da5b-d785-47e5-b319-87b782aad3e4\") " pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229010    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-systemd\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229350    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/307dbf09-689f-436e-9019-bfa20d6944c3-ovnkube-config\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/307dbf09-689f-436e-9019-bfa20d6944c3-ovnkube-config\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-systemd-units\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229522    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/307dbf09-689f-436e-9019-bfa20d6944c3-env-overrides\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.230222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-lib-modules\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/444a7bef-5a16-4460-9321-8bebda825ffe-etc-tuned\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229656    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-var-lib-openvswitch\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229689    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-run-ovn\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-node-log\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-sysconfig\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229803    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-modprobe-d\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-dbus\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/444a7bef-5a16-4460-9321-8bebda825ffe-tmp\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6e7925a-b3c4-4064-925d-cdc5e31e48f1-tmp-dir\") pod \"node-resolver-7qqxm\" (UID: \"f6e7925a-b3c4-4064-925d-cdc5e31e48f1\") " pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.229973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-etc-openvswitch\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.230004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-run-openvswitch\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.230114    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-run-openvswitch\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.230190    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-systemd-units\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.230620    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/307dbf09-689f-436e-9019-bfa20d6944c3-env-overrides\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.230735    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:16:55.231075 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.230816    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret podName:aad70f3d-c86b-45f4-abdf-4d86bdecdf0b nodeName:}" failed. No retries permitted until 2026-07-28 17:16:55.730793188 +0000 UTC m=+3.158572407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret") pod "global-pull-secret-syncer-9l299" (UID: "aad70f3d-c86b-45f4-abdf-4d86bdecdf0b") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:16:55.231959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.230947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-lib-modules\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.231959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.231193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.231263    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-var-lib-openvswitch\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.231315    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-run-ovn\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.231360    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-node-log\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.231416    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-sysconfig\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.231959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.231748    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307dbf09-689f-436e-9019-bfa20d6944c3-etc-openvswitch\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.231959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.231871    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/444a7bef-5a16-4460-9321-8bebda825ffe-etc-modprobe-d\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.231959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.231942    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-dbus\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.232474 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.232006    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6e7925a-b3c4-4064-925d-cdc5e31e48f1-tmp-dir\") pod \"node-resolver-7qqxm\" (UID: \"f6e7925a-b3c4-4064-925d-cdc5e31e48f1\") " pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.232936 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.232579    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/307dbf09-689f-436e-9019-bfa20d6944c3-ovn-node-metrics-cert\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.234416 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.234324    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:16:55.234416 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.234351    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:16:55.234416 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.234366    2574 projected.go:196] Error preparing data for projected volume kube-api-access-g8btw for pod openshift-network-diagnostics/network-check-target-xrgmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:16:55.234690 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.234475    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw podName:176e178e-5fa7-4789-93af-ac877709077a nodeName:}" failed. No retries permitted until 2026-07-28 17:16:55.734455622 +0000 UTC m=+3.162234866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g8btw" (UniqueName: "kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw") pod "network-check-target-xrgmh" (UID: "176e178e-5fa7-4789-93af-ac877709077a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:16:55.234690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.234558    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa38da5b-d785-47e5-b319-87b782aad3e4-agent-certs\") pod \"konnectivity-agent-b74hg\" (UID: \"aa38da5b-d785-47e5-b319-87b782aad3e4\") " pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:16:55.236737 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.236681    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4jt8\" (UniqueName: \"kubernetes.io/projected/93a8f35e-919b-4c2b-ab51-54cce84896bf-kube-api-access-n4jt8\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:55.237864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.237840    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/444a7bef-5a16-4460-9321-8bebda825ffe-tmp\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.240354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.240114    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftcjt\" (UniqueName: \"kubernetes.io/projected/444a7bef-5a16-4460-9321-8bebda825ffe-kube-api-access-ftcjt\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.240354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.240311    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/444a7bef-5a16-4460-9321-8bebda825ffe-etc-tuned\") pod \"tuned-x7pq9\" (UID: \"444a7bef-5a16-4460-9321-8bebda825ffe\") " pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.241566 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.241520    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bw6s\" (UniqueName: \"kubernetes.io/projected/307dbf09-689f-436e-9019-bfa20d6944c3-kube-api-access-2bw6s\") pod \"ovnkube-node-qbd6q\" (UID: \"307dbf09-689f-436e-9019-bfa20d6944c3\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.247690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.247665    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vxp8\" (UniqueName: \"kubernetes.io/projected/f6e7925a-b3c4-4064-925d-cdc5e31e48f1-kube-api-access-5vxp8\") pod \"node-resolver-7qqxm\" (UID: \"f6e7925a-b3c4-4064-925d-cdc5e31e48f1\") " pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.309524 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.309486    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m4x6s"
Jul 28 17:16:55.321575 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.321535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lpb4n"
Jul 28 17:16:55.335431 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.335399    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lr8ct"
Jul 28 17:16:55.343909 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.343882    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb"
Jul 28 17:16:55.353042 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.353009    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z7pbf"
Jul 28 17:16:55.361247 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.361203    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:16:55.370914 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.370885    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7pq9"
Jul 28 17:16:55.379165 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.379138    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7qqxm"
Jul 28 17:16:55.386298 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.386276    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:16:55.734462 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.734408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:55.734666 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.734598    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:16:55.734728 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.734601    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:16:55.734728 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.734682    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret podName:aad70f3d-c86b-45f4-abdf-4d86bdecdf0b nodeName:}" failed. No retries permitted until 2026-07-28 17:16:56.734660385 +0000 UTC m=+4.162439620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret") pod "global-pull-secret-syncer-9l299" (UID: "aad70f3d-c86b-45f4-abdf-4d86bdecdf0b") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:16:55.734812 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.734725    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:16:55.734812 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.734744    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:16:55.734812 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.734753    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:55.734812 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.734758    2574 projected.go:196] Error preparing data for projected volume kube-api-access-g8btw for pod openshift-network-diagnostics/network-check-target-xrgmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:16:55.734967 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.734820    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:16:55.734967 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.734842    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw podName:176e178e-5fa7-4789-93af-ac877709077a nodeName:}" failed. No retries permitted until 2026-07-28 17:16:56.734824849 +0000 UTC m=+4.162604073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8btw" (UniqueName: "kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw") pod "network-check-target-xrgmh" (UID: "176e178e-5fa7-4789-93af-ac877709077a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:16:55.734967 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:55.734868    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs podName:93a8f35e-919b-4c2b-ab51-54cce84896bf nodeName:}" failed. No retries permitted until 2026-07-28 17:16:56.734852147 +0000 UTC m=+4.162631384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs") pod "network-metrics-daemon-77rmg" (UID: "93a8f35e-919b-4c2b-ab51-54cce84896bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:16:55.944176 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:55.944138    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:16:56.063876 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:56.063833    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:11:55 +0000 UTC" deadline="2028-02-02 10:16:20.735145507 +0000 UTC"
Jul 28 17:16:56.063876 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:56.063873    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13288h59m24.67127892s"
Jul 28 17:16:56.140764 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:56.140729    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:56.140969 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:56.140851    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:16:56.352719 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:56.352687    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0714666_577a_4238_828b_d307712d99a6.slice/crio-70f34b6058e0217260e8cf584278b118567417ea0936841a3f7f3468fd8a53c0 WatchSource:0}: Error finding container 70f34b6058e0217260e8cf584278b118567417ea0936841a3f7f3468fd8a53c0: Status 404 returned error can't find the container with id 70f34b6058e0217260e8cf584278b118567417ea0936841a3f7f3468fd8a53c0
Jul 28 17:16:56.354490 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:56.354433    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307dbf09_689f_436e_9019_bfa20d6944c3.slice/crio-1c93c9e23c4f8131d64fe436df0216518b6924ddbd0c044f451d59909440f3b3 WatchSource:0}: Error finding container 1c93c9e23c4f8131d64fe436df0216518b6924ddbd0c044f451d59909440f3b3: Status 404 returned error can't find the container with id 1c93c9e23c4f8131d64fe436df0216518b6924ddbd0c044f451d59909440f3b3
Jul 28 17:16:56.355410 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:56.355389    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa38da5b_d785_47e5_b319_87b782aad3e4.slice/crio-fcd44899cfce41229e916e37893cebc1fd345bcc0650d7538b0757dccb006129 WatchSource:0}: Error finding container fcd44899cfce41229e916e37893cebc1fd345bcc0650d7538b0757dccb006129: Status 404 returned error can't find the container with id fcd44899cfce41229e916e37893cebc1fd345bcc0650d7538b0757dccb006129
Jul 28 17:16:56.358346 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:56.358323    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9001436c_49c2_49d6_967a_2debaf26b00b.slice/crio-5f3f519aab14607ed5aaac22ebc9184a9549c0c052c1a479abc66749e8111116 WatchSource:0}: Error finding container 5f3f519aab14607ed5aaac22ebc9184a9549c0c052c1a479abc66749e8111116: Status 404 returned error can't find the container with id 5f3f519aab14607ed5aaac22ebc9184a9549c0c052c1a479abc66749e8111116
Jul 28 17:16:56.359184 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:56.359010    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9c7560_3e42_4d51_899a_460ddce48eda.slice/crio-5e8253e1d22fb051bbdd9acb12ad1b07ad3a249dcfc485d4feede56c6b416442 WatchSource:0}: Error finding container 5e8253e1d22fb051bbdd9acb12ad1b07ad3a249dcfc485d4feede56c6b416442: Status 404 returned error can't find the container with id 5e8253e1d22fb051bbdd9acb12ad1b07ad3a249dcfc485d4feede56c6b416442
Jul 28 17:16:56.360430 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:56.360404    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de10f76_be20_4f9f_b9b9_e5035874d200.slice/crio-af6e09bc819ea8ccd11fec38416a7f8c58b488a2d7c21b5be65635b99ed0849b WatchSource:0}: Error finding container af6e09bc819ea8ccd11fec38416a7f8c58b488a2d7c21b5be65635b99ed0849b: Status 404 returned error can't find the container with id af6e09bc819ea8ccd11fec38416a7f8c58b488a2d7c21b5be65635b99ed0849b
Jul 28 17:16:56.361935 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:56.361910    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c630921_60fe_4480_ab51_ca22cee19605.slice/crio-8615f6d1903af89990123c8aceaab88c038f567200fdb6fcdf000c1ffce7c44a WatchSource:0}: Error finding container 8615f6d1903af89990123c8aceaab88c038f567200fdb6fcdf000c1ffce7c44a: Status 404 returned error can't find the container with id 8615f6d1903af89990123c8aceaab88c038f567200fdb6fcdf000c1ffce7c44a
Jul 28 17:16:56.362461 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:56.362390    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444a7bef_5a16_4460_9321_8bebda825ffe.slice/crio-ed226bfabad88da0a30ebd1065d97310dbd04522cc674f09cb93d3399ccd4b4e WatchSource:0}: Error finding container ed226bfabad88da0a30ebd1065d97310dbd04522cc674f09cb93d3399ccd4b4e: Status 404 returned error can't find the container with id ed226bfabad88da0a30ebd1065d97310dbd04522cc674f09cb93d3399ccd4b4e
Jul 28 17:16:56.364157 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:16:56.363954    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6e7925a_b3c4_4064_925d_cdc5e31e48f1.slice/crio-fe544e43d56f148e9b9d82b4758e0399da0a03561c8dcf7f97a973f3b831b704 WatchSource:0}: Error finding container fe544e43d56f148e9b9d82b4758e0399da0a03561c8dcf7f97a973f3b831b704: Status 404 returned error can't find the container with id fe544e43d56f148e9b9d82b4758e0399da0a03561c8dcf7f97a973f3b831b704
Jul 28 17:16:56.743393 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:56.743187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:16:56.743393 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:56.743397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:56.743594 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:56.743340    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:16:56.743594 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:56.743465    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:16:56.743594 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:56.743477    2574 projected.go:196] Error preparing data for projected volume kube-api-access-g8btw for pod openshift-network-diagnostics/network-check-target-xrgmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:16:56.743594 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:56.743440    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:56.743594 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:56.743537    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw podName:176e178e-5fa7-4789-93af-ac877709077a nodeName:}" failed. No retries permitted until 2026-07-28 17:16:58.743521316 +0000 UTC m=+6.171300534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8btw" (UniqueName: "kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw") pod "network-check-target-xrgmh" (UID: "176e178e-5fa7-4789-93af-ac877709077a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:16:56.743594 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:56.743560    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:16:56.743817 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:56.743609    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:16:56.743817 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:56.743625    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs podName:93a8f35e-919b-4c2b-ab51-54cce84896bf nodeName:}" failed. No retries permitted until 2026-07-28 17:16:58.74360658 +0000 UTC m=+6.171385798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs") pod "network-metrics-daemon-77rmg" (UID: "93a8f35e-919b-4c2b-ab51-54cce84896bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:16:56.743817 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:56.743647    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret podName:aad70f3d-c86b-45f4-abdf-4d86bdecdf0b nodeName:}" failed. No retries permitted until 2026-07-28 17:16:58.743636158 +0000 UTC m=+6.171415381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret") pod "global-pull-secret-syncer-9l299" (UID: "aad70f3d-c86b-45f4-abdf-4d86bdecdf0b") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:16:57.064228 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.064145    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:11:55 +0000 UTC" deadline="2028-04-27 06:34:53.117408318 +0000 UTC"
Jul 28 17:16:57.064228 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.064217    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15325h17m56.053197202s"
Jul 28 17:16:57.146909 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.146877    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:57.147103 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:57.146997    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:16:57.147398 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.147378    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:16:57.147508 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:57.147487    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:16:57.174280 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.174242    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" event={"ID":"f0714666-577a-4238-828b-d307712d99a6","Type":"ContainerStarted","Data":"70f34b6058e0217260e8cf584278b118567417ea0936841a3f7f3468fd8a53c0"}
Jul 28 17:16:57.181179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.181102    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7qqxm" event={"ID":"f6e7925a-b3c4-4064-925d-cdc5e31e48f1","Type":"ContainerStarted","Data":"fe544e43d56f148e9b9d82b4758e0399da0a03561c8dcf7f97a973f3b831b704"}
Jul 28 17:16:57.190331 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.190241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7pq9" event={"ID":"444a7bef-5a16-4460-9321-8bebda825ffe","Type":"ContainerStarted","Data":"ed226bfabad88da0a30ebd1065d97310dbd04522cc674f09cb93d3399ccd4b4e"}
Jul 28 17:16:57.203028 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.202990    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4x6s" event={"ID":"fa9c7560-3e42-4d51-899a-460ddce48eda","Type":"ContainerStarted","Data":"5e8253e1d22fb051bbdd9acb12ad1b07ad3a249dcfc485d4feede56c6b416442"}
Jul 28 17:16:57.207672 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.207640    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z7pbf" event={"ID":"9001436c-49c2-49d6-967a-2debaf26b00b","Type":"ContainerStarted","Data":"5f3f519aab14607ed5aaac22ebc9184a9549c0c052c1a479abc66749e8111116"}
Jul 28 17:16:57.213679 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.213582    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b74hg" event={"ID":"aa38da5b-d785-47e5-b319-87b782aad3e4","Type":"ContainerStarted","Data":"fcd44899cfce41229e916e37893cebc1fd345bcc0650d7538b0757dccb006129"}
Jul 28 17:16:57.220989 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.220357    2574 generic.go:356] "Generic (PLEG): container finished" podID="7ffa06e1665a7778d4ccba5e41bd423d" containerID="934633aaffa3e80d9aece6842a99409a7fc75fb48da5eff605ae5b186112f14b" exitCode=0
Jul 28 17:16:57.220989 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.220516    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal" event={"ID":"7ffa06e1665a7778d4ccba5e41bd423d","Type":"ContainerDied","Data":"934633aaffa3e80d9aece6842a99409a7fc75fb48da5eff605ae5b186112f14b"}
Jul 28 17:16:57.227146 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.226694    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal" event={"ID":"2a7be853eabb2e477d6252d8cbc46b72","Type":"ContainerStarted","Data":"cdf3c6c453124e371fc1c105a61e9e14ad56a4c0d0f411da08637aa33d89abf6"}
Jul 28 17:16:57.240393 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.240359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb" event={"ID":"3c630921-60fe-4480-ab51-ca22cee19605","Type":"ContainerStarted","Data":"8615f6d1903af89990123c8aceaab88c038f567200fdb6fcdf000c1ffce7c44a"}
Jul 28 17:16:57.253624 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.253592    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lr8ct" event={"ID":"4de10f76-be20-4f9f-b9b9-e5035874d200","Type":"ContainerStarted","Data":"af6e09bc819ea8ccd11fec38416a7f8c58b488a2d7c21b5be65635b99ed0849b"}
Jul 28 17:16:57.258487 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:57.258458    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerStarted","Data":"1c93c9e23c4f8131d64fe436df0216518b6924ddbd0c044f451d59909440f3b3"}
Jul 28 17:16:58.141736 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:58.141175    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:58.141736 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:58.141358    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:16:58.275392 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:58.275298    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal" event={"ID":"7ffa06e1665a7778d4ccba5e41bd423d","Type":"ContainerStarted","Data":"7bd420eff7e5db5779ddc3923c356f637297c044795d7e0ac6a140434f38ae39"}
Jul 28 17:16:58.292040 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:58.291982    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-52.ec2.internal" podStartSLOduration=4.291961833 podStartE2EDuration="4.291961833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:16:57.256492514 +0000 UTC m=+4.684271753" watchObservedRunningTime="2026-07-28 17:16:58.291961833 +0000 UTC m=+5.719741076"
Jul 28 17:16:58.763601 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:58.763563    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:16:58.763821 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:58.763620    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:16:58.763821 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:58.763656    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:58.763821 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:58.763797    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:16:58.763992 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:58.763857    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret podName:aad70f3d-c86b-45f4-abdf-4d86bdecdf0b nodeName:}" failed. No retries permitted until 2026-07-28 17:17:02.763839965 +0000 UTC m=+10.191619201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret") pod "global-pull-secret-syncer-9l299" (UID: "aad70f3d-c86b-45f4-abdf-4d86bdecdf0b") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:16:58.764315 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:58.764292    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:16:58.764408 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:58.764320    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:16:58.764408 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:58.764333    2574 projected.go:196] Error preparing data for projected volume kube-api-access-g8btw for pod openshift-network-diagnostics/network-check-target-xrgmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:16:58.764408 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:58.764380    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw podName:176e178e-5fa7-4789-93af-ac877709077a nodeName:}" failed. No retries permitted until 2026-07-28 17:17:02.764363117 +0000 UTC m=+10.192142350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8btw" (UniqueName: "kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw") pod "network-check-target-xrgmh" (UID: "176e178e-5fa7-4789-93af-ac877709077a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:16:58.764597 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:58.764442    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:16:58.764597 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:58.764480    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs podName:93a8f35e-919b-4c2b-ab51-54cce84896bf nodeName:}" failed. No retries permitted until 2026-07-28 17:17:02.76446572 +0000 UTC m=+10.192244938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs") pod "network-metrics-daemon-77rmg" (UID: "93a8f35e-919b-4c2b-ab51-54cce84896bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:16:59.144046 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:59.143354    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:16:59.144046 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:59.143481    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:16:59.144046 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:16:59.143841    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:16:59.144046 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:16:59.143934    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:00.141043 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:00.141006    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:00.141263 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:00.141177    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:01.142690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:01.142185    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:01.142690 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:01.142313    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:01.143675 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:01.143099    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:01.143675 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:01.143207    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:02.141817 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:02.141325    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:02.141817 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:02.141488    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:02.798898 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:02.798860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:02.798918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:02.798957    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:02.799058    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:02.799110    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:02.799112    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:02.799139    2574 projected.go:196] Error preparing data for projected volume kube-api-access-g8btw for pod openshift-network-diagnostics/network-check-target-xrgmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:02.799082    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:02.799204    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw podName:176e178e-5fa7-4789-93af-ac877709077a nodeName:}" failed. No retries permitted until 2026-07-28 17:17:10.799184527 +0000 UTC m=+18.226963745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8btw" (UniqueName: "kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw") pod "network-check-target-xrgmh" (UID: "176e178e-5fa7-4789-93af-ac877709077a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:02.799232    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret podName:aad70f3d-c86b-45f4-abdf-4d86bdecdf0b nodeName:}" failed. No retries permitted until 2026-07-28 17:17:10.799213028 +0000 UTC m=+18.226992245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret") pod "global-pull-secret-syncer-9l299" (UID: "aad70f3d-c86b-45f4-abdf-4d86bdecdf0b") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:02.799410 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:02.799252    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs podName:93a8f35e-919b-4c2b-ab51-54cce84896bf nodeName:}" failed. No retries permitted until 2026-07-28 17:17:10.799242091 +0000 UTC m=+18.227021307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs") pod "network-metrics-daemon-77rmg" (UID: "93a8f35e-919b-4c2b-ab51-54cce84896bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:03.142012 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:03.141937    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:03.142166 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:03.142054    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:03.142509 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:03.142489    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:03.142656 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:03.142633    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:04.141765 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:04.141727    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:04.142261 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:04.141902    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:05.141334 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:05.141304    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:05.141521 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:05.141438    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:05.141521 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:05.141500    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:05.141641 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:05.141606    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:06.141050 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:06.141013    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:06.141506 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:06.141177    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:07.141549 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:07.141471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:07.141977 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:07.141607    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:07.141977 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:07.141618    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:07.141977 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:07.141704    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:08.140890 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:08.140854    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:08.141087 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:08.140980    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:09.140816 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:09.140777    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:09.141288 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:09.140910    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:09.141288 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:09.140965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:09.141288 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:09.141092    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:10.141145 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:10.141110    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:10.141491 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:10.141223    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:10.871449 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:10.871405    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:10.871643 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:10.871461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:10.871643 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:10.871500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:10.871643 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:10.871597    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:10.871643 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:10.871613    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:10.871643 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:10.871641    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:10.871887 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:10.871658    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:10.871887 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:10.871670    2574 projected.go:196] Error preparing data for projected volume kube-api-access-g8btw for pod openshift-network-diagnostics/network-check-target-xrgmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:10.871887 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:10.871678    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs podName:93a8f35e-919b-4c2b-ab51-54cce84896bf nodeName:}" failed. No retries permitted until 2026-07-28 17:17:26.871658793 +0000 UTC m=+34.299438024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs") pod "network-metrics-daemon-77rmg" (UID: "93a8f35e-919b-4c2b-ab51-54cce84896bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:10.871887 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:10.871699    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret podName:aad70f3d-c86b-45f4-abdf-4d86bdecdf0b nodeName:}" failed. No retries permitted until 2026-07-28 17:17:26.871689789 +0000 UTC m=+34.299469005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret") pod "global-pull-secret-syncer-9l299" (UID: "aad70f3d-c86b-45f4-abdf-4d86bdecdf0b") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:10.871887 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:10.871714    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw podName:176e178e-5fa7-4789-93af-ac877709077a nodeName:}" failed. No retries permitted until 2026-07-28 17:17:26.871705955 +0000 UTC m=+34.299485175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8btw" (UniqueName: "kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw") pod "network-check-target-xrgmh" (UID: "176e178e-5fa7-4789-93af-ac877709077a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:11.141442 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:11.141359    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:11.141442 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:11.141380    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:11.141934 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:11.141519    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:11.141934 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:11.141598    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:12.141024 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:12.140982    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:12.141219 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:12.141137    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:13.141743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:13.141708    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:13.142253 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:13.141794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:13.142253 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:13.141828    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:13.142253 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:13.141903    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:14.140877 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:14.140839    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:14.141045 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:14.140959    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:15.141940 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.141652    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:15.142581 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.141719    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:15.142581 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:15.142019    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:15.142581 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:15.142139    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:15.325744 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.325703    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb" event={"ID":"3c630921-60fe-4480-ab51-ca22cee19605","Type":"ContainerStarted","Data":"a13a503887267eb3d7469243346e3568ad7e8a66ee99a6c64885cb64fc3c1b86"}
Jul 28 17:17:15.327478 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.327430    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lr8ct" event={"ID":"4de10f76-be20-4f9f-b9b9-e5035874d200","Type":"ContainerStarted","Data":"482828f0a387ce746acf233bec713917e7b7ec31ee3ea37fbde1df3064a86165"}
Jul 28 17:17:15.330465 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.330435    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:17:15.330835 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.330807    2574 generic.go:356] "Generic (PLEG): container finished" podID="307dbf09-689f-436e-9019-bfa20d6944c3" containerID="146f69782300523ac9da7e38592332b277c18dbd9c05a63092fb9d6f16b330ba" exitCode=1
Jul 28 17:17:15.330951 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.330880    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerStarted","Data":"9d45631df7e34b347dd0546b2df6bd3ab0f5551f41103ab01a3a8b401ea082c6"}
Jul 28 17:17:15.331008 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.330957    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerStarted","Data":"86393664675b49b472cbf61cf9b015eb4869f2e2ee5e1af0c2fa00b023b3c3c5"}
Jul 28 17:17:15.331081 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.331011    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerStarted","Data":"ecacacc778a7a401fd2272374edc9622874201ba597ac88fbacf16f0930d8ca8"}
Jul 28 17:17:15.331081 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.331061    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerStarted","Data":"699284d52d14d4211510048dca3f0b3a8cf4ba103ef0c5547ea6b1e68928adb4"}
Jul 28 17:17:15.331189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.331126    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerDied","Data":"146f69782300523ac9da7e38592332b277c18dbd9c05a63092fb9d6f16b330ba"}
Jul 28 17:17:15.331189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.331176    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerStarted","Data":"fc482abcf63a82f2d82a39193dbafa592421f599f1bb01aa2a0e658f49979a4a"}
Jul 28 17:17:15.332755 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.332735    2574 generic.go:356] "Generic (PLEG): container finished" podID="f0714666-577a-4238-828b-d307712d99a6" containerID="61b1e735800d2b0eed4f51d4d8e9744afb3585c4481c51847360f4952356d0cf" exitCode=0
Jul 28 17:17:15.332881 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.332787    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" event={"ID":"f0714666-577a-4238-828b-d307712d99a6","Type":"ContainerDied","Data":"61b1e735800d2b0eed4f51d4d8e9744afb3585c4481c51847360f4952356d0cf"}
Jul 28 17:17:15.334497 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.334475    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7qqxm" event={"ID":"f6e7925a-b3c4-4064-925d-cdc5e31e48f1","Type":"ContainerStarted","Data":"e1a41c1c0324b43a7d76bf225644e3868205956a384c52c435eb6cfba06a8c30"}
Jul 28 17:17:15.336173 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.336151    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7pq9" event={"ID":"444a7bef-5a16-4460-9321-8bebda825ffe","Type":"ContainerStarted","Data":"32bb754325f6646b3440b237711c97f016c8eedad095d50bd586a07692fea767"}
Jul 28 17:17:15.337771 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.337748    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z7pbf" event={"ID":"9001436c-49c2-49d6-967a-2debaf26b00b","Type":"ContainerStarted","Data":"8e617cd9d5938d31ebd82f78e310fbf259cbeac797008c7500e26bc5d7f52c4d"}
Jul 28 17:17:15.339316 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.339292    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b74hg" event={"ID":"aa38da5b-d785-47e5-b319-87b782aad3e4","Type":"ContainerStarted","Data":"4b08d829944fbac95a271cd46e5b0fb786f1e33e9ddb49ad6bfb01937b3338ba"}
Jul 28 17:17:15.347935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.347889    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-52.ec2.internal" podStartSLOduration=21.347877763 podStartE2EDuration="21.347877763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:16:58.292361077 +0000 UTC m=+5.720140317" watchObservedRunningTime="2026-07-28 17:17:15.347877763 +0000 UTC m=+22.775657000"
Jul 28 17:17:15.368406 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.368359    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7qqxm" podStartSLOduration=4.307476082 podStartE2EDuration="22.368343901s" totalImagesPullingTime="18.060867819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:15.367938472 +0000 UTC m=+22.795717711" watchObservedRunningTime="2026-07-28 17:17:15.368343901 +0000 UTC m=+22.796123138"
Jul 28 17:17:15.368552 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.368527    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lr8ct" podStartSLOduration=4.295369887 podStartE2EDuration="22.36852078s" totalImagesPullingTime="18.073150893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:15.350716735 +0000 UTC m=+22.778495979" watchObservedRunningTime="2026-07-28 17:17:15.36852078 +0000 UTC m=+22.796299997"
Jul 28 17:17:15.411150 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.411046    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z7pbf" podStartSLOduration=4.345216873 podStartE2EDuration="22.411031971s" totalImagesPullingTime="18.065815098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:15.411013751 +0000 UTC m=+22.838792986" watchObservedRunningTime="2026-07-28 17:17:15.411031971 +0000 UTC m=+22.838811200"
Jul 28 17:17:15.434505 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.434298    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x7pq9" podStartSLOduration=4.372043445 podStartE2EDuration="22.434277101s" totalImagesPullingTime="18.062233656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:15.433759103 +0000 UTC m=+22.861538341" watchObservedRunningTime="2026-07-28 17:17:15.434277101 +0000 UTC m=+22.862056335"
Jul 28 17:17:15.450182 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:15.450121    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b74hg" podStartSLOduration=12.301061389000001 podStartE2EDuration="22.450101855s" totalImagesPullingTime="10.149040466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:15.450090207 +0000 UTC m=+22.877869447" watchObservedRunningTime="2026-07-28 17:17:15.450101855 +0000 UTC m=+22.877881095"
Jul 28 17:17:16.119027 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:16.118962    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 17:17:16.141059 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:16.141029    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:16.141233 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:16.141187    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:16.343651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:16.343614    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m4x6s" event={"ID":"fa9c7560-3e42-4d51-899a-460ddce48eda","Type":"ContainerStarted","Data":"824e448f44de11158035190e6cd8f67b80ca843fcbbf923c196ce428167769fe"}
Jul 28 17:17:16.345548 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:16.345513    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb" event={"ID":"3c630921-60fe-4480-ab51-ca22cee19605","Type":"ContainerStarted","Data":"0547fb51f7d30e775d121b7ce2914bdacb6c2b1867ebb7774f76f806e68a8996"}
Jul 28 17:17:16.361401 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:16.361349    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m4x6s" podStartSLOduration=5.295882344 podStartE2EDuration="23.361333574s" totalImagesPullingTime="18.06545123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:16.360911977 +0000 UTC m=+23.788691216" watchObservedRunningTime="2026-07-28 17:17:16.361333574 +0000 UTC m=+23.789112816"
Jul 28 17:17:17.082211 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:17.082040    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:17:16.11898354Z","UUID":"df748a90-9962-41c4-9f0c-e9358c1c674b","Handler":null,"Name":"","Endpoint":""}
Jul 28 17:17:17.083871 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:17.083848    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 17:17:17.083995 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:17.083892    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 17:17:17.141330 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:17.141299    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:17.141507 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:17.141430    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:17.141507 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:17.141468    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:17.141622 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:17.141582    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:17.354953 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:17.354866    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb" event={"ID":"3c630921-60fe-4480-ab51-ca22cee19605","Type":"ContainerStarted","Data":"96dd7cdc5f5b8babaeda1c48d243c986d0109596c544d8fce74b539b5ca21c7f"}
Jul 28 17:17:17.359625 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:17.359559    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:17:17.360110 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:17.360012    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerStarted","Data":"2c275cb3378f696e18fe7d421ac2f90b7e545b9b206e449e02492ba12aa9b4e4"}
Jul 28 17:17:17.378964 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:17.378918    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wd5zb" podStartSLOduration=3.967857861 podStartE2EDuration="24.378902092s" totalImagesPullingTime="20.411044231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:17.378751108 +0000 UTC m=+24.806530347" watchObservedRunningTime="2026-07-28 17:17:17.378902092 +0000 UTC m=+24.806681331"
Jul 28 17:17:18.141191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:18.141155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:18.141386 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:18.141314    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:19.141775 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:19.141598    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:19.142253 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:19.141599    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:19.142253 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:19.141875    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:19.142253 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:19.141973    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:19.750300 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:19.750215    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:17:19.750767 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:19.750745    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:17:20.141567 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:20.141532    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:20.141738 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:20.141667    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:20.370061 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:20.370031    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:17:20.370832 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:20.370381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerStarted","Data":"a0c437018178562b50cfbef7fe6a048275d80a1b83f0a7e723d0a55232014925"}
Jul 28 17:17:20.370832 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:20.370659    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:17:20.370832 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:20.370709    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:17:20.370974 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:20.370875    2574 scope.go:117] "RemoveContainer" containerID="146f69782300523ac9da7e38592332b277c18dbd9c05a63092fb9d6f16b330ba"
Jul 28 17:17:20.372301 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:20.372277    2574 generic.go:356] "Generic (PLEG): container finished" podID="f0714666-577a-4238-828b-d307712d99a6" containerID="329e12ca95bc4be5c68ff66619af181c618f0d93018b3b8fbeb6fe037dc04e7d" exitCode=0
Jul 28 17:17:20.372412 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:20.372364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" event={"ID":"f0714666-577a-4238-828b-d307712d99a6","Type":"ContainerDied","Data":"329e12ca95bc4be5c68ff66619af181c618f0d93018b3b8fbeb6fe037dc04e7d"}
Jul 28 17:17:20.391872 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:20.391799    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:17:21.141977 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.141748    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:21.142196 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.141814    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:21.142196 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:21.142109    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:21.142301 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:21.142235    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:21.348999 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.348952    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:21.378347 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.378272    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:17:21.378775 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.378649    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" event={"ID":"307dbf09-689f-436e-9019-bfa20d6944c3","Type":"ContainerStarted","Data":"f2558e0a780b9751c5e89040cdbe8ed039d325ce857eba94eed49901fb755be5"}
Jul 28 17:17:21.379025 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.379003    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:17:21.380881 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.380851    2574 generic.go:356] "Generic (PLEG): container finished" podID="f0714666-577a-4238-828b-d307712d99a6" containerID="7d606cbebcecb4561d88067e844f8c5c087bcce3cc1c80ff469766a695ee2030" exitCode=0
Jul 28 17:17:21.380978 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.380914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" event={"ID":"f0714666-577a-4238-828b-d307712d99a6","Type":"ContainerDied","Data":"7d606cbebcecb4561d88067e844f8c5c087bcce3cc1c80ff469766a695ee2030"}
Jul 28 17:17:21.395209 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.395185    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:17:21.411634 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.411587    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q" podStartSLOduration=10.294045645 podStartE2EDuration="28.411569525s" totalImagesPullingTime="18.11752388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:21.410763444 +0000 UTC m=+28.838542682" watchObservedRunningTime="2026-07-28 17:17:21.411569525 +0000 UTC m=+28.839348756"
Jul 28 17:17:21.467588 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.467543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:21.522024 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.521982    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9l299"]
Jul 28 17:17:21.522237 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.522220    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:21.522411 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:21.522382    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:21.523194 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.523165    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77rmg"]
Jul 28 17:17:21.523302 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.523287    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:21.523441 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:21.523418    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:21.523810 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.523792    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xrgmh"]
Jul 28 17:17:21.523890 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.523877    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:21.523984 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:21.523963    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:21.592297 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:21.592267    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:22.385609 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:22.385571    2574 generic.go:356] "Generic (PLEG): container finished" podID="f0714666-577a-4238-828b-d307712d99a6" containerID="e143ce96e0073f72261ff74819bf230d28b22ac4d6f6276609ac61892820e093" exitCode=0
Jul 28 17:17:22.386051 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:22.385652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" event={"ID":"f0714666-577a-4238-828b-d307712d99a6","Type":"ContainerDied","Data":"e143ce96e0073f72261ff74819bf230d28b22ac4d6f6276609ac61892820e093"}
Jul 28 17:17:22.577233 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:22.577189    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:17:22.577436 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:22.577316    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 17:17:22.577950 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:22.577929    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b74hg"
Jul 28 17:17:22.728306 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:22.728273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:22.831675 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:22.831600    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:23.001802 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:23.001772    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:23.105369 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:23.105289    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:23.144552 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:23.144518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:23.144691 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:23.144606    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:23.144691 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:23.144614    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:23.144691 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:23.144633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:23.144815 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:23.144693    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:23.144815 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:23.144757    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:25.145582 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:25.145393    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:25.146046 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:25.145440    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:25.146046 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:25.145683    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:25.146046 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:25.145441    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:25.146046 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:25.145809    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:25.146046 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:25.145895    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:26.890664 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:26.890626    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:26.890664 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:26.890672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:26.891234 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:26.890696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:26.891234 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:26.890791    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:26.891234 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:26.890800    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:17:26.891234 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:26.890826    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:17:26.891234 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:26.890837    2574 projected.go:196] Error preparing data for projected volume kube-api-access-g8btw for pod openshift-network-diagnostics/network-check-target-xrgmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:26.891234 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:26.890844    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret podName:aad70f3d-c86b-45f4-abdf-4d86bdecdf0b nodeName:}" failed. No retries permitted until 2026-07-28 17:17:58.890830848 +0000 UTC m=+66.318610063 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret") pod "global-pull-secret-syncer-9l299" (UID: "aad70f3d-c86b-45f4-abdf-4d86bdecdf0b") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:17:26.891234 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:26.890879    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw podName:176e178e-5fa7-4789-93af-ac877709077a nodeName:}" failed. No retries permitted until 2026-07-28 17:17:58.890867378 +0000 UTC m=+66.318646594 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g8btw" (UniqueName: "kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw") pod "network-check-target-xrgmh" (UID: "176e178e-5fa7-4789-93af-ac877709077a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:17:26.891234 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:26.890800    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:26.891234 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:26.890907    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs podName:93a8f35e-919b-4c2b-ab51-54cce84896bf nodeName:}" failed. No retries permitted until 2026-07-28 17:17:58.890900941 +0000 UTC m=+66.318680157 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs") pod "network-metrics-daemon-77rmg" (UID: "93a8f35e-919b-4c2b-ab51-54cce84896bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:17:27.140890 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:27.140812    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:27.140890 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:27.140851    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:27.141155 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:27.140919    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xrgmh" podUID="176e178e-5fa7-4789-93af-ac877709077a"
Jul 28 17:17:27.141155 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:27.140823    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:27.141155 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:27.141089    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-77rmg" podUID="93a8f35e-919b-4c2b-ab51-54cce84896bf"
Jul 28 17:17:27.141266 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:27.141160    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9l299" podUID="aad70f3d-c86b-45f4-abdf-4d86bdecdf0b"
Jul 28 17:17:27.401218 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:27.401189    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" event={"ID":"f0714666-577a-4238-828b-d307712d99a6","Type":"ContainerStarted","Data":"71d47efeb9fa3ad550003c2554a64881be70e2ae454116891fb43e08356dda83"}
Jul 28 17:17:28.406554 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.406520    2574 generic.go:356] "Generic (PLEG): container finished" podID="f0714666-577a-4238-828b-d307712d99a6" containerID="71d47efeb9fa3ad550003c2554a64881be70e2ae454116891fb43e08356dda83" exitCode=0
Jul 28 17:17:28.407158 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.406575    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" event={"ID":"f0714666-577a-4238-828b-d307712d99a6","Type":"ContainerDied","Data":"71d47efeb9fa3ad550003c2554a64881be70e2ae454116891fb43e08356dda83"}
Jul 28 17:17:28.419762 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.419736    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-52.ec2.internal" event="NodeReady"
Jul 28 17:17:28.419895 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.419883    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 17:17:28.468563 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.468537    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f96fd"]
Jul 28 17:17:28.507247 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.507225    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bbsrj"]
Jul 28 17:17:28.508260 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.507365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.511627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.510392    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 17:17:28.511627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.510703    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c9wr5\""
Jul 28 17:17:28.511627 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.510965    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 17:17:28.529542 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.529490    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f96fd"]
Jul 28 17:17:28.529542 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.529543    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbsrj"]
Jul 28 17:17:28.529750 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.529623    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbsrj"
Jul 28 17:17:28.532308 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.532289    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dzv2b\""
Jul 28 17:17:28.532436 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.532312    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 17:17:28.532436 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.532329    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 17:17:28.532436 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.532337    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 17:17:28.603624 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.603597    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53122cc2-26c7-43aa-b161-fccf61696643-config-volume\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.603727 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.603635    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q4n5\" (UniqueName: \"kubernetes.io/projected/e0d6b4e4-3979-47bd-8780-27bfd715d592-kube-api-access-4q4n5\") pod \"ingress-canary-bbsrj\" (UID: \"e0d6b4e4-3979-47bd-8780-27bfd715d592\") " pod="openshift-ingress-canary/ingress-canary-bbsrj"
Jul 28 17:17:28.603727 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.603655    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53122cc2-26c7-43aa-b161-fccf61696643-tmp-dir\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.603727 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.603674    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0d6b4e4-3979-47bd-8780-27bfd715d592-cert\") pod \"ingress-canary-bbsrj\" (UID: \"e0d6b4e4-3979-47bd-8780-27bfd715d592\") " pod="openshift-ingress-canary/ingress-canary-bbsrj"
Jul 28 17:17:28.603727 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.603691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcp6x\" (UniqueName: \"kubernetes.io/projected/53122cc2-26c7-43aa-b161-fccf61696643-kube-api-access-qcp6x\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.603873 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.603735    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.704740 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.704646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q4n5\" (UniqueName: \"kubernetes.io/projected/e0d6b4e4-3979-47bd-8780-27bfd715d592-kube-api-access-4q4n5\") pod \"ingress-canary-bbsrj\" (UID: \"e0d6b4e4-3979-47bd-8780-27bfd715d592\") " pod="openshift-ingress-canary/ingress-canary-bbsrj"
Jul 28 17:17:28.704740 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.704687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53122cc2-26c7-43aa-b161-fccf61696643-tmp-dir\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.704740 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.704712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0d6b4e4-3979-47bd-8780-27bfd715d592-cert\") pod \"ingress-canary-bbsrj\" (UID: \"e0d6b4e4-3979-47bd-8780-27bfd715d592\") " pod="openshift-ingress-canary/ingress-canary-bbsrj"
Jul 28 17:17:28.704740 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.704729    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcp6x\" (UniqueName: \"kubernetes.io/projected/53122cc2-26c7-43aa-b161-fccf61696643-kube-api-access-qcp6x\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.704740 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.704744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.705166 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:28.704819    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:28.705166 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:28.704866    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls podName:53122cc2-26c7-43aa-b161-fccf61696643 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:29.204853725 +0000 UTC m=+36.632632941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls") pod "dns-default-f96fd" (UID: "53122cc2-26c7-43aa-b161-fccf61696643") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:28.705166 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.704949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53122cc2-26c7-43aa-b161-fccf61696643-config-volume\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.705166 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.705122    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53122cc2-26c7-43aa-b161-fccf61696643-tmp-dir\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.705442 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.705424    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53122cc2-26c7-43aa-b161-fccf61696643-config-volume\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.708949 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.708923    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0d6b4e4-3979-47bd-8780-27bfd715d592-cert\") pod \"ingress-canary-bbsrj\" (UID: \"e0d6b4e4-3979-47bd-8780-27bfd715d592\") " pod="openshift-ingress-canary/ingress-canary-bbsrj"
Jul 28 17:17:28.713688 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.713669    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcp6x\" (UniqueName: \"kubernetes.io/projected/53122cc2-26c7-43aa-b161-fccf61696643-kube-api-access-qcp6x\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:28.714663 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.714647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q4n5\" (UniqueName: \"kubernetes.io/projected/e0d6b4e4-3979-47bd-8780-27bfd715d592-kube-api-access-4q4n5\") pod \"ingress-canary-bbsrj\" (UID: \"e0d6b4e4-3979-47bd-8780-27bfd715d592\") " pod="openshift-ingress-canary/ingress-canary-bbsrj"
Jul 28 17:17:28.837409 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:28.837371    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbsrj"
Jul 28 17:17:29.026521 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.026342    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbsrj"]
Jul 28 17:17:29.030041 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:17:29.030017    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d6b4e4_3979_47bd_8780_27bfd715d592.slice/crio-466baf392f4b05c1af678894d331a3b5d5ae9023a0b327aa90a1675758c5735b WatchSource:0}: Error finding container 466baf392f4b05c1af678894d331a3b5d5ae9023a0b327aa90a1675758c5735b: Status 404 returned error can't find the container with id 466baf392f4b05c1af678894d331a3b5d5ae9023a0b327aa90a1675758c5735b
Jul 28 17:17:29.141499 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.141471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:29.141499 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.141489    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:29.141699 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.141473    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:29.144328 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.144289    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 17:17:29.144466 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.144448    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wqrl8\""
Jul 28 17:17:29.145561 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.145543    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2k2q\""
Jul 28 17:17:29.145653 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.145616    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:17:29.145653 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.145624    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 17:17:29.145772 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.145729    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:17:29.207859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.207821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:29.208024 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:29.207957    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:29.208024 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:29.208015    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls podName:53122cc2-26c7-43aa-b161-fccf61696643 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:30.207996804 +0000 UTC m=+37.635776022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls") pod "dns-default-f96fd" (UID: "53122cc2-26c7-43aa-b161-fccf61696643") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:29.410476 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.410442    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbsrj" event={"ID":"e0d6b4e4-3979-47bd-8780-27bfd715d592","Type":"ContainerStarted","Data":"466baf392f4b05c1af678894d331a3b5d5ae9023a0b327aa90a1675758c5735b"}
Jul 28 17:17:29.413430 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.413405    2574 generic.go:356] "Generic (PLEG): container finished" podID="f0714666-577a-4238-828b-d307712d99a6" containerID="a9ca7780d28a1b942fedda06c4d9d568521dcd5300577255aafb200c43108177" exitCode=0
Jul 28 17:17:29.413566 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:29.413440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" event={"ID":"f0714666-577a-4238-828b-d307712d99a6","Type":"ContainerDied","Data":"a9ca7780d28a1b942fedda06c4d9d568521dcd5300577255aafb200c43108177"}
Jul 28 17:17:30.214648 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:30.214611    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:30.214815 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:30.214776    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:30.214866 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:30.214850    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls podName:53122cc2-26c7-43aa-b161-fccf61696643 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:32.214831095 +0000 UTC m=+39.642610314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls") pod "dns-default-f96fd" (UID: "53122cc2-26c7-43aa-b161-fccf61696643") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:30.418887 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:30.418849    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" event={"ID":"f0714666-577a-4238-828b-d307712d99a6","Type":"ContainerStarted","Data":"c49de6edb01ea5ca0384cf5be73965977c483dee4da44c16e2ac2ad2e2b12248"}
Jul 28 17:17:30.450087 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:30.450013    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lpb4n" podStartSLOduration=8.955009094 podStartE2EDuration="37.44997251s" totalImagesPullingTime="28.494963416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:30.447920593 +0000 UTC m=+37.875699831" watchObservedRunningTime="2026-07-28 17:17:30.44997251 +0000 UTC m=+37.877751752"
Jul 28 17:17:30.863414 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:30.863380    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:30.939221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:30.939188    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:32.229975 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:32.229932    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:32.230351 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:32.230121    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:32.230351 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:32.230187    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls podName:53122cc2-26c7-43aa-b161-fccf61696643 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:36.230171424 +0000 UTC m=+43.657950643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls") pod "dns-default-f96fd" (UID: "53122cc2-26c7-43aa-b161-fccf61696643") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:32.694620 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:32.694434    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:32.792210 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:32.792115    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:33.238140 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:33.238049    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:33.331471 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:33.331413    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:33.427179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:33.427144    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbsrj" event={"ID":"e0d6b4e4-3979-47bd-8780-27bfd715d592","Type":"ContainerStarted","Data":"a2b7a15666887ea94ccf50d5b73df7f126821cde271b82284396f085764cf956"}
Jul 28 17:17:33.443703 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:33.443656    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bbsrj" podStartSLOduration=1.950587493 podStartE2EDuration="5.443642032s" totalImagesPullingTime="3.493054539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:33.443426188 +0000 UTC m=+40.871205426" watchObservedRunningTime="2026-07-28 17:17:33.443642032 +0000 UTC m=+40.871421323"
Jul 28 17:17:36.259814 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:36.259774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:36.260221 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:36.259934    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:36.260221 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:36.260000    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls podName:53122cc2-26c7-43aa-b161-fccf61696643 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:44.259984168 +0000 UTC m=+51.687763385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls") pod "dns-default-f96fd" (UID: "53122cc2-26c7-43aa-b161-fccf61696643") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:43.731029 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.730993    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-795tw"]
Jul 28 17:17:43.740944 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.740917    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-559f9bb59c-8bm4b"]
Jul 28 17:17:43.741060 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.741034    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:43.744052 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.744031    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m9txv\""
Jul 28 17:17:43.744269 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.744256    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 17:17:43.744496 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.744482    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 17:17:43.753017 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.753000    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-795tw"]
Jul 28 17:17:43.753129 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.753107    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.756765 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.756747    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 17:17:43.757278 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.757261    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 17:17:43.757278 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.757270    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 17:17:43.757479 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.757464    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gt8nm\""
Jul 28 17:17:43.762740 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.762721    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-559f9bb59c-8bm4b"]
Jul 28 17:17:43.765496 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.765479    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 17:17:43.809983 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.809951    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-image-registry-private-configuration\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.809983 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.809986    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-bound-sa-token\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.810215 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.810007    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-installation-pull-secrets\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.810215 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.810028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.810215 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.810160    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a3edc0a-9137-48df-b36b-16cb0b75f28b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:43.810215 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.810203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-certificates\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.810351 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.810235    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:43.810351 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.810251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-trusted-ca\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.810351 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.810277    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/323a94b8-1721-49a3-b79c-a1ab62ceae0e-ca-trust-extracted\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.810351 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.810290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jdzm\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-kube-api-access-9jdzm\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.910874 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.910843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:43.911105 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.910881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-trusted-ca\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.911105 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.910914    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/323a94b8-1721-49a3-b79c-a1ab62ceae0e-ca-trust-extracted\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.911105 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.910933    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jdzm\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-kube-api-access-9jdzm\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.911105 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.910960    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-image-registry-private-configuration\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.911105 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.910983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-bound-sa-token\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.911105 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.911009    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-installation-pull-secrets\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.911105 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.911042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.911105 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:43.911011    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 17:17:43.911517 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:43.911176    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert podName:8a3edc0a-9137-48df-b36b-16cb0b75f28b nodeName:}" failed. No retries permitted until 2026-07-28 17:17:44.411149555 +0000 UTC m=+51.838928791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-795tw" (UID: "8a3edc0a-9137-48df-b36b-16cb0b75f28b") : secret "networking-console-plugin-cert" not found
Jul 28 17:17:43.911517 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:43.911192    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:17:43.911517 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:43.911207    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f9bb59c-8bm4b: secret "image-registry-tls" not found
Jul 28 17:17:43.911517 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.911216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a3edc0a-9137-48df-b36b-16cb0b75f28b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:43.911517 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:43.911262    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls podName:323a94b8-1721-49a3-b79c-a1ab62ceae0e nodeName:}" failed. No retries permitted until 2026-07-28 17:17:44.411245026 +0000 UTC m=+51.839024244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls") pod "image-registry-559f9bb59c-8bm4b" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e") : secret "image-registry-tls" not found
Jul 28 17:17:43.911517 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.911304    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-certificates\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.911828 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.911741    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/323a94b8-1721-49a3-b79c-a1ab62ceae0e-ca-trust-extracted\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.911828 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.911820    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a3edc0a-9137-48df-b36b-16cb0b75f28b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:43.911915 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.911838    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-certificates\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.915931 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.915908    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-installation-pull-secrets\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.916019 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.915973    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-image-registry-private-configuration\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.917792 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.917772    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-trusted-ca\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.919723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.919704    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jdzm\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-kube-api-access-9jdzm\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.920483 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.920455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-bound-sa-token\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:43.957907 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.957876    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"]
Jul 28 17:17:43.982088 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.982003    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"]
Jul 28 17:17:43.982239 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.982133    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:43.985267 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.985241    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 17:17:43.985481 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.985466    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 17:17:43.985539 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.985476    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:17:43.985539 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:43.985509    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hjr9g\""
Jul 28 17:17:44.012449 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.012424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqfdz\" (UniqueName: \"kubernetes.io/projected/a565b207-ff1b-4236-aa4f-fc784f3b945f-kube-api-access-bqfdz\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:44.012608 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.012457    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:44.066466 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.066433    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:44.113373 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.113333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqfdz\" (UniqueName: \"kubernetes.io/projected/a565b207-ff1b-4236-aa4f-fc784f3b945f-kube-api-access-bqfdz\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:44.113550 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.113380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:44.113550 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.113499    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:17:44.113664 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.113568    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls podName:a565b207-ff1b-4236-aa4f-fc784f3b945f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:44.613545242 +0000 UTC m=+52.041324459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls") pod "cluster-samples-operator-6748489656-rp5rp" (UID: "a565b207-ff1b-4236-aa4f-fc784f3b945f") : secret "samples-operator-tls" not found
Jul 28 17:17:44.134651 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.134622    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqfdz\" (UniqueName: \"kubernetes.io/projected/a565b207-ff1b-4236-aa4f-fc784f3b945f-kube-api-access-bqfdz\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:44.185494 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.185462    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:44.315118 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.315083    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:17:44.315281 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.315217    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:17:44.315325 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.315284    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls podName:53122cc2-26c7-43aa-b161-fccf61696643 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:00.315266833 +0000 UTC m=+67.743046049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls") pod "dns-default-f96fd" (UID: "53122cc2-26c7-43aa-b161-fccf61696643") : secret "dns-default-metrics-tls" not found
Jul 28 17:17:44.416464 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.416426    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:44.416680 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.416492    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:44.416680 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.416580    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:17:44.416680 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.416590    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f9bb59c-8bm4b: secret "image-registry-tls" not found
Jul 28 17:17:44.416680 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.416587    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 17:17:44.416680 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.416636    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls podName:323a94b8-1721-49a3-b79c-a1ab62ceae0e nodeName:}" failed. No retries permitted until 2026-07-28 17:17:45.416623062 +0000 UTC m=+52.844402279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls") pod "image-registry-559f9bb59c-8bm4b" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e") : secret "image-registry-tls" not found
Jul 28 17:17:44.416680 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.416679    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert podName:8a3edc0a-9137-48df-b36b-16cb0b75f28b nodeName:}" failed. No retries permitted until 2026-07-28 17:17:45.416666811 +0000 UTC m=+52.844446029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-795tw" (UID: "8a3edc0a-9137-48df-b36b-16cb0b75f28b") : secret "networking-console-plugin-cert" not found
Jul 28 17:17:44.618033 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.617942    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:44.618198 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.618053    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:17:44.618198 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:44.618124    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls podName:a565b207-ff1b-4236-aa4f-fc784f3b945f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:45.618111128 +0000 UTC m=+53.045890343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls") pod "cluster-samples-operator-6748489656-rp5rp" (UID: "a565b207-ff1b-4236-aa4f-fc784f3b945f") : secret "samples-operator-tls" not found
Jul 28 17:17:44.715179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.715138    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:44.814533 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.814499    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:44.895271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:44.895189    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:45.424960 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:45.424923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:45.425214 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:45.425003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:45.425214 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:45.425089    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:17:45.425214 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:45.425101    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 17:17:45.425214 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:45.425107    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f9bb59c-8bm4b: secret "image-registry-tls" not found
Jul 28 17:17:45.425214 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:45.425153    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert podName:8a3edc0a-9137-48df-b36b-16cb0b75f28b nodeName:}" failed. No retries permitted until 2026-07-28 17:17:47.425139152 +0000 UTC m=+54.852918369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-795tw" (UID: "8a3edc0a-9137-48df-b36b-16cb0b75f28b") : secret "networking-console-plugin-cert" not found
Jul 28 17:17:45.425214 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:45.425167    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls podName:323a94b8-1721-49a3-b79c-a1ab62ceae0e nodeName:}" failed. No retries permitted until 2026-07-28 17:17:47.425159844 +0000 UTC m=+54.852939060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls") pod "image-registry-559f9bb59c-8bm4b" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e") : secret "image-registry-tls" not found
Jul 28 17:17:45.626561 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:45.626523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:45.626733 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:45.626672    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:17:45.626773 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:45.626735    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls podName:a565b207-ff1b-4236-aa4f-fc784f3b945f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:47.626720531 +0000 UTC m=+55.054499750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls") pod "cluster-samples-operator-6748489656-rp5rp" (UID: "a565b207-ff1b-4236-aa4f-fc784f3b945f") : secret "samples-operator-tls" not found
Jul 28 17:17:47.441514 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:47.441460    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:47.441917 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:47.441586    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:47.441917 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:47.441624    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:17:47.441917 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:47.441641    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f9bb59c-8bm4b: secret "image-registry-tls" not found
Jul 28 17:17:47.441917 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:47.441697    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls podName:323a94b8-1721-49a3-b79c-a1ab62ceae0e nodeName:}" failed. No retries permitted until 2026-07-28 17:17:51.441683215 +0000 UTC m=+58.869462435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls") pod "image-registry-559f9bb59c-8bm4b" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e") : secret "image-registry-tls" not found
Jul 28 17:17:47.441917 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:47.441725    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 17:17:47.441917 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:47.441784    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert podName:8a3edc0a-9137-48df-b36b-16cb0b75f28b nodeName:}" failed. No retries permitted until 2026-07-28 17:17:51.441771359 +0000 UTC m=+58.869550576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-795tw" (UID: "8a3edc0a-9137-48df-b36b-16cb0b75f28b") : secret "networking-console-plugin-cert" not found
Jul 28 17:17:47.642815 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:47.642781    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:47.642968 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:47.642937    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:17:47.643009 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:47.642999    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls podName:a565b207-ff1b-4236-aa4f-fc784f3b945f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:51.642984145 +0000 UTC m=+59.070763361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls") pod "cluster-samples-operator-6748489656-rp5rp" (UID: "a565b207-ff1b-4236-aa4f-fc784f3b945f") : secret "samples-operator-tls" not found
Jul 28 17:17:48.741014 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:48.740974    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:48.840486 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:48.840422    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:48.921736 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:48.921708    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:49.025114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.025058    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:49.317837 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.317760    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gct9w"]
Jul 28 17:17:49.319969 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.319953    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.322743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.322721    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 17:17:49.322743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.322729    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 17:17:49.322998 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.322981    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hbmbv\""
Jul 28 17:17:49.323104 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.323010    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 17:17:49.324301 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.324281    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 17:17:49.330532 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.330512    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gct9w"]
Jul 28 17:17:49.356640 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.356613    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtzxf\" (UniqueName: \"kubernetes.io/projected/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-api-access-jtzxf\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.356801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.356726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.356801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.356764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-crio-socket\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.356801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.356788    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-data-volume\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.356904 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.356856    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.385462 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.385425    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:49.457969 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.457937    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.458134 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.457978    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-crio-socket\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.458134 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.457996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-data-volume\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.458134 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.458028    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.458134 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:49.458060    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:49.458134 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.458099    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-crio-socket\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.458381 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.458144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtzxf\" (UniqueName: \"kubernetes.io/projected/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-api-access-jtzxf\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.458381 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:49.458153    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:49.458381 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:49.458165    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:49.958145294 +0000 UTC m=+57.385924541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:49.458381 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:49.458194    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:49.958183937 +0000 UTC m=+57.385963159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:49.458537 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.458397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-data-volume\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.470573 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.470530    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtzxf\" (UniqueName: \"kubernetes.io/projected/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-api-access-jtzxf\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.596862 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.596776    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:49.797526 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.797488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:49.887385 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.887300    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:49.963336 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.963299    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.963504 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:49.963355    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:49.963504 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:49.963388    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:49.963504 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:49.963484    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:50.963465831 +0000 UTC m=+58.391245050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:49.963504 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:49.963488    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:49.963633 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:49.963538    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:50.963526398 +0000 UTC m=+58.391305615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:50.971514 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:50.971473    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:50.972010 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:50.971527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:50.972010 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:50.971599    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:50.972010 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:50.971673    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:52.97165478 +0000 UTC m=+60.399434008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:50.972010 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:50.971726    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:50.972010 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:50.971798    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:52.971780112 +0000 UTC m=+60.399559329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:50.993052 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:50.993022    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-fff8d"]
Jul 28 17:17:50.995336 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:50.995321    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:50.998147 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:50.998116    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 17:17:50.998252 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:50.998131    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jjzd7\""
Jul 28 17:17:50.999491 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:50.999473    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 17:17:50.999646 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:50.999554    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 17:17:50.999646 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:50.999554    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 17:17:51.005156 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.005133    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-fff8d"]
Jul 28 17:17:51.072575 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.072536    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cf9546f8-7345-411f-bb78-6df1988115ff-signing-cabundle\") pod \"service-ca-658d7b7c78-fff8d\" (UID: \"cf9546f8-7345-411f-bb78-6df1988115ff\") " pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.072762 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.072607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qqg4\" (UniqueName: \"kubernetes.io/projected/cf9546f8-7345-411f-bb78-6df1988115ff-kube-api-access-2qqg4\") pod \"service-ca-658d7b7c78-fff8d\" (UID: \"cf9546f8-7345-411f-bb78-6df1988115ff\") " pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.072762 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.072669    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cf9546f8-7345-411f-bb78-6df1988115ff-signing-key\") pod \"service-ca-658d7b7c78-fff8d\" (UID: \"cf9546f8-7345-411f-bb78-6df1988115ff\") " pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.094479 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.094442    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:51.122137 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.122108    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7qqxm_f6e7925a-b3c4-4064-925d-cdc5e31e48f1/dns-node-resolver/0.log"
Jul 28 17:17:51.173591 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.173556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cf9546f8-7345-411f-bb78-6df1988115ff-signing-cabundle\") pod \"service-ca-658d7b7c78-fff8d\" (UID: \"cf9546f8-7345-411f-bb78-6df1988115ff\") " pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.173734 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.173629    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qqg4\" (UniqueName: \"kubernetes.io/projected/cf9546f8-7345-411f-bb78-6df1988115ff-kube-api-access-2qqg4\") pod \"service-ca-658d7b7c78-fff8d\" (UID: \"cf9546f8-7345-411f-bb78-6df1988115ff\") " pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.173734 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.173660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cf9546f8-7345-411f-bb78-6df1988115ff-signing-key\") pod \"service-ca-658d7b7c78-fff8d\" (UID: \"cf9546f8-7345-411f-bb78-6df1988115ff\") " pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.174334 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.174308    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cf9546f8-7345-411f-bb78-6df1988115ff-signing-cabundle\") pod \"service-ca-658d7b7c78-fff8d\" (UID: \"cf9546f8-7345-411f-bb78-6df1988115ff\") " pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.175964 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.175943    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cf9546f8-7345-411f-bb78-6df1988115ff-signing-key\") pod \"service-ca-658d7b7c78-fff8d\" (UID: \"cf9546f8-7345-411f-bb78-6df1988115ff\") " pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.182900 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.182881    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qqg4\" (UniqueName: \"kubernetes.io/projected/cf9546f8-7345-411f-bb78-6df1988115ff-kube-api-access-2qqg4\") pod \"service-ca-658d7b7c78-fff8d\" (UID: \"cf9546f8-7345-411f-bb78-6df1988115ff\") " pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.196875 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.196839    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:51.304429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.304390    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-fff8d"
Jul 28 17:17:51.426778 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.426747    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-fff8d"]
Jul 28 17:17:51.429949 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:17:51.429922    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9546f8_7345_411f_bb78_6df1988115ff.slice/crio-942552e219ed80289185e4c7dc69fdff94b83a0854281d62e46a3fd2d90cc2d6 WatchSource:0}: Error finding container 942552e219ed80289185e4c7dc69fdff94b83a0854281d62e46a3fd2d90cc2d6: Status 404 returned error can't find the container with id 942552e219ed80289185e4c7dc69fdff94b83a0854281d62e46a3fd2d90cc2d6
Jul 28 17:17:51.469316 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.469282    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-fff8d" event={"ID":"cf9546f8-7345-411f-bb78-6df1988115ff","Type":"ContainerStarted","Data":"942552e219ed80289185e4c7dc69fdff94b83a0854281d62e46a3fd2d90cc2d6"}
Jul 28 17:17:51.475703 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.475678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:51.475817 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.475762    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:51.475857 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:51.475821    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:17:51.475857 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:51.475833    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-559f9bb59c-8bm4b: secret "image-registry-tls" not found
Jul 28 17:17:51.475924 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:51.475857    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 17:17:51.475924 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:51.475890    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls podName:323a94b8-1721-49a3-b79c-a1ab62ceae0e nodeName:}" failed. No retries permitted until 2026-07-28 17:17:59.475876075 +0000 UTC m=+66.903655291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls") pod "image-registry-559f9bb59c-8bm4b" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e") : secret "image-registry-tls" not found
Jul 28 17:17:51.475924 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:51.475906    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert podName:8a3edc0a-9137-48df-b36b-16cb0b75f28b nodeName:}" failed. No retries permitted until 2026-07-28 17:17:59.475895457 +0000 UTC m=+66.903674674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-795tw" (UID: "8a3edc0a-9137-48df-b36b-16cb0b75f28b") : secret "networking-console-plugin-cert" not found
Jul 28 17:17:51.677666 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.677570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:51.677821 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:51.677725    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 17:17:51.677821 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:51.677797    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls podName:a565b207-ff1b-4236-aa4f-fc784f3b945f nodeName:}" failed. No retries permitted until 2026-07-28 17:17:59.67777958 +0000 UTC m=+67.105558799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls") pod "cluster-samples-operator-6748489656-rp5rp" (UID: "a565b207-ff1b-4236-aa4f-fc784f3b945f") : secret "samples-operator-tls" not found
Jul 28 17:17:51.727720 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.727690    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:51.829573 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:51.829535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:52.084211 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:52.084178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:52.522646 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:52.522617    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z7pbf_9001436c-49c2-49d6-967a-2debaf26b00b/node-ca/0.log"
Jul 28 17:17:52.989995 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:52.989919    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:52.989995 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:52.989970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:52.990217 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:52.990058    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:52.990217 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:52.990092    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:52.990217 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:52.990132    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:56.990117933 +0000 UTC m=+64.417897149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:52.990217 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:52.990147    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:17:56.990141783 +0000 UTC m=+64.417920999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:53.122736 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:53.122694    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bbsrj_e0d6b4e4-3979-47bd-8780-27bfd715d592/serve-healthcheck-canary/0.log"
Jul 28 17:17:53.399158 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:53.399132    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbd6q"
Jul 28 17:17:53.476321 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:53.476288    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-fff8d" event={"ID":"cf9546f8-7345-411f-bb78-6df1988115ff","Type":"ContainerStarted","Data":"833c75f24a72bd97bcd99e914486ebb8c84f03c77a40e398e4a930eb207e2ce3"}
Jul 28 17:17:53.494057 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:53.493883    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-fff8d" podStartSLOduration=1.507792202 podStartE2EDuration="3.493860229s" totalImagesPullingTime="1.986068027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:53.492602083 +0000 UTC m=+60.920381322" watchObservedRunningTime="2026-07-28 17:17:53.493860229 +0000 UTC m=+60.921639468"
Jul 28 17:17:55.246557 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:55.246516    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:55.371476 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:55.371443    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:55.475054 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:55.475013    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:55.576476 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:55.576443    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:55.719841 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:55.719809    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:55.869579 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:55.869498    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:55.955160 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:55.955123    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:56.935451 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:56.935415    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:57.026380 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:57.026338    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:57.026544 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:57.026407    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:17:57.026544 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:57.026455    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:17:57.026544 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:57.026517    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:05.026501803 +0000 UTC m=+72.454281020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : configmap "kube-rbac-proxy" not found
Jul 28 17:17:57.026673 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:57.026542    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:57.026673 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:57.026596    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:05.026583562 +0000 UTC m=+72.454362778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:17:57.351930 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:57.351893    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:57.546501 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:57.546467    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:57.819918 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:57.819880    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:57.961127 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:57.961087    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:58.077078 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.076972    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:58.914526 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.914490    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:58.941719 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.941684    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:58.941889 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.941726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:17:58.941889 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.941751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:58.944519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.944492    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 17:17:58.944631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.944615    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:17:58.944697 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.944687    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:17:58.952204 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:58.952180    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 17:17:58.952306 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:58.952254    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs podName:93a8f35e-919b-4c2b-ab51-54cce84896bf nodeName:}" failed. No retries permitted until 2026-07-28 17:19:02.952229698 +0000 UTC m=+130.380008915 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs") pod "network-metrics-daemon-77rmg" (UID: "93a8f35e-919b-4c2b-ab51-54cce84896bf") : secret "metrics-daemon-secret" not found
Jul 28 17:17:58.954442 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.954418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aad70f3d-c86b-45f4-abdf-4d86bdecdf0b-original-pull-secret\") pod \"global-pull-secret-syncer-9l299\" (UID: \"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b\") " pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:58.954772 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.954757    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 17:17:58.974537 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:58.974506    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8btw\" (UniqueName: \"kubernetes.io/projected/176e178e-5fa7-4789-93af-ac877709077a-kube-api-access-g8btw\") pod \"network-check-target-xrgmh\" (UID: \"176e178e-5fa7-4789-93af-ac877709077a\") " pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:59.016901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.016867    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:59.140213 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.140177    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:59.154690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.154660    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wqrl8\""
Jul 28 17:17:59.162271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.162241    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:17:59.162271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.162262    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9l299"
Jul 28 17:17:59.327547 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.327518    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xrgmh"]
Jul 28 17:17:59.331361 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:17:59.331331    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176e178e_5fa7_4789_93af_ac877709077a.slice/crio-8f92bf893b1c9c692c920bf8b501dcda691f383ae05b1e7c495a0e58d3dc4238 WatchSource:0}: Error finding container 8f92bf893b1c9c692c920bf8b501dcda691f383ae05b1e7c495a0e58d3dc4238: Status 404 returned error can't find the container with id 8f92bf893b1c9c692c920bf8b501dcda691f383ae05b1e7c495a0e58d3dc4238
Jul 28 17:17:59.345248 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.345224    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9l299"]
Jul 28 17:17:59.348114 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:17:59.348089    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad70f3d_c86b_45f4_abdf_4d86bdecdf0b.slice/crio-975900fe402aa7a3f2165687be104c5b2eaacaae7e9654e73852b7eb7a0db0a9 WatchSource:0}: Error finding container 975900fe402aa7a3f2165687be104c5b2eaacaae7e9654e73852b7eb7a0db0a9: Status 404 returned error can't find the container with id 975900fe402aa7a3f2165687be104c5b2eaacaae7e9654e73852b7eb7a0db0a9
Jul 28 17:17:59.491229 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.491133    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xrgmh" event={"ID":"176e178e-5fa7-4789-93af-ac877709077a","Type":"ContainerStarted","Data":"8f92bf893b1c9c692c920bf8b501dcda691f383ae05b1e7c495a0e58d3dc4238"}
Jul 28 17:17:59.492261 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.492239    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9l299" event={"ID":"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b","Type":"ContainerStarted","Data":"975900fe402aa7a3f2165687be104c5b2eaacaae7e9654e73852b7eb7a0db0a9"}
Jul 28 17:17:59.535544 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.535505    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:59.545568 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.545543    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:17:59.545678 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.545632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:59.545732 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:59.545694    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 17:17:59.545783 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:17:59.545751    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert podName:8a3edc0a-9137-48df-b36b-16cb0b75f28b nodeName:}" failed. No retries permitted until 2026-07-28 17:18:15.545737589 +0000 UTC m=+82.973516807 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-795tw" (UID: "8a3edc0a-9137-48df-b36b-16cb0b75f28b") : secret "networking-console-plugin-cert" not found
Jul 28 17:17:59.547973 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.547954    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") pod \"image-registry-559f9bb59c-8bm4b\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") " pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:59.664607 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.664576    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gt8nm\""
Jul 28 17:17:59.672906 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.672891    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:17:59.733570 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.733538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:59.747568 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.747484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:59.750953 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.750885    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a565b207-ff1b-4236-aa4f-fc784f3b945f-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-rp5rp\" (UID: \"a565b207-ff1b-4236-aa4f-fc784f3b945f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:17:59.815123 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.815089    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:59.844925 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.844868    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-559f9bb59c-8bm4b"]
Jul 28 17:17:59.847868 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:17:59.847840    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323a94b8_1721_49a3_b79c_a1ab62ceae0e.slice/crio-c069f4d2bda426d643779f54c3efa1483a1ee5ddd09299222f9e799440675ec4 WatchSource:0}: Error finding container c069f4d2bda426d643779f54c3efa1483a1ee5ddd09299222f9e799440675ec4: Status 404 returned error can't find the container with id c069f4d2bda426d643779f54c3efa1483a1ee5ddd09299222f9e799440675ec4
Jul 28 17:17:59.894017 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.893990    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hjr9g\""
Jul 28 17:17:59.902451 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:17:59.902414    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"
Jul 28 17:18:00.058956 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.058147    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp"]
Jul 28 17:18:00.343251 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.343051    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:00.351848 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.351813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:18:00.354963 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.354931    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53122cc2-26c7-43aa-b161-fccf61696643-metrics-tls\") pod \"dns-default-f96fd\" (UID: \"53122cc2-26c7-43aa-b161-fccf61696643\") " pod="openshift-dns/dns-default-f96fd"
Jul 28 17:18:00.497885 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.497848    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp" event={"ID":"a565b207-ff1b-4236-aa4f-fc784f3b945f","Type":"ContainerStarted","Data":"7281ca0e12937af0fde0d6fef84d7913207e3fe74d5b47c3ba16dce28f31c683"}
Jul 28 17:18:00.500094 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.500045    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b" event={"ID":"323a94b8-1721-49a3-b79c-a1ab62ceae0e","Type":"ContainerStarted","Data":"7ea4306ad6c3873c0aa21095d3aa3e74adf9080f59b5a42c3fa7fa244cf5bca6"}
Jul 28 17:18:00.500236 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.500111    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b" event={"ID":"323a94b8-1721-49a3-b79c-a1ab62ceae0e","Type":"ContainerStarted","Data":"c069f4d2bda426d643779f54c3efa1483a1ee5ddd09299222f9e799440675ec4"}
Jul 28 17:18:00.500327 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.500311    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:18:00.526376 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.526325    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b" podStartSLOduration=17.526305968 podStartE2EDuration="17.526305968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:00.525054777 +0000 UTC m=+67.952834014" watchObservedRunningTime="2026-07-28 17:18:00.526305968 +0000 UTC m=+67.954085205"
Jul 28 17:18:00.627022 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.626753    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c9wr5\""
Jul 28 17:18:00.634173 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.634138    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f96fd"
Jul 28 17:18:00.818691 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.817537    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f96fd"]
Jul 28 17:18:00.822798 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:00.822766    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53122cc2_26c7_43aa_b161_fccf61696643.slice/crio-dbca342ee05807f20ea376af1c1e494d2de66ef1348b91d6b828191f290f0929 WatchSource:0}: Error finding container dbca342ee05807f20ea376af1c1e494d2de66ef1348b91d6b828191f290f0929: Status 404 returned error can't find the container with id dbca342ee05807f20ea376af1c1e494d2de66ef1348b91d6b828191f290f0929
Jul 28 17:18:00.939283 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:00.939086    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:01.138598 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:01.138565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:01.237836 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:01.237711    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:01.339110 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:01.339038    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:01.505964 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:01.505886    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f96fd" event={"ID":"53122cc2-26c7-43aa-b161-fccf61696643","Type":"ContainerStarted","Data":"dbca342ee05807f20ea376af1c1e494d2de66ef1348b91d6b828191f290f0929"}
Jul 28 17:18:01.555632 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:01.555599    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:01.837300 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:01.837265    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:02.332529 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:02.332489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:02.741116 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:02.741001    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:03.145727 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:03.145684    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:03.372691 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:03.372645    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:03.473869 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:03.473761    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:03.766706 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:03.766674    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:04.546525 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:04.546485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:04.783720 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:04.783672    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:05.092293 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.092257    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:18:05.092481 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.092310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:18:05.092481 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:18:05.092462    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:18:05.092616 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:18:05.092547    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls podName:cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5 nodeName:}" failed. No retries permitted until 2026-07-28 17:18:21.092526762 +0000 UTC m=+88.520306003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gct9w" (UID: "cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:18:05.093013 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.092977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:18:05.157476 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.157439    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:05.348654 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.348598    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:05.519872 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.519831    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9l299" event={"ID":"aad70f3d-c86b-45f4-abdf-4d86bdecdf0b","Type":"ContainerStarted","Data":"622159e264fc6a02f7391a255e37cd44d6cd0d75e42ba61a8c07c78c7bfd3c57"}
Jul 28 17:18:05.521782 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.521748    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp" event={"ID":"a565b207-ff1b-4236-aa4f-fc784f3b945f","Type":"ContainerStarted","Data":"d5c47d79b1e98b7da627a4e48d65fd5425a4cb6a763feccf486f7c394633d1c3"}
Jul 28 17:18:05.521923 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.521813    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp" event={"ID":"a565b207-ff1b-4236-aa4f-fc784f3b945f","Type":"ContainerStarted","Data":"ec9e93dafd6e727b66aa3f909892f6f831ab62a6da398eed43ac8005f5f8c281"}
Jul 28 17:18:05.523247 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.523211    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xrgmh" event={"ID":"176e178e-5fa7-4789-93af-ac877709077a","Type":"ContainerStarted","Data":"d5d2cc4d4749f4053ed9f2dc9a7ce66321dd0b57b25357cc11410dcfc94aaf0f"}
Jul 28 17:18:05.523362 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.523341    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:18:05.525748 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.525192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f96fd" event={"ID":"53122cc2-26c7-43aa-b161-fccf61696643","Type":"ContainerStarted","Data":"c5646eed3fc2a766615062a528e34408292652128d7bce70471ff40d9fba4a95"}
Jul 28 17:18:05.525748 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.525239    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f96fd" event={"ID":"53122cc2-26c7-43aa-b161-fccf61696643","Type":"ContainerStarted","Data":"48917665939e6a560c7da4fcb4689bbf2560a870f87023c0b6d7c9e4d74c1cc5"}
Jul 28 17:18:05.525748 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.525697    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f96fd"
Jul 28 17:18:05.537128 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.537081    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9l299" podStartSLOduration=66.627066061 podStartE2EDuration="1m12.53705248s" totalImagesPullingTime="5.909986419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:05.536221913 +0000 UTC m=+72.964001152" watchObservedRunningTime="2026-07-28 17:18:05.53705248 +0000 UTC m=+72.964831709"
Jul 28 17:18:05.557982 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.557936    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f96fd" podStartSLOduration=33.129367215 podStartE2EDuration="37.557919256s" totalImagesPullingTime="4.428552041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:05.556869325 +0000 UTC m=+72.984648565" watchObservedRunningTime="2026-07-28 17:18:05.557919256 +0000 UTC m=+72.985698472"
Jul 28 17:18:05.592140 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.592080    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xrgmh" podStartSLOduration=66.671128784 podStartE2EDuration="1m12.592046175s" totalImagesPullingTime="5.920917391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:05.574395617 +0000 UTC m=+73.002174869" watchObservedRunningTime="2026-07-28 17:18:05.592046175 +0000 UTC m=+73.019825413"
Jul 28 17:18:05.592405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.592372    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-rp5rp" podStartSLOduration=17.459406181 podStartE2EDuration="22.59236269s" totalImagesPullingTime="5.132956509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:05.591500622 +0000 UTC m=+73.019279860" watchObservedRunningTime="2026-07-28 17:18:05.59236269 +0000 UTC m=+73.020141927"
Jul 28 17:18:05.605915 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.605837    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:05.956111 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:05.956010    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:06.298571 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:06.298541    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:06.375202 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:06.375169    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:08.576383 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:08.576342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:08.677517 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:08.677485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:08.752865 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:08.752839    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:08.868286 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:08.868202    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:09.247800 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:09.247701    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:09.657676 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:09.657642    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:10.050895 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:10.050860    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:10.166501 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:10.166473    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:10.285041 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:10.284987    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:10.357420 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:10.357340    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:10.845320 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:10.845285    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:13.836185 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.836152    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"]
Jul 28 17:18:13.839013 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.838996    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:13.843286 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.843268    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 17:18:13.843565 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.843550    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 17:18:13.843745 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.843733    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 17:18:13.843963 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.843942    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 17:18:13.857193 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.857173    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"]
Jul 28 17:18:13.910946 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.910912    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-559f9bb59c-8bm4b"]
Jul 28 17:18:13.925808 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.925781    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-2vcxq"]
Jul 28 17:18:13.928963 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.928941    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2vcxq"
Jul 28 17:18:13.931822 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.931804    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dqgnt\""
Jul 28 17:18:13.931935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.931803    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 17:18:13.932555 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.932529    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 17:18:13.946480 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.946458    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2vcxq"]
Jul 28 17:18:13.956143 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.956118    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f879296d-3da0-4e8f-b2d4-28fa32c06054-klusterlet-config\") pod \"klusterlet-addon-workmgr-c6c5db8f5-2f4nx\" (UID: \"f879296d-3da0-4e8f-b2d4-28fa32c06054\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:13.956264 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.956154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvt8c\" (UniqueName: \"kubernetes.io/projected/f879296d-3da0-4e8f-b2d4-28fa32c06054-kube-api-access-nvt8c\") pod \"klusterlet-addon-workmgr-c6c5db8f5-2f4nx\" (UID: \"f879296d-3da0-4e8f-b2d4-28fa32c06054\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:13.956264 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:13.956199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f879296d-3da0-4e8f-b2d4-28fa32c06054-tmp\") pod \"klusterlet-addon-workmgr-c6c5db8f5-2f4nx\" (UID: \"f879296d-3da0-4e8f-b2d4-28fa32c06054\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:14.006132 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.006085    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:14.026391 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.026362    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56565fd7f7-2x2n8"]
Jul 28 17:18:14.029339 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.029324    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.044749 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.044715    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56565fd7f7-2x2n8"]
Jul 28 17:18:14.056832 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.056808    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p67pv\" (UniqueName: \"kubernetes.io/projected/568e5fb7-6017-4c0c-b0cd-04915993d621-kube-api-access-p67pv\") pod \"downloads-7c97dc4555-2vcxq\" (UID: \"568e5fb7-6017-4c0c-b0cd-04915993d621\") " pod="openshift-console/downloads-7c97dc4555-2vcxq"
Jul 28 17:18:14.056952 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.056859    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f879296d-3da0-4e8f-b2d4-28fa32c06054-klusterlet-config\") pod \"klusterlet-addon-workmgr-c6c5db8f5-2f4nx\" (UID: \"f879296d-3da0-4e8f-b2d4-28fa32c06054\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:14.056952 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.056919    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvt8c\" (UniqueName: \"kubernetes.io/projected/f879296d-3da0-4e8f-b2d4-28fa32c06054-kube-api-access-nvt8c\") pod \"klusterlet-addon-workmgr-c6c5db8f5-2f4nx\" (UID: \"f879296d-3da0-4e8f-b2d4-28fa32c06054\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:14.057021 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.056990    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f879296d-3da0-4e8f-b2d4-28fa32c06054-tmp\") pod \"klusterlet-addon-workmgr-c6c5db8f5-2f4nx\" (UID: \"f879296d-3da0-4e8f-b2d4-28fa32c06054\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:14.057358 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.057335    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f879296d-3da0-4e8f-b2d4-28fa32c06054-tmp\") pod \"klusterlet-addon-workmgr-c6c5db8f5-2f4nx\" (UID: \"f879296d-3da0-4e8f-b2d4-28fa32c06054\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:14.059319 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.059301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f879296d-3da0-4e8f-b2d4-28fa32c06054-klusterlet-config\") pod \"klusterlet-addon-workmgr-c6c5db8f5-2f4nx\" (UID: \"f879296d-3da0-4e8f-b2d4-28fa32c06054\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:14.071186 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.071162    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvt8c\" (UniqueName: \"kubernetes.io/projected/f879296d-3da0-4e8f-b2d4-28fa32c06054-kube-api-access-nvt8c\") pod \"klusterlet-addon-workmgr-c6c5db8f5-2f4nx\" (UID: \"f879296d-3da0-4e8f-b2d4-28fa32c06054\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:14.107216 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.107060    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:14.147568 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.147537    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:14.157734 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.157705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p67pv\" (UniqueName: \"kubernetes.io/projected/568e5fb7-6017-4c0c-b0cd-04915993d621-kube-api-access-p67pv\") pod \"downloads-7c97dc4555-2vcxq\" (UID: \"568e5fb7-6017-4c0c-b0cd-04915993d621\") " pod="openshift-console/downloads-7c97dc4555-2vcxq"
Jul 28 17:18:14.157883 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.157754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-bound-sa-token\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.157883 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.157776    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c852b\" (UniqueName: \"kubernetes.io/projected/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-kube-api-access-c852b\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.157883 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.157802    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-ca-trust-extracted\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.157883 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.157820    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-trusted-ca\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.157883 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.157855    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-registry-certificates\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.157883 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.157882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-installation-pull-secrets\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.158219 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.157915    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-image-registry-private-configuration\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.158219 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.157950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-registry-tls\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.167363 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.167339    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p67pv\" (UniqueName: \"kubernetes.io/projected/568e5fb7-6017-4c0c-b0cd-04915993d621-kube-api-access-p67pv\") pod \"downloads-7c97dc4555-2vcxq\" (UID: \"568e5fb7-6017-4c0c-b0cd-04915993d621\") " pod="openshift-console/downloads-7c97dc4555-2vcxq"
Jul 28 17:18:14.203425 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.203375    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:14.237515 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.237485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-2vcxq"
Jul 28 17:18:14.259006 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.258975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-bound-sa-token\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.259191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.259023    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c852b\" (UniqueName: \"kubernetes.io/projected/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-kube-api-access-c852b\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.259191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.259055    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-ca-trust-extracted\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.259191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.259097    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-trusted-ca\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.259191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.259121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-registry-certificates\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.259191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.259139    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-installation-pull-secrets\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.259191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.259175    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-image-registry-private-configuration\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.259507 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.259227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-registry-tls\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.259657 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.259610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-ca-trust-extracted\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.260249 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.260224    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-registry-certificates\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.260696 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.260675    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-trusted-ca\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.262419 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.262398    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-image-registry-private-configuration\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.262494 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.262398    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-installation-pull-secrets\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.262670 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.262653    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-registry-tls\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.276996 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.276965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-bound-sa-token\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.278245 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.278169    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c852b\" (UniqueName: \"kubernetes.io/projected/e4b12af9-1fcf-46bc-8b4f-e8db258f4af7-kube-api-access-c852b\") pod \"image-registry-56565fd7f7-2x2n8\" (UID: \"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7\") " pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.284231 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.284205    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"]
Jul 28 17:18:14.288334 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:14.288310    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf879296d_3da0_4e8f_b2d4_28fa32c06054.slice/crio-ad5a3789bb3c74f3087a2619cc8eb6e296bb51fa5ef4498cbd3ca41d70e6e521 WatchSource:0}: Error finding container ad5a3789bb3c74f3087a2619cc8eb6e296bb51fa5ef4498cbd3ca41d70e6e521: Status 404 returned error can't find the container with id ad5a3789bb3c74f3087a2619cc8eb6e296bb51fa5ef4498cbd3ca41d70e6e521
Jul 28 17:18:14.338269 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.338237    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.373910 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.373817    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-2vcxq"]
Jul 28 17:18:14.379471 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:14.379443    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568e5fb7_6017_4c0c_b0cd_04915993d621.slice/crio-c270afdb97726f27136fa0e9168f681a457054d5b4d01efe6a9f301888ed8f7e WatchSource:0}: Error finding container c270afdb97726f27136fa0e9168f681a457054d5b4d01efe6a9f301888ed8f7e: Status 404 returned error can't find the container with id c270afdb97726f27136fa0e9168f681a457054d5b4d01efe6a9f301888ed8f7e
Jul 28 17:18:14.481188 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.481158    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56565fd7f7-2x2n8"]
Jul 28 17:18:14.483861 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:14.483827    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b12af9_1fcf_46bc_8b4f_e8db258f4af7.slice/crio-90efce40bac3865ae85d40e2d38b0e1c9f0d572da4fdc8bc2be4f418082c7edf WatchSource:0}: Error finding container 90efce40bac3865ae85d40e2d38b0e1c9f0d572da4fdc8bc2be4f418082c7edf: Status 404 returned error can't find the container with id 90efce40bac3865ae85d40e2d38b0e1c9f0d572da4fdc8bc2be4f418082c7edf
Jul 28 17:18:14.558296 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.558260    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2vcxq" event={"ID":"568e5fb7-6017-4c0c-b0cd-04915993d621","Type":"ContainerStarted","Data":"c270afdb97726f27136fa0e9168f681a457054d5b4d01efe6a9f301888ed8f7e"}
Jul 28 17:18:14.559352 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.559316    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx" event={"ID":"f879296d-3da0-4e8f-b2d4-28fa32c06054","Type":"ContainerStarted","Data":"ad5a3789bb3c74f3087a2619cc8eb6e296bb51fa5ef4498cbd3ca41d70e6e521"}
Jul 28 17:18:14.560724 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.560702    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8" event={"ID":"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7","Type":"ContainerStarted","Data":"240a225866180f12bc82238d5839599b67c59aa9f611ead63c702b33368bb61d"}
Jul 28 17:18:14.560822 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.560740    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8" event={"ID":"e4b12af9-1fcf-46bc-8b4f-e8db258f4af7","Type":"ContainerStarted","Data":"90efce40bac3865ae85d40e2d38b0e1c9f0d572da4fdc8bc2be4f418082c7edf"}
Jul 28 17:18:14.560822 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.560768    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:14.579619 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:14.579570    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8" podStartSLOduration=0.579552943 podStartE2EDuration="579.552943ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:14.579134358 +0000 UTC m=+82.006913596" watchObservedRunningTime="2026-07-28 17:18:14.579552943 +0000 UTC m=+82.007332163"
Jul 28 17:18:15.571778 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:15.571742    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:18:15.575321 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:15.575265    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a3edc0a-9137-48df-b36b-16cb0b75f28b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-795tw\" (UID: \"8a3edc0a-9137-48df-b36b-16cb0b75f28b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:18:15.852959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:15.852881    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m9txv\""
Jul 28 17:18:15.860454 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:15.860359    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw"
Jul 28 17:18:16.478901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:16.478841    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:16.538688 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:16.538585    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f96fd"
Jul 28 17:18:16.937309 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:16.937226    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-795tw"]
Jul 28 17:18:16.940945 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:16.940853    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3edc0a_9137_48df_b36b_16cb0b75f28b.slice/crio-68c6ea7a8ce16943aa1847b23ebcb12d9e7274c0d92fa8eeb633db77ea3b2b83 WatchSource:0}: Error finding container 68c6ea7a8ce16943aa1847b23ebcb12d9e7274c0d92fa8eeb633db77ea3b2b83: Status 404 returned error can't find the container with id 68c6ea7a8ce16943aa1847b23ebcb12d9e7274c0d92fa8eeb633db77ea3b2b83
Jul 28 17:18:17.578232 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:17.578191    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw" event={"ID":"8a3edc0a-9137-48df-b36b-16cb0b75f28b","Type":"ContainerStarted","Data":"68c6ea7a8ce16943aa1847b23ebcb12d9e7274c0d92fa8eeb633db77ea3b2b83"}
Jul 28 17:18:18.584581 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:18.584484    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx" event={"ID":"f879296d-3da0-4e8f-b2d4-28fa32c06054","Type":"ContainerStarted","Data":"c54d09dfb648ff5b8729c534d9e9d8499da019ab7507fde8727da3b3cf493dbf"}
Jul 28 17:18:18.585036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:18.584940    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:18.586872 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:18.586848    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx"
Jul 28 17:18:18.603162 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:18.603105    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c6c5db8f5-2f4nx" podStartSLOduration=1.5903967209999998 podStartE2EDuration="5.603085952s" totalImagesPullingTime="4.012689231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:18.602445895 +0000 UTC m=+86.030225145" watchObservedRunningTime="2026-07-28 17:18:18.603085952 +0000 UTC m=+86.030865183"
Jul 28 17:18:19.182020 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:19.181934    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:19.274935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:19.274884    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:19.594612 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:19.594574    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw" event={"ID":"8a3edc0a-9137-48df-b36b-16cb0b75f28b","Type":"ContainerStarted","Data":"d6f11d83a574809669dc66c68d01e3be26d3ae1f47e464d57c4c14d5666a520a"}
Jul 28 17:18:19.611978 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:19.611928    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-795tw" podStartSLOduration=34.51129335 podStartE2EDuration="36.611912254s" totalImagesPullingTime="2.100618904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:19.611442805 +0000 UTC m=+87.039222044" watchObservedRunningTime="2026-07-28 17:18:19.611912254 +0000 UTC m=+87.039691492"
Jul 28 17:18:19.672171 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:19.672132    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:19.774879 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:19.774837    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:19.862341 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:19.862201    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:20.876750 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:20.876712    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:20.943869 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:20.943840    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:21.119907 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:21.119875    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:18:21.122549 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:21.122492    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gct9w\" (UID: \"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5\") " pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:18:21.132615 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:21.132546    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hbmbv\""
Jul 28 17:18:21.140538 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:21.140513    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gct9w"
Jul 28 17:18:21.293323 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:21.293286    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gct9w"]
Jul 28 17:18:21.296716 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:21.296690    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4dcd02_b711_43a6_abdd_2fe8b45d9dc5.slice/crio-ad42d4312293e971a88bf831beeb90c1be66e8575fc7bfd8b46b02b7dc5f72af WatchSource:0}: Error finding container ad42d4312293e971a88bf831beeb90c1be66e8575fc7bfd8b46b02b7dc5f72af: Status 404 returned error can't find the container with id ad42d4312293e971a88bf831beeb90c1be66e8575fc7bfd8b46b02b7dc5f72af
Jul 28 17:18:21.603053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:21.603012    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gct9w" event={"ID":"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5","Type":"ContainerStarted","Data":"ad42d4312293e971a88bf831beeb90c1be66e8575fc7bfd8b46b02b7dc5f72af"}
Jul 28 17:18:23.918661 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:23.918629    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:18:24.154803 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:24.154758    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:24.225450 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:24.225368    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:24.583270 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:24.583228    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:27.313099 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.313050    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-659476b564-njfhd"]
Jul 28 17:18:27.318719 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.318696    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.321496 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.321470    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 17:18:27.321632 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.321586    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 17:18:27.322858 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.322837    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 17:18:27.323000 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.322933    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 17:18:27.323000 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.322953    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xc6lg\""
Jul 28 17:18:27.323202 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.323181    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 17:18:27.328619 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.328550    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 17:18:27.329023 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.328999    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659476b564-njfhd"]
Jul 28 17:18:27.331271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.331244    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:27.450529 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.450486    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:27.473412 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.473376    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wwcq\" (UniqueName: \"kubernetes.io/projected/9af703db-9f4b-4fe6-bc94-608b83010035-kube-api-access-4wwcq\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.473587 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.473419    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-oauth-serving-cert\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.473587 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.473454    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-trusted-ca-bundle\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.473587 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.473528    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-oauth-config\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.473587 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.473579    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-service-ca\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.473815 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.473697    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-serving-cert\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.473815 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.473753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-console-config\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.575042 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.574947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-serving-cert\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.575042 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.575029    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-console-config\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.575304 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.575136    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wwcq\" (UniqueName: \"kubernetes.io/projected/9af703db-9f4b-4fe6-bc94-608b83010035-kube-api-access-4wwcq\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.575304 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.575173    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-oauth-serving-cert\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.575304 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.575215    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-trusted-ca-bundle\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.575304 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.575262    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-oauth-config\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.575304 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.575290    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-service-ca\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.575905 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.575820    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-console-config\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.575905 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.575888    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-oauth-serving-cert\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.576108 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.576034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-service-ca\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.576263 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.576238    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-trusted-ca-bundle\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.577832 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.577807    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-serving-cert\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.578279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.578260    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-oauth-config\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.585444 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.585410    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wwcq\" (UniqueName: \"kubernetes.io/projected/9af703db-9f4b-4fe6-bc94-608b83010035-kube-api-access-4wwcq\") pod \"console-659476b564-njfhd\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") " pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:27.630747 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:27.630713    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:28.669665 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:28.669627    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:28.733755 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:28.733699    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:29.087972 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:29.087851    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:29.976615 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:29.976560    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:30.078589 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:30.078489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:30.499293 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:30.499253    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:30.577115 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:30.577078    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:31.340734 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.340654    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:31.557099 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.557006    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:31.634413 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.634325    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qjjlj"]
Jul 28 17:18:31.679370 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.679324    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:31.695113 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.695056    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.703775 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.703747    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 17:18:31.704428 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.703989    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 17:18:31.704428 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.704262    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kzkgt\""
Jul 28 17:18:31.704553 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.704533    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 17:18:31.705113 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.704737    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 17:18:31.705113 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.704940    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 17:18:31.705270 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.705227    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 17:18:31.814386 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.814339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/570a24e6-69f5-4f45-a9ec-eee669919228-root\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.814573 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.814392    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-tls\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.814573 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.814424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.814573 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.814544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmh57\" (UniqueName: \"kubernetes.io/projected/570a24e6-69f5-4f45-a9ec-eee669919228-kube-api-access-tmh57\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.814705 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.814628    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-accelerators-collector-config\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.814705 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.814654    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/570a24e6-69f5-4f45-a9ec-eee669919228-sys\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.814705 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.814683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-wtmp\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.814842 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.814728    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/570a24e6-69f5-4f45-a9ec-eee669919228-metrics-client-ca\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.814842 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.814773    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-textfile\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.831790 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.831735    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:31.916272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.916176    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-accelerators-collector-config\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.916891 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.916852    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/570a24e6-69f5-4f45-a9ec-eee669919228-sys\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917014 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.916911    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-wtmp\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917014 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.916938    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/570a24e6-69f5-4f45-a9ec-eee669919228-metrics-client-ca\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917014 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.916947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-accelerators-collector-config\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917014 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.916960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/570a24e6-69f5-4f45-a9ec-eee669919228-sys\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917014 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.916982    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-textfile\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917299 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.917036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/570a24e6-69f5-4f45-a9ec-eee669919228-root\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917299 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.917087    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-tls\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917299 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.917117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917299 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.917122    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-wtmp\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917299 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.917124    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/570a24e6-69f5-4f45-a9ec-eee669919228-root\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917299 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.917165    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmh57\" (UniqueName: \"kubernetes.io/projected/570a24e6-69f5-4f45-a9ec-eee669919228-kube-api-access-tmh57\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917598 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.917447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/570a24e6-69f5-4f45-a9ec-eee669919228-metrics-client-ca\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.917655 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.917593    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-textfile\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.919771 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.919745    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.919929 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.919904    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570a24e6-69f5-4f45-a9ec-eee669919228-node-exporter-tls\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.930260 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.930235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmh57\" (UniqueName: \"kubernetes.io/projected/570a24e6-69f5-4f45-a9ec-eee669919228-kube-api-access-tmh57\") pod \"node-exporter-qjjlj\" (UID: \"570a24e6-69f5-4f45-a9ec-eee669919228\") " pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:31.949685 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:31.949658    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:32.008366 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.008321    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qjjlj"
Jul 28 17:18:32.101837 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.101797    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:32.417223 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.417187    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:32.515980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.515949    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:32.622612 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.622573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:32.730279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.730176    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:32.745582 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.745549    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:18:32.767178 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.767152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.772136 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.771814    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 17:18:32.772136 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.772107    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 17:18:32.772325 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.772190    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 17:18:32.772383 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.772354    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 17:18:32.772383 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.772379    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 17:18:32.772494 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.772403    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 17:18:32.772494 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.772354    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 17:18:32.772639 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.772622    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 17:18:32.772699 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.772690    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-25pwt\""
Jul 28 17:18:32.773024 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.773004    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 17:18:32.773444 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.773426    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:18:32.825493 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825459    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.825673 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825512    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.825673 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825543    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.825673 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825567    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc2a7663-7e5f-4136-a655-4d1a79ea1398-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.825673 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc2a7663-7e5f-4136-a655-4d1a79ea1398-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.825859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc2a7663-7e5f-4136-a655-4d1a79ea1398-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.825859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825729    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc2a7663-7e5f-4136-a655-4d1a79ea1398-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.825859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825765    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.825859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825790    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.825859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825838    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4cdk\" (UniqueName: \"kubernetes.io/projected/fc2a7663-7e5f-4136-a655-4d1a79ea1398-kube-api-access-f4cdk\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.826110 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825922    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc2a7663-7e5f-4136-a655-4d1a79ea1398-config-out\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.826110 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825961    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-web-config\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.826110 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.825995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927124 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927083    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc2a7663-7e5f-4136-a655-4d1a79ea1398-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927132    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc2a7663-7e5f-4136-a655-4d1a79ea1398-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927172    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4cdk\" (UniqueName: \"kubernetes.io/projected/fc2a7663-7e5f-4136-a655-4d1a79ea1398-kube-api-access-f4cdk\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927223    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc2a7663-7e5f-4136-a655-4d1a79ea1398-config-out\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-web-config\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927281    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927331    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927363    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927388    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc2a7663-7e5f-4136-a655-4d1a79ea1398-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927434    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc2a7663-7e5f-4136-a655-4d1a79ea1398-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.927898 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.927693    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fc2a7663-7e5f-4136-a655-4d1a79ea1398-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.928611 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.928279    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc2a7663-7e5f-4136-a655-4d1a79ea1398-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.928743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.928688    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc2a7663-7e5f-4136-a655-4d1a79ea1398-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.930691 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.930645    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc2a7663-7e5f-4136-a655-4d1a79ea1398-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.931305 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.931176    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.931305 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.931211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc2a7663-7e5f-4136-a655-4d1a79ea1398-config-out\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.931305 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.931265    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.931585 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.931302    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.931585 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.931530    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-web-config\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.931585 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.931564    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-config-volume\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.932333 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.932310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.933318 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.933294    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc2a7663-7e5f-4136-a655-4d1a79ea1398-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:32.950675 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:32.950648    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4cdk\" (UniqueName: \"kubernetes.io/projected/fc2a7663-7e5f-4136-a655-4d1a79ea1398-kube-api-access-f4cdk\") pod \"alertmanager-main-0\" (UID: \"fc2a7663-7e5f-4136-a655-4d1a79ea1398\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:33.029833 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:33.029797    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:33.079549 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:33.079519    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 17:18:33.128251 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:33.128201    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:33.987468 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:33.987423    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570a24e6_69f5_4f45_a9ec_eee669919228.slice/crio-2d586b684508ffb3e4c0fa35e8933e5d3d686de53f3773a09f1c73031bfd14e2 WatchSource:0}: Error finding container 2d586b684508ffb3e4c0fa35e8933e5d3d686de53f3773a09f1c73031bfd14e2: Status 404 returned error can't find the container with id 2d586b684508ffb3e4c0fa35e8933e5d3d686de53f3773a09f1c73031bfd14e2
Jul 28 17:18:34.130946 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.130925    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659476b564-njfhd"]
Jul 28 17:18:34.134117 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:34.134088    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af703db_9f4b_4fe6_bc94_608b83010035.slice/crio-796ea9cd1fed6fb99be4f4ff019070d2f68e53afde76295da16368be5bd528d9 WatchSource:0}: Error finding container 796ea9cd1fed6fb99be4f4ff019070d2f68e53afde76295da16368be5bd528d9: Status 404 returned error can't find the container with id 796ea9cd1fed6fb99be4f4ff019070d2f68e53afde76295da16368be5bd528d9
Jul 28 17:18:34.162788 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.162762    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 17:18:34.164683 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:34.164660    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2a7663_7e5f_4136_a655_4d1a79ea1398.slice/crio-7c11a79302b5b2859e275bb880cf7165b493e53aa413ce1b9372a04615084c41 WatchSource:0}: Error finding container 7c11a79302b5b2859e275bb880cf7165b493e53aa413ce1b9372a04615084c41: Status 404 returned error can't find the container with id 7c11a79302b5b2859e275bb880cf7165b493e53aa413ce1b9372a04615084c41
Jul 28 17:18:34.659549 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.657582    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gct9w" event={"ID":"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5","Type":"ContainerStarted","Data":"a2f00ac97980be7610bd8c4a0553da676d3416475ddc737f8b762cae7f0cf7c6"}
Jul 28 17:18:34.660899 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.660809    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qjjlj" event={"ID":"570a24e6-69f5-4f45-a9ec-eee669919228","Type":"ContainerStarted","Data":"2d586b684508ffb3e4c0fa35e8933e5d3d686de53f3773a09f1c73031bfd14e2"}
Jul 28 17:18:34.662905 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.662796    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc2a7663-7e5f-4136-a655-4d1a79ea1398","Type":"ContainerStarted","Data":"7c11a79302b5b2859e275bb880cf7165b493e53aa413ce1b9372a04615084c41"}
Jul 28 17:18:34.672894 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.671775    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-2vcxq" event={"ID":"568e5fb7-6017-4c0c-b0cd-04915993d621","Type":"ContainerStarted","Data":"a429d779150d459f188fd722c18ab053d37102bd7052fff5e0d187322b00a29e"}
Jul 28 17:18:34.672894 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.672842    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-2vcxq"
Jul 28 17:18:34.675677 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.674158    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:34.677689 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.677620    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659476b564-njfhd" event={"ID":"9af703db-9f4b-4fe6-bc94-608b83010035","Type":"ContainerStarted","Data":"796ea9cd1fed6fb99be4f4ff019070d2f68e53afde76295da16368be5bd528d9"}
Jul 28 17:18:34.686550 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.686497    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-2vcxq"
Jul 28 17:18:34.697445 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.695725    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-2vcxq" podStartSLOduration=2.040538838 podStartE2EDuration="21.695704148s" totalImagesPullingTime="19.65516531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:34.695418927 +0000 UTC m=+102.123198166" watchObservedRunningTime="2026-07-28 17:18:34.695704148 +0000 UTC m=+102.123483387"
Jul 28 17:18:34.732758 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.731959    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"]
Jul 28 17:18:34.755493 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.754543    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"]
Jul 28 17:18:34.755493 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.754705    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.762980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.759833    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-c7h8l\""
Jul 28 17:18:34.762980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.760169    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 17:18:34.762980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.760399    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 17:18:34.762980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.760700    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 17:18:34.762980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.760897    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 17:18:34.762980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.761604    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-tfmi7gkits18\""
Jul 28 17:18:34.765391 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.765226    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 17:18:34.786412 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.786379    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:34.852153 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.851660    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwvjb\" (UniqueName: \"kubernetes.io/projected/55fd9971-3831-4962-80bf-f2a668791e70-kube-api-access-gwvjb\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.852153 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.851722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.852153 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.851764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55fd9971-3831-4962-80bf-f2a668791e70-metrics-client-ca\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.852153 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.851843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.852153 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.851881    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.852153 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.851911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-grpc-tls\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.852153 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.851970    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.852153 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.852000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-tls\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.911247 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.911143    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:34.954617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.953441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwvjb\" (UniqueName: \"kubernetes.io/projected/55fd9971-3831-4962-80bf-f2a668791e70-kube-api-access-gwvjb\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.954617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.953503    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.954617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.953542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55fd9971-3831-4962-80bf-f2a668791e70-metrics-client-ca\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.954617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.953610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.954617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.953643    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.954617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.953673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-grpc-tls\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.954617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.953764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.954617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.953795    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-tls\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.957102 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.957034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55fd9971-3831-4962-80bf-f2a668791e70-metrics-client-ca\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.959966 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.959534    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.959966 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.959924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.966042 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.965992    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwvjb\" (UniqueName: \"kubernetes.io/projected/55fd9971-3831-4962-80bf-f2a668791e70-kube-api-access-gwvjb\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.976698 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.976641    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:34.990274 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:34.989130    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-tls\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:35.006512 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:35.005250    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:35.014120 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:35.014051    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55fd9971-3831-4962-80bf-f2a668791e70-secret-grpc-tls\") pod \"thanos-querier-75fc5bc9cc-clmpl\" (UID: \"55fd9971-3831-4962-80bf-f2a668791e70\") " pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:35.077235 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:35.076930    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:35.309366 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:35.309273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:35.355274 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:35.355159    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"]
Jul 28 17:18:35.574092 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:35.573875    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56565fd7f7-2x2n8"
Jul 28 17:18:35.731687 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:35.731606    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:35.833102 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:35.832914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:35.896860 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:35.896825    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55fd9971_3831_4962_80bf_f2a668791e70.slice/crio-693fa6aae65b6b23ae1d82e0f13487651b2e5c049912299e570c660d6b998b88 WatchSource:0}: Error finding container 693fa6aae65b6b23ae1d82e0f13487651b2e5c049912299e570c660d6b998b88: Status 404 returned error can't find the container with id 693fa6aae65b6b23ae1d82e0f13487651b2e5c049912299e570c660d6b998b88
Jul 28 17:18:36.228775 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.228274    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64446b66cb-mc49d"]
Jul 28 17:18:36.252341 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.252163    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64446b66cb-mc49d"]
Jul 28 17:18:36.255148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.252540    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.256061 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.256030    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 17:18:36.256743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.256557    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 28 17:18:36.258060 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.257398    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 28 17:18:36.258060 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.257647    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 28 17:18:36.258060 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.257915    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-968h2reakn1lb\""
Jul 28 17:18:36.260446 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.259445    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-85hd9\""
Jul 28 17:18:36.379602 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.379564    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:36.381333 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.381255    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659476b564-njfhd"]
Jul 28 17:18:36.383103 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.383020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f73e1f52-2e96-44f5-ba28-746845519c60-secret-metrics-server-tls\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.383717 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.383380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f73e1f52-2e96-44f5-ba28-746845519c60-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.383717 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.383442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f73e1f52-2e96-44f5-ba28-746845519c60-metrics-server-audit-profiles\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.383717 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.383475    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f73e1f52-2e96-44f5-ba28-746845519c60-secret-metrics-server-client-certs\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.383717 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.383540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f73e1f52-2e96-44f5-ba28-746845519c60-client-ca-bundle\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.383717 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.383575    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f73e1f52-2e96-44f5-ba28-746845519c60-audit-log\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.383717 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.383605    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml2kr\" (UniqueName: \"kubernetes.io/projected/f73e1f52-2e96-44f5-ba28-746845519c60-kube-api-access-ml2kr\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.390764 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.389787    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"]
Jul 28 17:18:36.413378 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.413350    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"]
Jul 28 17:18:36.413572 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.413456    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:36.418722 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.417447    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 17:18:36.418722 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.417690    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wbdm2\""
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f73e1f52-2e96-44f5-ba28-746845519c60-metrics-server-audit-profiles\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f73e1f52-2e96-44f5-ba28-746845519c60-secret-metrics-server-client-certs\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f73e1f52-2e96-44f5-ba28-746845519c60-client-ca-bundle\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485434    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f73e1f52-2e96-44f5-ba28-746845519c60-audit-log\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485466    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/86551e1c-409e-42ae-ae0a-d05d35e53a97-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-llwkt\" (UID: \"86551e1c-409e-42ae-ae0a-d05d35e53a97\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485492    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml2kr\" (UniqueName: \"kubernetes.io/projected/f73e1f52-2e96-44f5-ba28-746845519c60-kube-api-access-ml2kr\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f73e1f52-2e96-44f5-ba28-746845519c60-secret-metrics-server-tls\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f73e1f52-2e96-44f5-ba28-746845519c60-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485646    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22r92\" (UniqueName: \"kubernetes.io/projected/86551e1c-409e-42ae-ae0a-d05d35e53a97-kube-api-access-22r92\") pod \"monitoring-plugin-68b7fc9574-llwkt\" (UID: \"86551e1c-409e-42ae-ae0a-d05d35e53a97\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.485908    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f73e1f52-2e96-44f5-ba28-746845519c60-audit-log\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.486925    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f73e1f52-2e96-44f5-ba28-746845519c60-metrics-server-audit-profiles\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.497148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.487531    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f73e1f52-2e96-44f5-ba28-746845519c60-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.498249 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.498200    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f73e1f52-2e96-44f5-ba28-746845519c60-secret-metrics-server-client-certs\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.503683 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.503091    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f73e1f52-2e96-44f5-ba28-746845519c60-client-ca-bundle\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.504953 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.504912    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml2kr\" (UniqueName: \"kubernetes.io/projected/f73e1f52-2e96-44f5-ba28-746845519c60-kube-api-access-ml2kr\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.510729 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.510682    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f73e1f52-2e96-44f5-ba28-746845519c60-secret-metrics-server-tls\") pod \"metrics-server-64446b66cb-mc49d\" (UID: \"f73e1f52-2e96-44f5-ba28-746845519c60\") " pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.518858 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.518769    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:36.532903 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.532302    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xrgmh"
Jul 28 17:18:36.571891 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.571047    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:36.587728 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.586481    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22r92\" (UniqueName: \"kubernetes.io/projected/86551e1c-409e-42ae-ae0a-d05d35e53a97-kube-api-access-22r92\") pod \"monitoring-plugin-68b7fc9574-llwkt\" (UID: \"86551e1c-409e-42ae-ae0a-d05d35e53a97\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:36.587728 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.586595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/86551e1c-409e-42ae-ae0a-d05d35e53a97-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-llwkt\" (UID: \"86551e1c-409e-42ae-ae0a-d05d35e53a97\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:36.591413 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.591359    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/86551e1c-409e-42ae-ae0a-d05d35e53a97-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-llwkt\" (UID: \"86551e1c-409e-42ae-ae0a-d05d35e53a97\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:36.603743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.603684    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22r92\" (UniqueName: \"kubernetes.io/projected/86551e1c-409e-42ae-ae0a-d05d35e53a97-kube-api-access-22r92\") pod \"monitoring-plugin-68b7fc9574-llwkt\" (UID: \"86551e1c-409e-42ae-ae0a-d05d35e53a97\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:36.629538 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.629482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:36.694486 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.691636    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl" event={"ID":"55fd9971-3831-4962-80bf-f2a668791e70","Type":"ContainerStarted","Data":"693fa6aae65b6b23ae1d82e0f13487651b2e5c049912299e570c660d6b998b88"}
Jul 28 17:18:36.732486 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:36.732235    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:37.368132 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.367995    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64446b66cb-mc49d"]
Jul 28 17:18:37.375495 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:18:37.375461    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73e1f52_2e96_44f5_ba28_746845519c60.slice/crio-3c88037008d0fa4d13863e885191899c8ac3b1512fc3e999ea0b6e488ae1415a WatchSource:0}: Error finding container 3c88037008d0fa4d13863e885191899c8ac3b1512fc3e999ea0b6e488ae1415a: Status 404 returned error can't find the container with id 3c88037008d0fa4d13863e885191899c8ac3b1512fc3e999ea0b6e488ae1415a
Jul 28 17:18:37.400507 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.400435    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"]
Jul 28 17:18:37.707983 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.707846    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64446b66cb-mc49d" event={"ID":"f73e1f52-2e96-44f5-ba28-746845519c60","Type":"ContainerStarted","Data":"3c88037008d0fa4d13863e885191899c8ac3b1512fc3e999ea0b6e488ae1415a"}
Jul 28 17:18:37.712364 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.712179    2574 generic.go:356] "Generic (PLEG): container finished" podID="fc2a7663-7e5f-4136-a655-4d1a79ea1398" containerID="6efdfba761fded5c71a7b07b43c4844c3b799223e74750e10cd5480d1b880617" exitCode=0
Jul 28 17:18:37.712364 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.712273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc2a7663-7e5f-4136-a655-4d1a79ea1398","Type":"ContainerDied","Data":"6efdfba761fded5c71a7b07b43c4844c3b799223e74750e10cd5480d1b880617"}
Jul 28 17:18:37.715687 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.715384    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt" event={"ID":"86551e1c-409e-42ae-ae0a-d05d35e53a97","Type":"ContainerStarted","Data":"28ee994b233495b079ae302725515774b51e28e9365feace3de3b400fc430cca"}
Jul 28 17:18:37.719405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.719381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qjjlj" event={"ID":"570a24e6-69f5-4f45-a9ec-eee669919228","Type":"ContainerStarted","Data":"e84da5f4330a3366bd34ca7b5e1ab1616cd4265a7bf6e481029c0e703b1bb7f5"}
Jul 28 17:18:37.760056 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.759999    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:37.844728 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.844637    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:37.937689 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:37.937249    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:38.931081 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:38.930994    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b" podUID="323a94b8-1721-49a3-b79c-a1ab62ceae0e" containerName="registry" containerID="cri-o://7ea4306ad6c3873c0aa21095d3aa3e74adf9080f59b5a42c3fa7fa244cf5bca6" gracePeriod=30
Jul 28 17:18:39.734150 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:39.733379    2574 generic.go:356] "Generic (PLEG): container finished" podID="570a24e6-69f5-4f45-a9ec-eee669919228" containerID="e84da5f4330a3366bd34ca7b5e1ab1616cd4265a7bf6e481029c0e703b1bb7f5" exitCode=0
Jul 28 17:18:39.734150 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:39.733505    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qjjlj" event={"ID":"570a24e6-69f5-4f45-a9ec-eee669919228","Type":"ContainerDied","Data":"e84da5f4330a3366bd34ca7b5e1ab1616cd4265a7bf6e481029c0e703b1bb7f5"}
Jul 28 17:18:41.749884 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:41.749797    2574 generic.go:356] "Generic (PLEG): container finished" podID="323a94b8-1721-49a3-b79c-a1ab62ceae0e" containerID="7ea4306ad6c3873c0aa21095d3aa3e74adf9080f59b5a42c3fa7fa244cf5bca6" exitCode=0
Jul 28 17:18:41.749884 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:41.749875    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b" event={"ID":"323a94b8-1721-49a3-b79c-a1ab62ceae0e","Type":"ContainerDied","Data":"7ea4306ad6c3873c0aa21095d3aa3e74adf9080f59b5a42c3fa7fa244cf5bca6"}
Jul 28 17:18:43.137989 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.137963    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:18:43.260045 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260011    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jdzm\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-kube-api-access-9jdzm\") pod \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") "
Jul 28 17:18:43.260354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260111    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-image-registry-private-configuration\") pod \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") "
Jul 28 17:18:43.260354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260150    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-installation-pull-secrets\") pod \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") "
Jul 28 17:18:43.260354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260182    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/323a94b8-1721-49a3-b79c-a1ab62ceae0e-ca-trust-extracted\") pod \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") "
Jul 28 17:18:43.260354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260225    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-certificates\") pod \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") "
Jul 28 17:18:43.260354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260259    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") pod \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") "
Jul 28 17:18:43.260354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260286    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-trusted-ca\") pod \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") "
Jul 28 17:18:43.260354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260319    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-bound-sa-token\") pod \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\" (UID: \"323a94b8-1721-49a3-b79c-a1ab62ceae0e\") "
Jul 28 17:18:43.260939 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260868    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "323a94b8-1721-49a3-b79c-a1ab62ceae0e" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:18:43.260939 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.260927    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "323a94b8-1721-49a3-b79c-a1ab62ceae0e" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:18:43.263564 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.263334    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "323a94b8-1721-49a3-b79c-a1ab62ceae0e" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:18:43.263564 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.263486    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "323a94b8-1721-49a3-b79c-a1ab62ceae0e" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:18:43.263738 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.263669    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-kube-api-access-9jdzm" (OuterVolumeSpecName: "kube-api-access-9jdzm") pod "323a94b8-1721-49a3-b79c-a1ab62ceae0e" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e"). InnerVolumeSpecName "kube-api-access-9jdzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:18:43.263859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.263827    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "323a94b8-1721-49a3-b79c-a1ab62ceae0e" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:18:43.264096 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.264056    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "323a94b8-1721-49a3-b79c-a1ab62ceae0e" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:18:43.271403 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.271372    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323a94b8-1721-49a3-b79c-a1ab62ceae0e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "323a94b8-1721-49a3-b79c-a1ab62ceae0e" (UID: "323a94b8-1721-49a3-b79c-a1ab62ceae0e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:18:43.361353 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.361270    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-image-registry-private-configuration\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.361353 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.361301    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/323a94b8-1721-49a3-b79c-a1ab62ceae0e-installation-pull-secrets\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.361353 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.361317    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/323a94b8-1721-49a3-b79c-a1ab62ceae0e-ca-trust-extracted\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.361353 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.361331    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-certificates\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.361353 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.361346    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-registry-tls\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.361353 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.361354    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/323a94b8-1721-49a3-b79c-a1ab62ceae0e-trusted-ca\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.361353 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.361362    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-bound-sa-token\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.361753 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.361370    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jdzm\" (UniqueName: \"kubernetes.io/projected/323a94b8-1721-49a3-b79c-a1ab62ceae0e-kube-api-access-9jdzm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.758650 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.758620    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b" event={"ID":"323a94b8-1721-49a3-b79c-a1ab62ceae0e","Type":"ContainerDied","Data":"c069f4d2bda426d643779f54c3efa1483a1ee5ddd09299222f9e799440675ec4"}
Jul 28 17:18:43.758864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.758669    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-559f9bb59c-8bm4b"
Jul 28 17:18:43.758864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.758707    2574 scope.go:117] "RemoveContainer" containerID="7ea4306ad6c3873c0aa21095d3aa3e74adf9080f59b5a42c3fa7fa244cf5bca6"
Jul 28 17:18:43.779479 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.779447    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-559f9bb59c-8bm4b"]
Jul 28 17:18:43.783593 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:43.783568    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-559f9bb59c-8bm4b"]
Jul 28 17:18:45.146346 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.146321    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323a94b8-1721-49a3-b79c-a1ab62ceae0e" path="/var/lib/kubelet/pods/323a94b8-1721-49a3-b79c-a1ab62ceae0e/volumes"
Jul 28 17:18:45.769624 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.769514    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64446b66cb-mc49d" event={"ID":"f73e1f52-2e96-44f5-ba28-746845519c60","Type":"ContainerStarted","Data":"15152c21f5612589cff058fa8e7f605e657341e8f76cd80087bcb80e97f56065"}
Jul 28 17:18:45.772981 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.772951    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gct9w" event={"ID":"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5","Type":"ContainerStarted","Data":"f9da5a05e2a3dee6f90f8a8d7f40c2cb8ccb2023660fb4f0e1d05a99fa17d2c6"}
Jul 28 17:18:45.776730 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.776701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc2a7663-7e5f-4136-a655-4d1a79ea1398","Type":"ContainerStarted","Data":"21111fc9a1a24076ba5b7c37966117fd86edf651e47d46e9695593feb52fd618"}
Jul 28 17:18:45.776863 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.776776    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc2a7663-7e5f-4136-a655-4d1a79ea1398","Type":"ContainerStarted","Data":"b756d8b593a2f6cea29748eaaac544cedea02538b638815ff4482be2789547c1"}
Jul 28 17:18:45.776863 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.776819    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc2a7663-7e5f-4136-a655-4d1a79ea1398","Type":"ContainerStarted","Data":"630903cd311d999931177c8c6412a3d06587807f7aa34b0273c8b826730488ab"}
Jul 28 17:18:45.776863 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.776861    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc2a7663-7e5f-4136-a655-4d1a79ea1398","Type":"ContainerStarted","Data":"fdd6fa42377b49e1c31e1192aa86c4f9f7f61e8fef211912ff055f03b2805452"}
Jul 28 17:18:45.777131 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.776899    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc2a7663-7e5f-4136-a655-4d1a79ea1398","Type":"ContainerStarted","Data":"1816e580aa6bd903721e74d8db27e0349ca6a5eacb6d644bd1e189c948832371"}
Jul 28 17:18:45.778502 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.778473    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt" event={"ID":"86551e1c-409e-42ae-ae0a-d05d35e53a97","Type":"ContainerStarted","Data":"035368ddba406755c6a2de4521fbbc1f78e3ab4e3bb61da8f8456fec9ef4e713"}
Jul 28 17:18:45.778779 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.778762    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:45.782401 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.782372    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659476b564-njfhd" event={"ID":"9af703db-9f4b-4fe6-bc94-608b83010035","Type":"ContainerStarted","Data":"c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399"}
Jul 28 17:18:45.786900 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.786877    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt"
Jul 28 17:18:45.790922 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.790870    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64446b66cb-mc49d" podStartSLOduration=2.088954387 podStartE2EDuration="9.790850976s" totalImagesPullingTime="7.701896589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:45.790022214 +0000 UTC m=+113.217801465" watchObservedRunningTime="2026-07-28 17:18:45.790850976 +0000 UTC m=+113.218630213"
Jul 28 17:18:45.791765 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.791734    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qjjlj" event={"ID":"570a24e6-69f5-4f45-a9ec-eee669919228","Type":"ContainerStarted","Data":"905d14c6c094844a1979dfd24ff327eabadeacd5446d14b35d16c4baaab5645e"}
Jul 28 17:18:45.791875 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.791795    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qjjlj" event={"ID":"570a24e6-69f5-4f45-a9ec-eee669919228","Type":"ContainerStarted","Data":"679ddc02dc547b1a455bf4bddfe8bc4028423a83c203c1d3cd9d246d08e4a64d"}
Jul 28 17:18:45.797674 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.797616    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl" event={"ID":"55fd9971-3831-4962-80bf-f2a668791e70","Type":"ContainerStarted","Data":"60c9d3c4ff24148543fb94c239dafa012d17dd6224a0657e6d99abb71569eaba"}
Jul 28 17:18:45.798239 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.798203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl" event={"ID":"55fd9971-3831-4962-80bf-f2a668791e70","Type":"ContainerStarted","Data":"9fc57d053db9fd6a2d9beca3faf9d1e749c2d910585791652e4db781691b246f"}
Jul 28 17:18:45.798354 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.798259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl" event={"ID":"55fd9971-3831-4962-80bf-f2a668791e70","Type":"ContainerStarted","Data":"a44b1faa004d07715af489b8c785a86bbc44fd9476483f1dc89ee002b5a1930d"}
Jul 28 17:18:45.808277 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.808224    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-llwkt" podStartSLOduration=2.164180086 podStartE2EDuration="9.808209471s" totalImagesPullingTime="7.644029385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:45.808154537 +0000 UTC m=+113.235933775" watchObservedRunningTime="2026-07-28 17:18:45.808209471 +0000 UTC m=+113.235988709"
Jul 28 17:18:45.829225 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.829122    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-659476b564-njfhd" podStartSLOduration=8.780618075 podStartE2EDuration="18.829100315s" totalImagesPullingTime="10.04848224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:45.828016858 +0000 UTC m=+113.255796098" watchObservedRunningTime="2026-07-28 17:18:45.829100315 +0000 UTC m=+113.256879555"
Jul 28 17:18:45.851355 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:45.851274    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qjjlj" podStartSLOduration=11.56508264 podStartE2EDuration="14.851256619s" totalImagesPullingTime="3.155702562s" totalInitContainerRuntime="130.471417ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:45.849986434 +0000 UTC m=+113.277765674" watchObservedRunningTime="2026-07-28 17:18:45.851256619 +0000 UTC m=+113.279035856"
Jul 28 17:18:46.805795 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:46.805758    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl" event={"ID":"55fd9971-3831-4962-80bf-f2a668791e70","Type":"ContainerStarted","Data":"46ec93d95774f7aaea8e8f782bf493b075648543fec1df5a6a26eafc3e481c9f"}
Jul 28 17:18:46.810334 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:46.810251    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fc2a7663-7e5f-4136-a655-4d1a79ea1398","Type":"ContainerStarted","Data":"7309a0b5a240f16fbe0153009d4508a1ddb540285a42a054f6248a0b5bff5f9e"}
Jul 28 17:18:46.845080 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:46.845015    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.58080341 podStartE2EDuration="14.844994032s" totalImagesPullingTime="11.251657304s" totalInitContainerRuntime="12.533318ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:46.842839923 +0000 UTC m=+114.270619160" watchObservedRunningTime="2026-07-28 17:18:46.844994032 +0000 UTC m=+114.272773272"
Jul 28 17:18:47.126234 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:47.126036    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:47.228050 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:47.228003    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:47.315395 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:47.315360    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:47.630842 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:47.630804    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:18:47.818988 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:47.818951    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl" event={"ID":"55fd9971-3831-4962-80bf-f2a668791e70","Type":"ContainerStarted","Data":"1ae4ff20b28a4534c29083bf2f115371f3983f4ce5b0125a4e03c6a30b3e6dd5"}
Jul 28 17:18:47.819468 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:47.819039    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl" event={"ID":"55fd9971-3831-4962-80bf-f2a668791e70","Type":"ContainerStarted","Data":"f21f452d8d7d1f40b95d1da9b6f76bf6266a7b1500b80c85b5e1d0a7ecfdd601"}
Jul 28 17:18:47.819530 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:47.819517    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:47.845830 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:47.845771    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl" podStartSLOduration=3.509693066 podStartE2EDuration="13.84575654s" totalImagesPullingTime="10.336063474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:18:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:47.843671283 +0000 UTC m=+115.271450543" watchObservedRunningTime="2026-07-28 17:18:47.84575654 +0000 UTC m=+115.273535778"
Jul 28 17:18:49.828518 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:49.828432    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gct9w" event={"ID":"cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5","Type":"ContainerStarted","Data":"7043dc0af5cd870f9ea4a4a115d3a84f3d61fa83b055cb05269d2a0c0b837110"}
Jul 28 17:18:49.853504 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:49.853453    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gct9w" podStartSLOduration=32.842706923 podStartE2EDuration="1m0.853427496s" totalImagesPullingTime="28.010720573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:17:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:18:49.851125153 +0000 UTC m=+117.278904392" watchObservedRunningTime="2026-07-28 17:18:49.853427496 +0000 UTC m=+117.281206735"
Jul 28 17:18:49.997558 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:49.997520    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:50.097433 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:50.097327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:51.282373 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:51.282335    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:51.362298 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:51.362265    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:52.048296 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:52.048253    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:53.829794 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:53.829763    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75fc5bc9cc-clmpl"
Jul 28 17:18:56.101446 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:56.101415    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:56.176331 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:56.176299    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:56.571836 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:56.571800    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:56.572014 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:56.571863    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:18:57.915200 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:57.915166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:58.016681 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:58.016636    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:58.086753 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:18:58.086716    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:03.039371 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:03.039330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:19:03.041768 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:03.041739    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93a8f35e-919b-4c2b-ab51-54cce84896bf-metrics-certs\") pod \"network-metrics-daemon-77rmg\" (UID: \"93a8f35e-919b-4c2b-ab51-54cce84896bf\") " pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:19:03.060541 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:03.060510    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2k2q\""
Jul 28 17:19:03.068103 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:03.068063    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-77rmg"
Jul 28 17:19:03.225444 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:03.225419    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-77rmg"]
Jul 28 17:19:03.227320 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:19:03.227291    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a8f35e_919b_4c2b_ab51_54cce84896bf.slice/crio-655e36d279e5140203cd427d7a364d55132120b4f449556eb49b2504623f6119 WatchSource:0}: Error finding container 655e36d279e5140203cd427d7a364d55132120b4f449556eb49b2504623f6119: Status 404 returned error can't find the container with id 655e36d279e5140203cd427d7a364d55132120b4f449556eb49b2504623f6119
Jul 28 17:19:03.883306 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:03.883266    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77rmg" event={"ID":"93a8f35e-919b-4c2b-ab51-54cce84896bf","Type":"ContainerStarted","Data":"655e36d279e5140203cd427d7a364d55132120b4f449556eb49b2504623f6119"}
Jul 28 17:19:04.888594 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:04.888563    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77rmg" event={"ID":"93a8f35e-919b-4c2b-ab51-54cce84896bf","Type":"ContainerStarted","Data":"cfe7eadbc0dc3775fe08f6a7474d07ef9d5b2ffaff449fd584cdcb9467d8355e"}
Jul 28 17:19:05.894189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:05.894151    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-77rmg" event={"ID":"93a8f35e-919b-4c2b-ab51-54cce84896bf","Type":"ContainerStarted","Data":"461c859b4ebf4aac4d8f44b0a42128660a8858f934af86ec8334ae5cd9fa78af"}
Jul 28 17:19:05.918688 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:05.918639    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-77rmg" podStartSLOduration=131.544637138 podStartE2EDuration="2m12.918622902s" totalImagesPullingTime="1.373985764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:19:05.917842619 +0000 UTC m=+133.345621862" watchObservedRunningTime="2026-07-28 17:19:05.918622902 +0000 UTC m=+133.346402139"
Jul 28 17:19:06.023270 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:06.023237    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:06.153490 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:06.153397    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:06.210564 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:06.210522    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:06.396894 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:06.396859    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:06.494985 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:06.494905    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:10.807995 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:10.807957    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-659476b564-njfhd" podUID="9af703db-9f4b-4fe6-bc94-608b83010035" containerName="console" containerID="cri-o://c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399" gracePeriod=15
Jul 28 17:19:11.108941 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.108488    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:19:11.203533 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.203492    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-trusted-ca-bundle\") pod \"9af703db-9f4b-4fe6-bc94-608b83010035\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") "
Jul 28 17:19:11.203723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.203572    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-oauth-config\") pod \"9af703db-9f4b-4fe6-bc94-608b83010035\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") "
Jul 28 17:19:11.203723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.203610    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-service-ca\") pod \"9af703db-9f4b-4fe6-bc94-608b83010035\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") "
Jul 28 17:19:11.203723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.203634    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-serving-cert\") pod \"9af703db-9f4b-4fe6-bc94-608b83010035\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") "
Jul 28 17:19:11.203723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.203664    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wwcq\" (UniqueName: \"kubernetes.io/projected/9af703db-9f4b-4fe6-bc94-608b83010035-kube-api-access-4wwcq\") pod \"9af703db-9f4b-4fe6-bc94-608b83010035\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") "
Jul 28 17:19:11.203723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.203685    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-oauth-serving-cert\") pod \"9af703db-9f4b-4fe6-bc94-608b83010035\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") "
Jul 28 17:19:11.203723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.203701    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-console-config\") pod \"9af703db-9f4b-4fe6-bc94-608b83010035\" (UID: \"9af703db-9f4b-4fe6-bc94-608b83010035\") "
Jul 28 17:19:11.204029 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.203911    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9af703db-9f4b-4fe6-bc94-608b83010035" (UID: "9af703db-9f4b-4fe6-bc94-608b83010035"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:19:11.204675 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.204634    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9af703db-9f4b-4fe6-bc94-608b83010035" (UID: "9af703db-9f4b-4fe6-bc94-608b83010035"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:19:11.204829 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.204689    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-service-ca" (OuterVolumeSpecName: "service-ca") pod "9af703db-9f4b-4fe6-bc94-608b83010035" (UID: "9af703db-9f4b-4fe6-bc94-608b83010035"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:19:11.205202 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.204902    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-console-config" (OuterVolumeSpecName: "console-config") pod "9af703db-9f4b-4fe6-bc94-608b83010035" (UID: "9af703db-9f4b-4fe6-bc94-608b83010035"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:19:11.207537 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.207504    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9af703db-9f4b-4fe6-bc94-608b83010035" (UID: "9af703db-9f4b-4fe6-bc94-608b83010035"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:19:11.211311 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.211280    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9af703db-9f4b-4fe6-bc94-608b83010035" (UID: "9af703db-9f4b-4fe6-bc94-608b83010035"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:19:11.211404 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.211325    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af703db-9f4b-4fe6-bc94-608b83010035-kube-api-access-4wwcq" (OuterVolumeSpecName: "kube-api-access-4wwcq") pod "9af703db-9f4b-4fe6-bc94-608b83010035" (UID: "9af703db-9f4b-4fe6-bc94-608b83010035"). InnerVolumeSpecName "kube-api-access-4wwcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:19:11.304918 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.304884    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-service-ca\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:19:11.304918 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.304916    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-serving-cert\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:19:11.304918 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.304926    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wwcq\" (UniqueName: \"kubernetes.io/projected/9af703db-9f4b-4fe6-bc94-608b83010035-kube-api-access-4wwcq\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:19:11.305156 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.304936    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-oauth-serving-cert\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:19:11.305156 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.304945    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-console-config\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:19:11.305156 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.304953    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9af703db-9f4b-4fe6-bc94-608b83010035-trusted-ca-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:19:11.305156 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.304961    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9af703db-9f4b-4fe6-bc94-608b83010035-console-oauth-config\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:19:11.922810 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.922763    2574 generic.go:356] "Generic (PLEG): container finished" podID="9af703db-9f4b-4fe6-bc94-608b83010035" containerID="c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399" exitCode=0
Jul 28 17:19:11.923217 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.922819    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659476b564-njfhd"
Jul 28 17:19:11.923217 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.922821    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659476b564-njfhd" event={"ID":"9af703db-9f4b-4fe6-bc94-608b83010035","Type":"ContainerDied","Data":"c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399"}
Jul 28 17:19:11.923217 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.922904    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659476b564-njfhd" event={"ID":"9af703db-9f4b-4fe6-bc94-608b83010035","Type":"ContainerDied","Data":"796ea9cd1fed6fb99be4f4ff019070d2f68e53afde76295da16368be5bd528d9"}
Jul 28 17:19:11.923217 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.922925    2574 scope.go:117] "RemoveContainer" containerID="c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399"
Jul 28 17:19:11.933137 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.933113    2574 scope.go:117] "RemoveContainer" containerID="c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399"
Jul 28 17:19:11.933452 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:19:11.933429    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399\": container with ID starting with c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399 not found: ID does not exist" containerID="c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399"
Jul 28 17:19:11.933522 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.933461    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399"} err="failed to get container status \"c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399\": rpc error: code = NotFound desc = could not find container \"c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399\": container with ID starting with c468eb1ca23c1dc24deb66ae767821b61ed24dc3dcc0baece0ede3a70410c399 not found: ID does not exist"
Jul 28 17:19:11.946982 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.946938    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-659476b564-njfhd"]
Jul 28 17:19:11.951312 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:11.951279    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-659476b564-njfhd"]
Jul 28 17:19:13.146363 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:13.146330    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9af703db-9f4b-4fe6-bc94-608b83010035" path="/var/lib/kubelet/pods/9af703db-9f4b-4fe6-bc94-608b83010035/volumes"
Jul 28 17:19:16.576772 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:16.576737    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:19:16.581584 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:16.581557    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64446b66cb-mc49d"
Jul 28 17:19:21.312763 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:21.312723    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:21.388696 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:21.388659    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:24.865151 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:24.865117    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:50.988342 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:50.988250    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:51.299446 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:51.299410    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:56.126135 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.126098    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f6697f644-mbplm"]
Jul 28 17:19:56.126524 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.126440    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323a94b8-1721-49a3-b79c-a1ab62ceae0e" containerName="registry"
Jul 28 17:19:56.126524 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.126454    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="323a94b8-1721-49a3-b79c-a1ab62ceae0e" containerName="registry"
Jul 28 17:19:56.126524 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.126469    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af703db-9f4b-4fe6-bc94-608b83010035" containerName="console"
Jul 28 17:19:56.126524 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.126474    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af703db-9f4b-4fe6-bc94-608b83010035" containerName="console"
Jul 28 17:19:56.126524 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.126523    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af703db-9f4b-4fe6-bc94-608b83010035" containerName="console"
Jul 28 17:19:56.126678 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.126538    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="323a94b8-1721-49a3-b79c-a1ab62ceae0e" containerName="registry"
Jul 28 17:19:56.129412 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.129395    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.133189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.133157    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rlpj5\""
Jul 28 17:19:56.133189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.133170    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 17:19:56.133189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.133180    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 17:19:56.133397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.133250    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 17:19:56.133397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.133276    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 17:19:56.133397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.133297    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 17:19:56.141112 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.141088    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 17:19:56.142290 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.142270    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f6697f644-mbplm"]
Jul 28 17:19:56.282936 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.282889    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/785f75a4-01fb-404d-8225-797865e0fe45-serving-certs-ca-bundle\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.283179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.282967    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/785f75a4-01fb-404d-8225-797865e0fe45-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.283179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.283023    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-telemeter-client-tls\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.283179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.283127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-secret-telemeter-client\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.283179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.283162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.283406 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.283205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785f75a4-01fb-404d-8225-797865e0fe45-metrics-client-ca\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.283406 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.283256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7zqz\" (UniqueName: \"kubernetes.io/projected/785f75a4-01fb-404d-8225-797865e0fe45-kube-api-access-s7zqz\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.283545 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.283522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-federate-client-tls\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.384221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.384134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-telemeter-client-tls\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.384221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.384179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-secret-telemeter-client\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.384221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.384205    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.384486 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.384235    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785f75a4-01fb-404d-8225-797865e0fe45-metrics-client-ca\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.384486 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.384264    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zqz\" (UniqueName: \"kubernetes.io/projected/785f75a4-01fb-404d-8225-797865e0fe45-kube-api-access-s7zqz\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.384486 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.384314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-federate-client-tls\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.384486 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.384386    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/785f75a4-01fb-404d-8225-797865e0fe45-serving-certs-ca-bundle\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.384486 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.384415    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/785f75a4-01fb-404d-8225-797865e0fe45-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.385132 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.385103    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/785f75a4-01fb-404d-8225-797865e0fe45-metrics-client-ca\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.385246 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.385169    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/785f75a4-01fb-404d-8225-797865e0fe45-serving-certs-ca-bundle\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.385340 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.385316    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/785f75a4-01fb-404d-8225-797865e0fe45-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.386954 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.386924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.387050 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.386998    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-secret-telemeter-client\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.387293 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.387272    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-federate-client-tls\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.387331 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.387272    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/785f75a4-01fb-404d-8225-797865e0fe45-telemeter-client-tls\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.394590 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.394569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7zqz\" (UniqueName: \"kubernetes.io/projected/785f75a4-01fb-404d-8225-797865e0fe45-kube-api-access-s7zqz\") pod \"telemeter-client-6f6697f644-mbplm\" (UID: \"785f75a4-01fb-404d-8225-797865e0fe45\") " pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.439231 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.439196    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm"
Jul 28 17:19:56.570426 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:56.570374    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f6697f644-mbplm"]
Jul 28 17:19:56.572932 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:19:56.572900    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785f75a4_01fb_404d_8225_797865e0fe45.slice/crio-1961a098afc7aad2445a4717be08608160570e537798e6989ad2715e1384a47e WatchSource:0}: Error finding container 1961a098afc7aad2445a4717be08608160570e537798e6989ad2715e1384a47e: Status 404 returned error can't find the container with id 1961a098afc7aad2445a4717be08608160570e537798e6989ad2715e1384a47e
Jul 28 17:19:57.094195 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:57.094156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm" event={"ID":"785f75a4-01fb-404d-8225-797865e0fe45","Type":"ContainerStarted","Data":"1961a098afc7aad2445a4717be08608160570e537798e6989ad2715e1384a47e"}
Jul 28 17:19:59.103375 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.103335    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm" event={"ID":"785f75a4-01fb-404d-8225-797865e0fe45","Type":"ContainerStarted","Data":"e43b3f862137596593b42aec7f79f92876879f3a25d7846d5a42f5052a99f96d"}
Jul 28 17:19:59.103799 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.103441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm" event={"ID":"785f75a4-01fb-404d-8225-797865e0fe45","Type":"ContainerStarted","Data":"a7352e65c5b98b0ae9ff155c87c45f67ccd41bf9039299bb13ae7fffc2bed7d8"}
Jul 28 17:19:59.103799 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.103474    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm" event={"ID":"785f75a4-01fb-404d-8225-797865e0fe45","Type":"ContainerStarted","Data":"249e5b53655d5810f591f6f3ca3c934c98a6924beb44c4ea0ef21f62d6daa3c1"}
Jul 28 17:19:59.135186 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.135004    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f6697f644-mbplm" podStartSLOduration=1.069952519 podStartE2EDuration="3.134985559s" totalImagesPullingTime="2.06503304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:19:59.134249983 +0000 UTC m=+186.562029220" watchObservedRunningTime="2026-07-28 17:19:59.134985559 +0000 UTC m=+186.562764842"
Jul 28 17:19:59.872665 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.872631    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fd6df6bc7-npt89"]
Jul 28 17:19:59.875035 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.875018    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:19:59.877823 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.877799    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xc6lg\""
Jul 28 17:19:59.877956 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.877847    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 17:19:59.879129 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.879103    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 17:19:59.879129 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.879132    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 17:19:59.879276 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.879143    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 17:19:59.879276 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.879160    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 17:19:59.883827 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.883807    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 17:19:59.884993 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.884970    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd6df6bc7-npt89"]
Jul 28 17:19:59.930214 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:19:59.930179    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:00.016702 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.016667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-trusted-ca-bundle\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.016901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.016718    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-oauth-serving-cert\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.016901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.016739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s7l6\" (UniqueName: \"kubernetes.io/projected/c45e787d-5730-4c71-9ffa-e621ebcbd92a-kube-api-access-6s7l6\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.016901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.016794    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-oauth-config\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.016901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.016832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-config\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.016901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.016870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-serving-cert\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.017131 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.016906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-service-ca\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.117884 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.117847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-oauth-config\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.117884 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.117885    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-config\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.118402 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.117907    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-serving-cert\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.118402 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.117923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-service-ca\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.118402 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.118036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-trusted-ca-bundle\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.118402 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.118134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-oauth-serving-cert\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.118402 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.118161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s7l6\" (UniqueName: \"kubernetes.io/projected/c45e787d-5730-4c71-9ffa-e621ebcbd92a-kube-api-access-6s7l6\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.118773 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.118750    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-config\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.118773 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.118766    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-service-ca\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.118923 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.118909    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-trusted-ca-bundle\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.118993 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.118968    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-oauth-serving-cert\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.120579 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.120551    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-serving-cert\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.120678 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.120555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-oauth-config\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.126876 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.126816    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s7l6\" (UniqueName: \"kubernetes.io/projected/c45e787d-5730-4c71-9ffa-e621ebcbd92a-kube-api-access-6s7l6\") pod \"console-7fd6df6bc7-npt89\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") " pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.184707 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.184667    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:00.317204 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:00.317177    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd6df6bc7-npt89"]
Jul 28 17:20:00.319403 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:20:00.319377    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45e787d_5730_4c71_9ffa_e621ebcbd92a.slice/crio-54de0efdd0e802da46301686bc9c0635f1c77911132d9b540de7873437c81018 WatchSource:0}: Error finding container 54de0efdd0e802da46301686bc9c0635f1c77911132d9b540de7873437c81018: Status 404 returned error can't find the container with id 54de0efdd0e802da46301686bc9c0635f1c77911132d9b540de7873437c81018
Jul 28 17:20:01.112220 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:01.112185    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd6df6bc7-npt89" event={"ID":"c45e787d-5730-4c71-9ffa-e621ebcbd92a","Type":"ContainerStarted","Data":"c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c"}
Jul 28 17:20:01.112369 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:01.112235    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd6df6bc7-npt89" event={"ID":"c45e787d-5730-4c71-9ffa-e621ebcbd92a","Type":"ContainerStarted","Data":"54de0efdd0e802da46301686bc9c0635f1c77911132d9b540de7873437c81018"}
Jul 28 17:20:01.130014 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:01.129966    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fd6df6bc7-npt89" podStartSLOduration=2.129948248 podStartE2EDuration="2.129948248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:20:01.12840754 +0000 UTC m=+188.556186779" watchObservedRunningTime="2026-07-28 17:20:01.129948248 +0000 UTC m=+188.557727485"
Jul 28 17:20:06.255285 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:06.255247    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:06.353893 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:06.353860    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:08.774941 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.774898    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd6df6bc7-npt89"]
Jul 28 17:20:08.804205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.804176    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c4fcd685f-jqqvm"]
Jul 28 17:20:08.806653 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.806636    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.817219 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.817194    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4fcd685f-jqqvm"]
Jul 28 17:20:08.881218 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.881181    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-console-config\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.881218 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.881222    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-service-ca\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.881429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.881245    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-oauth-serving-cert\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.881429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.881299    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9pwm\" (UniqueName: \"kubernetes.io/projected/71095130-c734-4194-acb6-12d764fd6b28-kube-api-access-m9pwm\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.881429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.881324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-oauth-config\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.881429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.881356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-trusted-ca-bundle\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.881429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.881375    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-serving-cert\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.982685 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.982656    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-console-config\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.982801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.982692    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-service-ca\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.982801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.982708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-oauth-serving-cert\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.982801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.982739    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9pwm\" (UniqueName: \"kubernetes.io/projected/71095130-c734-4194-acb6-12d764fd6b28-kube-api-access-m9pwm\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.982801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.982766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-oauth-config\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.982801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.982796    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-trusted-ca-bundle\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.983025 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.982826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-serving-cert\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.983579 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.983550    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-service-ca\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.983704 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.983559    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-console-config\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.983704 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.983631    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-oauth-serving-cert\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.983823 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.983754    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-trusted-ca-bundle\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.985322 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.985292    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-oauth-config\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.985407 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.985375    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-serving-cert\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:08.991853 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:08.991829    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9pwm\" (UniqueName: \"kubernetes.io/projected/71095130-c734-4194-acb6-12d764fd6b28-kube-api-access-m9pwm\") pod \"console-5c4fcd685f-jqqvm\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") " pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:09.115747 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:09.115657    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:09.246640 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:09.246615    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4fcd685f-jqqvm"]
Jul 28 17:20:09.249358 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:20:09.249324    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71095130_c734_4194_acb6_12d764fd6b28.slice/crio-9ddafa77f9cfebfcbb6a2d03610132087f422dab2a3ce2b191ceff4ac35e6030 WatchSource:0}: Error finding container 9ddafa77f9cfebfcbb6a2d03610132087f422dab2a3ce2b191ceff4ac35e6030: Status 404 returned error can't find the container with id 9ddafa77f9cfebfcbb6a2d03610132087f422dab2a3ce2b191ceff4ac35e6030
Jul 28 17:20:10.149447 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:10.149417    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4fcd685f-jqqvm" event={"ID":"71095130-c734-4194-acb6-12d764fd6b28","Type":"ContainerStarted","Data":"b12d28707088d839d37318964cbd331e10c7da224ff58df431aded7c3f14a24a"}
Jul 28 17:20:10.149933 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:10.149460    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4fcd685f-jqqvm" event={"ID":"71095130-c734-4194-acb6-12d764fd6b28","Type":"ContainerStarted","Data":"9ddafa77f9cfebfcbb6a2d03610132087f422dab2a3ce2b191ceff4ac35e6030"}
Jul 28 17:20:10.168601 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:10.168556    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c4fcd685f-jqqvm" podStartSLOduration=2.168540276 podStartE2EDuration="2.168540276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:20:10.16775117 +0000 UTC m=+197.595530410" watchObservedRunningTime="2026-07-28 17:20:10.168540276 +0000 UTC m=+197.596319565"
Jul 28 17:20:10.185231 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:10.185189    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:18.190223 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:18.190184    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:18.259374 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:18.259339    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:19.115882 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:19.115850    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:19.116063 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:19.115956    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:19.120829 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:19.120808    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:19.189184 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:19.189156    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:20:19.360721 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:19.360684    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:19.461274 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:19.461176    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:19.537815 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:19.537773    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:21.277998 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:21.277961    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:21.378681 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:21.378649    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:29.709757 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:29.709723    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:29.791001 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:29.790967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:32.216965 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:32.216931    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:32.286308 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:32.286276    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:20:33.793507 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:33.793463    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fd6df6bc7-npt89" podUID="c45e787d-5730-4c71-9ffa-e621ebcbd92a" containerName="console" containerID="cri-o://c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c" gracePeriod=15
Jul 28 17:20:34.050582 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.050524    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:34.207863 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.207827    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s7l6\" (UniqueName: \"kubernetes.io/projected/c45e787d-5730-4c71-9ffa-e621ebcbd92a-kube-api-access-6s7l6\") pod \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") "
Jul 28 17:20:34.208036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.207874    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-oauth-config\") pod \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") "
Jul 28 17:20:34.208036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.207901    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-trusted-ca-bundle\") pod \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") "
Jul 28 17:20:34.208036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.207972    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-config\") pod \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") "
Jul 28 17:20:34.208036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.207997    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-serving-cert\") pod \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") "
Jul 28 17:20:34.208036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208030    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-service-ca\") pod \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") "
Jul 28 17:20:34.208311 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208057    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-oauth-serving-cert\") pod \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\" (UID: \"c45e787d-5730-4c71-9ffa-e621ebcbd92a\") "
Jul 28 17:20:34.208497 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208467    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-config" (OuterVolumeSpecName: "console-config") pod "c45e787d-5730-4c71-9ffa-e621ebcbd92a" (UID: "c45e787d-5730-4c71-9ffa-e621ebcbd92a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:20:34.208497 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208392    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c45e787d-5730-4c71-9ffa-e621ebcbd92a" (UID: "c45e787d-5730-4c71-9ffa-e621ebcbd92a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:20:34.208640 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208525    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-service-ca" (OuterVolumeSpecName: "service-ca") pod "c45e787d-5730-4c71-9ffa-e621ebcbd92a" (UID: "c45e787d-5730-4c71-9ffa-e621ebcbd92a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:20:34.208640 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208540    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c45e787d-5730-4c71-9ffa-e621ebcbd92a" (UID: "c45e787d-5730-4c71-9ffa-e621ebcbd92a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:20:34.209056 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208868    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-trusted-ca-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:20:34.209056 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208892    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-config\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:20:34.209056 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208907    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-service-ca\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:20:34.209056 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.208920    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c45e787d-5730-4c71-9ffa-e621ebcbd92a-oauth-serving-cert\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:20:34.210119 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.210099    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c45e787d-5730-4c71-9ffa-e621ebcbd92a" (UID: "c45e787d-5730-4c71-9ffa-e621ebcbd92a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:20:34.210195 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.210132    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c45e787d-5730-4c71-9ffa-e621ebcbd92a" (UID: "c45e787d-5730-4c71-9ffa-e621ebcbd92a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:20:34.210237 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.210200    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45e787d-5730-4c71-9ffa-e621ebcbd92a-kube-api-access-6s7l6" (OuterVolumeSpecName: "kube-api-access-6s7l6") pod "c45e787d-5730-4c71-9ffa-e621ebcbd92a" (UID: "c45e787d-5730-4c71-9ffa-e621ebcbd92a"). InnerVolumeSpecName "kube-api-access-6s7l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:20:34.244847 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.244815    2574 generic.go:356] "Generic (PLEG): container finished" podID="c45e787d-5730-4c71-9ffa-e621ebcbd92a" containerID="c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c" exitCode=0
Jul 28 17:20:34.245006 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.244861    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd6df6bc7-npt89"
Jul 28 17:20:34.245006 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.244890    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd6df6bc7-npt89" event={"ID":"c45e787d-5730-4c71-9ffa-e621ebcbd92a","Type":"ContainerDied","Data":"c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c"}
Jul 28 17:20:34.245006 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.244929    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd6df6bc7-npt89" event={"ID":"c45e787d-5730-4c71-9ffa-e621ebcbd92a","Type":"ContainerDied","Data":"54de0efdd0e802da46301686bc9c0635f1c77911132d9b540de7873437c81018"}
Jul 28 17:20:34.245006 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.244948    2574 scope.go:117] "RemoveContainer" containerID="c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c"
Jul 28 17:20:34.254150 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.254126    2574 scope.go:117] "RemoveContainer" containerID="c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c"
Jul 28 17:20:34.254439 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:20:34.254413    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c\": container with ID starting with c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c not found: ID does not exist" containerID="c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c"
Jul 28 17:20:34.254488 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.254449    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c"} err="failed to get container status \"c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c\": rpc error: code = NotFound desc = could not find container \"c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c\": container with ID starting with c936f442e38263c76b89df445e56587abb3293cbd21bf541ac4d3acae6fa8d0c not found: ID does not exist"
Jul 28 17:20:34.271099 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.270948    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd6df6bc7-npt89"]
Jul 28 17:20:34.275111 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.275079    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fd6df6bc7-npt89"]
Jul 28 17:20:34.310282 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.310203    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-oauth-config\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:20:34.310282 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.310230    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c45e787d-5730-4c71-9ffa-e621ebcbd92a-console-serving-cert\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:20:34.310282 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:34.310242    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s7l6\" (UniqueName: \"kubernetes.io/projected/c45e787d-5730-4c71-9ffa-e621ebcbd92a-kube-api-access-6s7l6\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:20:35.145863 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:20:35.145830    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45e787d-5730-4c71-9ffa-e621ebcbd92a" path="/var/lib/kubelet/pods/c45e787d-5730-4c71-9ffa-e621ebcbd92a/volumes"
Jul 28 17:21:07.078010 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:07.077976    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:07.161825 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:07.161782    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:13.909025 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:13.908990    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:14.037830 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:14.037798    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:14.286083 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:14.286046    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:14.385284 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:14.385246    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:14.485567 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:14.485533    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:15.317106 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.317056    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"]
Jul 28 17:21:15.317477 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.317424    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45e787d-5730-4c71-9ffa-e621ebcbd92a" containerName="console"
Jul 28 17:21:15.317477 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.317436    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45e787d-5730-4c71-9ffa-e621ebcbd92a" containerName="console"
Jul 28 17:21:15.317545 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.317505    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45e787d-5730-4c71-9ffa-e621ebcbd92a" containerName="console"
Jul 28 17:21:15.320587 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.320571    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.323459 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.323435    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nbztt\""
Jul 28 17:21:15.323459 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.323449    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 17:21:15.324787 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.324766    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 17:21:15.330092 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.330045    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"]
Jul 28 17:21:15.361326 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.361291    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.361501 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.361337    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw8dx\" (UniqueName: \"kubernetes.io/projected/43941d8b-2aec-4e6c-917c-6c272f00dade-kube-api-access-tw8dx\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.361501 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.361357    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.462127 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.462063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw8dx\" (UniqueName: \"kubernetes.io/projected/43941d8b-2aec-4e6c-917c-6c272f00dade-kube-api-access-tw8dx\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.462333 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.462138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.462333 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.462245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.462525 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.462504    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.462590 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.462577    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.471565 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.471536    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw8dx\" (UniqueName: \"kubernetes.io/projected/43941d8b-2aec-4e6c-917c-6c272f00dade-kube-api-access-tw8dx\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.630257 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.630155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:15.760971 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:15.760914    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"]
Jul 28 17:21:15.763355 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:21:15.763320    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43941d8b_2aec_4e6c_917c_6c272f00dade.slice/crio-110933e742491361208614b40dbd3848e711ee7f177c52756fe2f46b609bcd37 WatchSource:0}: Error finding container 110933e742491361208614b40dbd3848e711ee7f177c52756fe2f46b609bcd37: Status 404 returned error can't find the container with id 110933e742491361208614b40dbd3848e711ee7f177c52756fe2f46b609bcd37
Jul 28 17:21:16.406947 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:16.406915    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2" event={"ID":"43941d8b-2aec-4e6c-917c-6c272f00dade","Type":"ContainerStarted","Data":"110933e742491361208614b40dbd3848e711ee7f177c52756fe2f46b609bcd37"}
Jul 28 17:21:21.432871 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:21.432791    2574 generic.go:356] "Generic (PLEG): container finished" podID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerID="8ee7b8950e62bfe780949f664406c43286861ed7f424ee6c829ae9959debe152" exitCode=0
Jul 28 17:21:21.433275 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:21.432877    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2" event={"ID":"43941d8b-2aec-4e6c-917c-6c272f00dade","Type":"ContainerDied","Data":"8ee7b8950e62bfe780949f664406c43286861ed7f424ee6c829ae9959debe152"}
Jul 28 17:21:23.595093 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:23.594657    2574 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43941d8b_2aec_4e6c_917c_6c272f00dade.slice/crio-e518d22af5f2971dffcc7462d27fb1d28ec1ce1ff5c95315db770359e94ed156.scope\": RecentStats: unable to find data in memory cache]"
Jul 28 17:21:24.446857 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:24.446824    2574 generic.go:356] "Generic (PLEG): container finished" podID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerID="e518d22af5f2971dffcc7462d27fb1d28ec1ce1ff5c95315db770359e94ed156" exitCode=0
Jul 28 17:21:24.447026 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:24.446913    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2" event={"ID":"43941d8b-2aec-4e6c-917c-6c272f00dade","Type":"ContainerDied","Data":"e518d22af5f2971dffcc7462d27fb1d28ec1ce1ff5c95315db770359e94ed156"}
Jul 28 17:21:30.477634 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:30.477540    2574 generic.go:356] "Generic (PLEG): container finished" podID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerID="57aed2bc7d58b995856d58aabd7d54318247650b3baa6bff938ff4ac1a90967f" exitCode=0
Jul 28 17:21:30.477634 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:30.477596    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2" event={"ID":"43941d8b-2aec-4e6c-917c-6c272f00dade","Type":"ContainerDied","Data":"57aed2bc7d58b995856d58aabd7d54318247650b3baa6bff938ff4ac1a90967f"}
Jul 28 17:21:31.605269 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.605242    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:31.714380 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.714349    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-bundle\") pod \"43941d8b-2aec-4e6c-917c-6c272f00dade\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") "
Jul 28 17:21:31.714548 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.714438    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-util\") pod \"43941d8b-2aec-4e6c-917c-6c272f00dade\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") "
Jul 28 17:21:31.714548 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.714463    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw8dx\" (UniqueName: \"kubernetes.io/projected/43941d8b-2aec-4e6c-917c-6c272f00dade-kube-api-access-tw8dx\") pod \"43941d8b-2aec-4e6c-917c-6c272f00dade\" (UID: \"43941d8b-2aec-4e6c-917c-6c272f00dade\") "
Jul 28 17:21:31.715099 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.715053    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-bundle" (OuterVolumeSpecName: "bundle") pod "43941d8b-2aec-4e6c-917c-6c272f00dade" (UID: "43941d8b-2aec-4e6c-917c-6c272f00dade"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:21:31.716626 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.716601    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43941d8b-2aec-4e6c-917c-6c272f00dade-kube-api-access-tw8dx" (OuterVolumeSpecName: "kube-api-access-tw8dx") pod "43941d8b-2aec-4e6c-917c-6c272f00dade" (UID: "43941d8b-2aec-4e6c-917c-6c272f00dade"). InnerVolumeSpecName "kube-api-access-tw8dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:21:31.721741 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.721714    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-util" (OuterVolumeSpecName: "util") pod "43941d8b-2aec-4e6c-917c-6c272f00dade" (UID: "43941d8b-2aec-4e6c-917c-6c272f00dade"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:21:31.815264 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.815236    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-util\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:21:31.815264 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.815261    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw8dx\" (UniqueName: \"kubernetes.io/projected/43941d8b-2aec-4e6c-917c-6c272f00dade-kube-api-access-tw8dx\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:21:31.815456 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:31.815271    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43941d8b-2aec-4e6c-917c-6c272f00dade-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:21:32.487277 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:32.487250    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2"
Jul 28 17:21:32.487443 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:32.487251    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5sxlk2" event={"ID":"43941d8b-2aec-4e6c-917c-6c272f00dade","Type":"ContainerDied","Data":"110933e742491361208614b40dbd3848e711ee7f177c52756fe2f46b609bcd37"}
Jul 28 17:21:32.487443 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:32.487373    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="110933e742491361208614b40dbd3848e711ee7f177c52756fe2f46b609bcd37"
Jul 28 17:21:36.667958 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:36.667918    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:36.756451 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:36.756419    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:38.202684 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.202650    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"]
Jul 28 17:21:38.203048 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.202965    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerName="extract"
Jul 28 17:21:38.203048 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.202976    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerName="extract"
Jul 28 17:21:38.203048 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.202989    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerName="pull"
Jul 28 17:21:38.203048 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.202994    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerName="pull"
Jul 28 17:21:38.203048 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.203015    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerName="util"
Jul 28 17:21:38.203048 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.203020    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerName="util"
Jul 28 17:21:38.203244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.203080    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="43941d8b-2aec-4e6c-917c-6c272f00dade" containerName="extract"
Jul 28 17:21:38.233584 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.233554    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"]
Jul 28 17:21:38.233792 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.233660    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:21:38.236824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.236804    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 28 17:21:38.237231 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.237212    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 28 17:21:38.237326 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.237228    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 28 17:21:38.237326 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.237228    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-jbrcg\""
Jul 28 17:21:38.371440 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.371402    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hhnt\" (UniqueName: \"kubernetes.io/projected/d0b6db3e-1386-4060-9fcb-6ccfdbf827b0-kube-api-access-6hhnt\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh\" (UID: \"d0b6db3e-1386-4060-9fcb-6ccfdbf827b0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:21:38.371618 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.371494    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d0b6db3e-1386-4060-9fcb-6ccfdbf827b0-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh\" (UID: \"d0b6db3e-1386-4060-9fcb-6ccfdbf827b0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:21:38.472528 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.472428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hhnt\" (UniqueName: \"kubernetes.io/projected/d0b6db3e-1386-4060-9fcb-6ccfdbf827b0-kube-api-access-6hhnt\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh\" (UID: \"d0b6db3e-1386-4060-9fcb-6ccfdbf827b0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:21:38.472528 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.472521    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d0b6db3e-1386-4060-9fcb-6ccfdbf827b0-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh\" (UID: \"d0b6db3e-1386-4060-9fcb-6ccfdbf827b0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:21:38.475238 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.475213    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d0b6db3e-1386-4060-9fcb-6ccfdbf827b0-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh\" (UID: \"d0b6db3e-1386-4060-9fcb-6ccfdbf827b0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:21:38.481418 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.481396    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hhnt\" (UniqueName: \"kubernetes.io/projected/d0b6db3e-1386-4060-9fcb-6ccfdbf827b0-kube-api-access-6hhnt\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh\" (UID: \"d0b6db3e-1386-4060-9fcb-6ccfdbf827b0\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:21:38.543454 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.543415    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:21:38.701293 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:38.701268    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"]
Jul 28 17:21:38.702357 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:21:38.702334    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b6db3e_1386_4060_9fcb_6ccfdbf827b0.slice/crio-c355461574a7f4552d1c3acc79fde5297983b4db6839a79a3cf138c7f9d503df WatchSource:0}: Error finding container c355461574a7f4552d1c3acc79fde5297983b4db6839a79a3cf138c7f9d503df: Status 404 returned error can't find the container with id c355461574a7f4552d1c3acc79fde5297983b4db6839a79a3cf138c7f9d503df
Jul 28 17:21:39.516033 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:39.516003    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh" event={"ID":"d0b6db3e-1386-4060-9fcb-6ccfdbf827b0","Type":"ContainerStarted","Data":"c355461574a7f4552d1c3acc79fde5297983b4db6839a79a3cf138c7f9d503df"}
Jul 28 17:21:42.532740 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:42.532648    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh" event={"ID":"d0b6db3e-1386-4060-9fcb-6ccfdbf827b0","Type":"ContainerStarted","Data":"0acddc6a0e7c8bd7b07da11f88129a58e5ad7d44a95ac00018c425c95087ebb2"}
Jul 28 17:21:42.533134 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:42.532826    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:21:42.556789 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:42.556732    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh" podStartSLOduration=1.000971196 podStartE2EDuration="4.556714291s" totalImagesPullingTime="3.555743095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:21:42.555146508 +0000 UTC m=+289.982925746" watchObservedRunningTime="2026-07-28 17:21:42.556714291 +0000 UTC m=+289.984493528"
Jul 28 17:21:42.830995 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:42.830909    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:43.130381 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.130281    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-p4kwp"]
Jul 28 17:21:43.130800 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.130760    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:43.151872 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.151843    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.154728 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.154708    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-6lvgw\""
Jul 28 17:21:43.156137 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.156114    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 28 17:21:43.156422 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.156400    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 28 17:21:43.159551 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.159526    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-p4kwp"]
Jul 28 17:21:43.314292 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.314258    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-cabundle0\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.314469 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.314319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9b9b\" (UniqueName: \"kubernetes.io/projected/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-kube-api-access-k9b9b\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.314469 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.314399    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-certificates\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.331192 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.331159    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"]
Jul 28 17:21:43.334275 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.334244    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:43.350846 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.349571    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"]
Jul 28 17:21:43.350846 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.349695    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:43.352899 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.352877    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 28 17:21:43.415096 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.415002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9b9b\" (UniqueName: \"kubernetes.io/projected/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-kube-api-access-k9b9b\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.415096 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.415039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-certificates\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.415291 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.415105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-cabundle0\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.415291 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:43.415211    2574 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 28 17:21:43.415291 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:43.415235    2574 secret.go:281] references non-existent secret key: ca.crt
Jul 28 17:21:43.415291 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:43.415246    2574 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 28 17:21:43.415291 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:43.415262    2574 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-p4kwp: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 28 17:21:43.415499 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:43.415323    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-certificates podName:90dbddf8-969c-49c5-b3a7-b06709ab9e6d nodeName:}" failed. No retries permitted until 2026-07-28 17:21:43.915305172 +0000 UTC m=+291.343084393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-certificates") pod "keda-operator-77f648d694-p4kwp" (UID: "90dbddf8-969c-49c5-b3a7-b06709ab9e6d") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 28 17:21:43.415697 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.415681    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-cabundle0\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.426518 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.426488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9b9b\" (UniqueName: \"kubernetes.io/projected/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-kube-api-access-k9b9b\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.487885 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.487852    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:43.515537 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.515501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfjzj\" (UniqueName: \"kubernetes.io/projected/0844a6f6-2c3d-40d1-bfe9-42bb847739af-kube-api-access-dfjzj\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:43.515715 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.515560    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0844a6f6-2c3d-40d1-bfe9-42bb847739af-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:43.515715 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.515650    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0844a6f6-2c3d-40d1-bfe9-42bb847739af-certificates\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:43.604741 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.604701    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:43.616647 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.616617    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0844a6f6-2c3d-40d1-bfe9-42bb847739af-certificates\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:43.616765 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.616669    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfjzj\" (UniqueName: \"kubernetes.io/projected/0844a6f6-2c3d-40d1-bfe9-42bb847739af-kube-api-access-dfjzj\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:43.616765 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.616725    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0844a6f6-2c3d-40d1-bfe9-42bb847739af-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:43.616838 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:43.616761    2574 secret.go:281] references non-existent secret key: tls.crt
Jul 28 17:21:43.616838 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:43.616778    2574 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Jul 28 17:21:43.616838 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:43.616795    2574 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt: references non-existent secret key: tls.crt
Jul 28 17:21:43.616925 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:21:43.616841    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0844a6f6-2c3d-40d1-bfe9-42bb847739af-certificates podName:0844a6f6-2c3d-40d1-bfe9-42bb847739af nodeName:}" failed. No retries permitted until 2026-07-28 17:21:44.116826662 +0000 UTC m=+291.544605879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0844a6f6-2c3d-40d1-bfe9-42bb847739af-certificates") pod "keda-metrics-apiserver-55557df8c-lq4zt" (UID: "0844a6f6-2c3d-40d1-bfe9-42bb847739af") : references non-existent secret key: tls.crt
Jul 28 17:21:43.617084 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.617053    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/0844a6f6-2c3d-40d1-bfe9-42bb847739af-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:43.626168 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.626150    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfjzj\" (UniqueName: \"kubernetes.io/projected/0844a6f6-2c3d-40d1-bfe9-42bb847739af-kube-api-access-dfjzj\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:43.867326 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.867270    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:43.919207 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.919169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-certificates\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:43.921676 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:43.921652    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/90dbddf8-969c-49c5-b3a7-b06709ab9e6d-certificates\") pod \"keda-operator-77f648d694-p4kwp\" (UID: \"90dbddf8-969c-49c5-b3a7-b06709ab9e6d\") " pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:44.016045 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.016013    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:44.064110 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.064064    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:44.121495 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.121457    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0844a6f6-2c3d-40d1-bfe9-42bb847739af-certificates\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:44.125550 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.125525    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0844a6f6-2c3d-40d1-bfe9-42bb847739af-certificates\") pod \"keda-metrics-apiserver-55557df8c-lq4zt\" (UID: \"0844a6f6-2c3d-40d1-bfe9-42bb847739af\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:44.126188 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.126115    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:44.207655 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.207518    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-p4kwp"]
Jul 28 17:21:44.209807 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:21:44.209783    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90dbddf8_969c_49c5_b3a7_b06709ab9e6d.slice/crio-1683eeca085acdf896aba02cdd6f21a499d52e30d2e285114ba5a268863f88dd WatchSource:0}: Error finding container 1683eeca085acdf896aba02cdd6f21a499d52e30d2e285114ba5a268863f88dd: Status 404 returned error can't find the container with id 1683eeca085acdf896aba02cdd6f21a499d52e30d2e285114ba5a268863f88dd
Jul 28 17:21:44.262696 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.262658    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:44.263044 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.263012    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:44.390803 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.390716    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:44.403437 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.403414    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"]
Jul 28 17:21:44.405853 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:21:44.405816    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0844a6f6_2c3d_40d1_bfe9_42bb847739af.slice/crio-ca959dc68196f1017baf5be90ebbd21cd4c6f71c1db05e1214598bb002ba8c71 WatchSource:0}: Error finding container ca959dc68196f1017baf5be90ebbd21cd4c6f71c1db05e1214598bb002ba8c71: Status 404 returned error can't find the container with id ca959dc68196f1017baf5be90ebbd21cd4c6f71c1db05e1214598bb002ba8c71
Jul 28 17:21:44.511493 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.511450    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:21:44.543408 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.543376    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt" event={"ID":"0844a6f6-2c3d-40d1-bfe9-42bb847739af","Type":"ContainerStarted","Data":"ca959dc68196f1017baf5be90ebbd21cd4c6f71c1db05e1214598bb002ba8c71"}
Jul 28 17:21:44.544432 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:44.544407    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-p4kwp" event={"ID":"90dbddf8-969c-49c5-b3a7-b06709ab9e6d","Type":"ContainerStarted","Data":"1683eeca085acdf896aba02cdd6f21a499d52e30d2e285114ba5a268863f88dd"}
Jul 28 17:21:48.565813 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:48.565777    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt" event={"ID":"0844a6f6-2c3d-40d1-bfe9-42bb847739af","Type":"ContainerStarted","Data":"9fd6b50cdd92257b3a1104ca129bfc9353460ed4d08c8feac1a5e850f887f4b2"}
Jul 28 17:21:48.566272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:48.565854    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:21:48.567286 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:48.567263    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-p4kwp" event={"ID":"90dbddf8-969c-49c5-b3a7-b06709ab9e6d","Type":"ContainerStarted","Data":"b5f6550384e6f3b72cc045a769eaa862f237f088fb0473f832bf98944b9ff146"}
Jul 28 17:21:48.567405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:48.567365    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:21:48.637246 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:48.637187    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt" podStartSLOduration=2.092634752 podStartE2EDuration="5.637168072s" totalImagesPullingTime="3.54453332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:21:48.60186784 +0000 UTC m=+296.029647080" watchObservedRunningTime="2026-07-28 17:21:48.637168072 +0000 UTC m=+296.064947310"
Jul 28 17:21:48.637588 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:48.637565    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-p4kwp" podStartSLOduration=1.892806996 podStartE2EDuration="5.63755917s" totalImagesPullingTime="3.744752174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:21:48.635964875 +0000 UTC m=+296.063744113" watchObservedRunningTime="2026-07-28 17:21:48.63755917 +0000 UTC m=+296.065338409"
Jul 28 17:21:53.020243 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:53.020212    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:21:53.024679 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:53.024660    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:21:53.025760 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:53.025744    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 17:21:59.576875 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:21:59.576846    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-lq4zt"
Jul 28 17:22:00.651496 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:22:00.651458    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:00.752433 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:22:00.752394    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:22:03.540879 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:22:03.540848    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-tdtjh"
Jul 28 17:22:09.574390 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:22:09.574356    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-p4kwp"
Jul 28 17:23:02.142047 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.141832    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:02.230383 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.230346    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-84d9876847-shpsd"]
Jul 28 17:23:02.233411 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.233393    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:02.236137 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.236110    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 28 17:23:02.236286 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.236148    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 28 17:23:02.237310 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.237290    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-fss45\""
Jul 28 17:23:02.237443 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.237335    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 28 17:23:02.246411 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.246388    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84d9876847-shpsd"]
Jul 28 17:23:02.282804 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.282772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/095075a6-a32d-4ec2-981c-217283596ccc-cert\") pod \"llmisvc-controller-manager-84d9876847-shpsd\" (UID: \"095075a6-a32d-4ec2-981c-217283596ccc\") " pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:02.282974 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.282834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm59v\" (UniqueName: \"kubernetes.io/projected/095075a6-a32d-4ec2-981c-217283596ccc-kube-api-access-vm59v\") pod \"llmisvc-controller-manager-84d9876847-shpsd\" (UID: \"095075a6-a32d-4ec2-981c-217283596ccc\") " pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:02.383559 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.383519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm59v\" (UniqueName: \"kubernetes.io/projected/095075a6-a32d-4ec2-981c-217283596ccc-kube-api-access-vm59v\") pod \"llmisvc-controller-manager-84d9876847-shpsd\" (UID: \"095075a6-a32d-4ec2-981c-217283596ccc\") " pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:02.383720 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.383609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/095075a6-a32d-4ec2-981c-217283596ccc-cert\") pod \"llmisvc-controller-manager-84d9876847-shpsd\" (UID: \"095075a6-a32d-4ec2-981c-217283596ccc\") " pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:02.383720 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:23:02.383706    2574 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 17:23:02.383799 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:23:02.383768    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095075a6-a32d-4ec2-981c-217283596ccc-cert podName:095075a6-a32d-4ec2-981c-217283596ccc nodeName:}" failed. No retries permitted until 2026-07-28 17:23:02.883751248 +0000 UTC m=+370.311530464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/095075a6-a32d-4ec2-981c-217283596ccc-cert") pod "llmisvc-controller-manager-84d9876847-shpsd" (UID: "095075a6-a32d-4ec2-981c-217283596ccc") : secret "llmisvc-webhook-server-cert" not found
Jul 28 17:23:02.395022 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.394954    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm59v\" (UniqueName: \"kubernetes.io/projected/095075a6-a32d-4ec2-981c-217283596ccc-kube-api-access-vm59v\") pod \"llmisvc-controller-manager-84d9876847-shpsd\" (UID: \"095075a6-a32d-4ec2-981c-217283596ccc\") " pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:02.887585 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.887550    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/095075a6-a32d-4ec2-981c-217283596ccc-cert\") pod \"llmisvc-controller-manager-84d9876847-shpsd\" (UID: \"095075a6-a32d-4ec2-981c-217283596ccc\") " pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:02.889884 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:02.889864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/095075a6-a32d-4ec2-981c-217283596ccc-cert\") pod \"llmisvc-controller-manager-84d9876847-shpsd\" (UID: \"095075a6-a32d-4ec2-981c-217283596ccc\") " pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:03.145165 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:03.145078    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:03.278345 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:03.278307    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-84d9876847-shpsd"]
Jul 28 17:23:03.281193 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:23:03.281170    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod095075a6_a32d_4ec2_981c_217283596ccc.slice/crio-0bdf7b99314827ad1080823102c4aae77f553d79b7f9d2bf35f30cdfef81ee99 WatchSource:0}: Error finding container 0bdf7b99314827ad1080823102c4aae77f553d79b7f9d2bf35f30cdfef81ee99: Status 404 returned error can't find the container with id 0bdf7b99314827ad1080823102c4aae77f553d79b7f9d2bf35f30cdfef81ee99
Jul 28 17:23:03.282550 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:03.282533    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:23:03.509549 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:03.509518    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:03.904559 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:03.904481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd" event={"ID":"095075a6-a32d-4ec2-981c-217283596ccc","Type":"ContainerStarted","Data":"0bdf7b99314827ad1080823102c4aae77f553d79b7f9d2bf35f30cdfef81ee99"}
Jul 28 17:23:06.922885 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:06.922847    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd" event={"ID":"095075a6-a32d-4ec2-981c-217283596ccc","Type":"ContainerStarted","Data":"f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796"}
Jul 28 17:23:06.923294 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:06.922991    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:06.941261 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:06.941206    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd" podStartSLOduration=2.069671406 podStartE2EDuration="4.941191264s" totalImagesPullingTime="2.871519858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:06.940792201 +0000 UTC m=+374.368571444" watchObservedRunningTime="2026-07-28 17:23:06.941191264 +0000 UTC m=+374.368970501"
Jul 28 17:23:37.930930 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:37.930902    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 17:23:45.746443 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:45.746399    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:45.807778 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:45.807741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:45.992199 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:45.992166    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"]
Jul 28 17:23:45.995664 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:45.995648    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:45.998486 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:45.998415    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 17:23:45.999539 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:45.999523    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nbztt\""
Jul 28 17:23:45.999631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:45.999548    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 17:23:46.004385 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.004361    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"]
Jul 28 17:23:46.065183 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.065147    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p4km\" (UniqueName: \"kubernetes.io/projected/43fe382f-ae37-4e98-9d12-99ccd24115c7-kube-api-access-2p4km\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.065361 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.065192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.065361 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.065229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.165986 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.165949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p4km\" (UniqueName: \"kubernetes.io/projected/43fe382f-ae37-4e98-9d12-99ccd24115c7-kube-api-access-2p4km\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.166177 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.165995    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.166177 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.166046    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.166402 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.166381    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.166456 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.166440    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.174689 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.174663    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p4km\" (UniqueName: \"kubernetes.io/projected/43fe382f-ae37-4e98-9d12-99ccd24115c7-kube-api-access-2p4km\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.305586 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.305540    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:46.438138 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:46.438054    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"]
Jul 28 17:23:46.440706 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:23:46.440680    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fe382f_ae37_4e98_9d12_99ccd24115c7.slice/crio-2b1ccdd7b9b1fe5bc8dbcbf8c6b64347036bbbc6b1ec9a1a06ea9350ee9b90eb WatchSource:0}: Error finding container 2b1ccdd7b9b1fe5bc8dbcbf8c6b64347036bbbc6b1ec9a1a06ea9350ee9b90eb: Status 404 returned error can't find the container with id 2b1ccdd7b9b1fe5bc8dbcbf8c6b64347036bbbc6b1ec9a1a06ea9350ee9b90eb
Jul 28 17:23:47.103521 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:47.103490    2574 generic.go:356] "Generic (PLEG): container finished" podID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerID="ddb7651524c6d1f92623e9ef0763f7681534eaca249192035a5e5c568774e25e" exitCode=0
Jul 28 17:23:47.103960 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:47.103575    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz" event={"ID":"43fe382f-ae37-4e98-9d12-99ccd24115c7","Type":"ContainerDied","Data":"ddb7651524c6d1f92623e9ef0763f7681534eaca249192035a5e5c568774e25e"}
Jul 28 17:23:47.103960 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:47.103630    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz" event={"ID":"43fe382f-ae37-4e98-9d12-99ccd24115c7","Type":"ContainerStarted","Data":"2b1ccdd7b9b1fe5bc8dbcbf8c6b64347036bbbc6b1ec9a1a06ea9350ee9b90eb"}
Jul 28 17:23:50.119520 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:50.119486    2574 generic.go:356] "Generic (PLEG): container finished" podID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerID="908facc63b2a244f44fdc602aff9e549599b2d40d3405760a8fbfc0a6a15bea4" exitCode=0
Jul 28 17:23:50.119928 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:50.119576    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz" event={"ID":"43fe382f-ae37-4e98-9d12-99ccd24115c7","Type":"ContainerDied","Data":"908facc63b2a244f44fdc602aff9e549599b2d40d3405760a8fbfc0a6a15bea4"}
Jul 28 17:23:51.126764 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:51.126729    2574 generic.go:356] "Generic (PLEG): container finished" podID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerID="bc1d777625305e2a68231fbc2333eb8e672861f0d92f20937cd979243c3f696c" exitCode=0
Jul 28 17:23:51.127183 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:51.126796    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz" event={"ID":"43fe382f-ae37-4e98-9d12-99ccd24115c7","Type":"ContainerDied","Data":"bc1d777625305e2a68231fbc2333eb8e672861f0d92f20937cd979243c3f696c"}
Jul 28 17:23:52.254751 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.254726    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:52.320029 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.319987    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-util\") pod \"43fe382f-ae37-4e98-9d12-99ccd24115c7\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") "
Jul 28 17:23:52.320227 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.320103    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-bundle\") pod \"43fe382f-ae37-4e98-9d12-99ccd24115c7\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") "
Jul 28 17:23:52.320227 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.320131    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2p4km\" (UniqueName: \"kubernetes.io/projected/43fe382f-ae37-4e98-9d12-99ccd24115c7-kube-api-access-2p4km\") pod \"43fe382f-ae37-4e98-9d12-99ccd24115c7\" (UID: \"43fe382f-ae37-4e98-9d12-99ccd24115c7\") "
Jul 28 17:23:52.320819 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.320791    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-bundle" (OuterVolumeSpecName: "bundle") pod "43fe382f-ae37-4e98-9d12-99ccd24115c7" (UID: "43fe382f-ae37-4e98-9d12-99ccd24115c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:23:52.322186 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.322155    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43fe382f-ae37-4e98-9d12-99ccd24115c7-kube-api-access-2p4km" (OuterVolumeSpecName: "kube-api-access-2p4km") pod "43fe382f-ae37-4e98-9d12-99ccd24115c7" (UID: "43fe382f-ae37-4e98-9d12-99ccd24115c7"). InnerVolumeSpecName "kube-api-access-2p4km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:23:52.324769 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.324748    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-util" (OuterVolumeSpecName: "util") pod "43fe382f-ae37-4e98-9d12-99ccd24115c7" (UID: "43fe382f-ae37-4e98-9d12-99ccd24115c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:23:52.421227 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.421131    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p4km\" (UniqueName: \"kubernetes.io/projected/43fe382f-ae37-4e98-9d12-99ccd24115c7-kube-api-access-2p4km\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:23:52.421227 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.421165    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-util\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:23:52.421227 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:52.421177    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43fe382f-ae37-4e98-9d12-99ccd24115c7-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:23:53.137843 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:53.137804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz" event={"ID":"43fe382f-ae37-4e98-9d12-99ccd24115c7","Type":"ContainerDied","Data":"2b1ccdd7b9b1fe5bc8dbcbf8c6b64347036bbbc6b1ec9a1a06ea9350ee9b90eb"}
Jul 28 17:23:53.138005 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:53.137852    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mwtkz"
Jul 28 17:23:53.138005 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:53.137862    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b1ccdd7b9b1fe5bc8dbcbf8c6b64347036bbbc6b1ec9a1a06ea9350ee9b90eb"
Jul 28 17:23:57.155116 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:57.155053    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:58.406030 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:58.405995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:59.122892 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.122858    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"]
Jul 28 17:23:59.123216 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.123203    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerName="util"
Jul 28 17:23:59.123259 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.123217    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerName="util"
Jul 28 17:23:59.123259 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.123237    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerName="extract"
Jul 28 17:23:59.123259 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.123242    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerName="extract"
Jul 28 17:23:59.123259 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.123255    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerName="pull"
Jul 28 17:23:59.123259 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.123261    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerName="pull"
Jul 28 17:23:59.123411 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.123311    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="43fe382f-ae37-4e98-9d12-99ccd24115c7" containerName="extract"
Jul 28 17:23:59.127119 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.127100    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"
Jul 28 17:23:59.130171 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.130147    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:23:59.130290 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.130170    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 28 17:23:59.130408 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.130395    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mxk52\""
Jul 28 17:23:59.146877 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.146847    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"]
Jul 28 17:23:59.282967 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.282935    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8wm5\" (UniqueName: \"kubernetes.io/projected/43dabaaf-c81f-42e8-9caa-b12addfe3f32-kube-api-access-n8wm5\") pod \"cert-manager-operator-controller-manager-684f79c9b9-p2t48\" (UID: \"43dabaaf-c81f-42e8-9caa-b12addfe3f32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"
Jul 28 17:23:59.282967 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.282973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43dabaaf-c81f-42e8-9caa-b12addfe3f32-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-p2t48\" (UID: \"43dabaaf-c81f-42e8-9caa-b12addfe3f32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"
Jul 28 17:23:59.384496 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.384412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8wm5\" (UniqueName: \"kubernetes.io/projected/43dabaaf-c81f-42e8-9caa-b12addfe3f32-kube-api-access-n8wm5\") pod \"cert-manager-operator-controller-manager-684f79c9b9-p2t48\" (UID: \"43dabaaf-c81f-42e8-9caa-b12addfe3f32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"
Jul 28 17:23:59.384496 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.384451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43dabaaf-c81f-42e8-9caa-b12addfe3f32-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-p2t48\" (UID: \"43dabaaf-c81f-42e8-9caa-b12addfe3f32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"
Jul 28 17:23:59.384771 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.384756    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43dabaaf-c81f-42e8-9caa-b12addfe3f32-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-p2t48\" (UID: \"43dabaaf-c81f-42e8-9caa-b12addfe3f32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"
Jul 28 17:23:59.393837 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.393804    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8wm5\" (UniqueName: \"kubernetes.io/projected/43dabaaf-c81f-42e8-9caa-b12addfe3f32-kube-api-access-n8wm5\") pod \"cert-manager-operator-controller-manager-684f79c9b9-p2t48\" (UID: \"43dabaaf-c81f-42e8-9caa-b12addfe3f32\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"
Jul 28 17:23:59.436725 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.436688    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"
Jul 28 17:23:59.577833 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:23:59.577800    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48"]
Jul 28 17:23:59.581779 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:23:59.581754    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43dabaaf_c81f_42e8_9caa_b12addfe3f32.slice/crio-1038c467d9838db9a861fa01673ac9af59e46b97857fa7159b274378997744cf WatchSource:0}: Error finding container 1038c467d9838db9a861fa01673ac9af59e46b97857fa7159b274378997744cf: Status 404 returned error can't find the container with id 1038c467d9838db9a861fa01673ac9af59e46b97857fa7159b274378997744cf
Jul 28 17:24:00.171063 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:00.171027    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48" event={"ID":"43dabaaf-c81f-42e8-9caa-b12addfe3f32","Type":"ContainerStarted","Data":"1038c467d9838db9a861fa01673ac9af59e46b97857fa7159b274378997744cf"}
Jul 28 17:24:00.728529 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:00.728491    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:00.826863 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:00.826829    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:03.046797 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:03.046764    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:03.148013 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:03.147973    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:03.186334 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:03.186292    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48" event={"ID":"43dabaaf-c81f-42e8-9caa-b12addfe3f32","Type":"ContainerStarted","Data":"e22df202e7da901e0015287cb2882d5f997df88783a781f3cd0ebe5198a010a9"}
Jul 28 17:24:03.210789 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:03.210731    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-p2t48" podStartSLOduration=1.445608653 podStartE2EDuration="4.210710309s" totalImagesPullingTime="2.765101656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:03.209156366 +0000 UTC m=+430.636935605" watchObservedRunningTime="2026-07-28 17:24:03.210710309 +0000 UTC m=+430.638489548"
Jul 28 17:24:05.251777 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:05.251741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:05.454521 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:05.454492    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:05.534818 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:05.534779    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:05.598948 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:05.598914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:07.320206 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:07.320170    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:07.420426 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:07.420391    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:07.521333 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:07.521298    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:08.343379 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.343339    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"]
Jul 28 17:24:08.347331 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.347307    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.350332 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.350309    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 17:24:08.350456 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.350403    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nbztt\""
Jul 28 17:24:08.350510 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.350466    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 17:24:08.361372 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.361346    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"]
Jul 28 17:24:08.466302 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.466271    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.466504 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.466326    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v64kv\" (UniqueName: \"kubernetes.io/projected/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-kube-api-access-v64kv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.466504 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.466421    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.566995 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.566958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v64kv\" (UniqueName: \"kubernetes.io/projected/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-kube-api-access-v64kv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.567231 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.567009    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.567231 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.567063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.567443 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.567423    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.567524 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.567480    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.577970 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.577934    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v64kv\" (UniqueName: \"kubernetes.io/projected/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-kube-api-access-v64kv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.656853 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.656747    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:08.791183 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:08.791154    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"]
Jul 28 17:24:08.792817 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:24:08.792787    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bbff9c1_07e7_4008_bc15_eefe7ba8359a.slice/crio-c628fe91202e5cbf32514bb1de9169a3a9f9f3a85a394c6cd03345ca2cc1491c WatchSource:0}: Error finding container c628fe91202e5cbf32514bb1de9169a3a9f9f3a85a394c6cd03345ca2cc1491c: Status 404 returned error can't find the container with id c628fe91202e5cbf32514bb1de9169a3a9f9f3a85a394c6cd03345ca2cc1491c
Jul 28 17:24:09.213641 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:09.213608    2574 generic.go:356] "Generic (PLEG): container finished" podID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerID="a761ff59c9dcd9f1acaa1301ae2db76e6529888006904a1461574d0c60d5217c" exitCode=0
Jul 28 17:24:09.213834 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:09.213700    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl" event={"ID":"7bbff9c1-07e7-4008-bc15-eefe7ba8359a","Type":"ContainerDied","Data":"a761ff59c9dcd9f1acaa1301ae2db76e6529888006904a1461574d0c60d5217c"}
Jul 28 17:24:09.213834 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:09.213758    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl" event={"ID":"7bbff9c1-07e7-4008-bc15-eefe7ba8359a","Type":"ContainerStarted","Data":"c628fe91202e5cbf32514bb1de9169a3a9f9f3a85a394c6cd03345ca2cc1491c"}
Jul 28 17:24:12.108084 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:12.108030    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:12.180087 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:12.180025    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:12.232111 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:12.232054    2574 generic.go:356] "Generic (PLEG): container finished" podID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerID="0262b8b859ff85872445445ba9a5ace27a85a75fa71b5db05f40905eda488921" exitCode=0
Jul 28 17:24:12.232275 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:12.232140    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl" event={"ID":"7bbff9c1-07e7-4008-bc15-eefe7ba8359a","Type":"ContainerDied","Data":"0262b8b859ff85872445445ba9a5ace27a85a75fa71b5db05f40905eda488921"}
Jul 28 17:24:13.238518 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:13.238487    2574 generic.go:356] "Generic (PLEG): container finished" podID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerID="2b22d50db7b9819725b9a9842a75062ded4a0935657718340dd16f3f1695699a" exitCode=0
Jul 28 17:24:13.238949 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:13.238567    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl" event={"ID":"7bbff9c1-07e7-4008-bc15-eefe7ba8359a","Type":"ContainerDied","Data":"2b22d50db7b9819725b9a9842a75062ded4a0935657718340dd16f3f1695699a"}
Jul 28 17:24:13.251315 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:13.251274    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:14.381780 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.381750    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:14.522952 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.522925    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-bundle\") pod \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") "
Jul 28 17:24:14.523130 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.522974    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v64kv\" (UniqueName: \"kubernetes.io/projected/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-kube-api-access-v64kv\") pod \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") "
Jul 28 17:24:14.523130 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.522994    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-util\") pod \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\" (UID: \"7bbff9c1-07e7-4008-bc15-eefe7ba8359a\") "
Jul 28 17:24:14.523423 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.523393    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-bundle" (OuterVolumeSpecName: "bundle") pod "7bbff9c1-07e7-4008-bc15-eefe7ba8359a" (UID: "7bbff9c1-07e7-4008-bc15-eefe7ba8359a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:14.525102 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.525060    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-kube-api-access-v64kv" (OuterVolumeSpecName: "kube-api-access-v64kv") pod "7bbff9c1-07e7-4008-bc15-eefe7ba8359a" (UID: "7bbff9c1-07e7-4008-bc15-eefe7ba8359a"). InnerVolumeSpecName "kube-api-access-v64kv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:24:14.527455 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.527419    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-util" (OuterVolumeSpecName: "util") pod "7bbff9c1-07e7-4008-bc15-eefe7ba8359a" (UID: "7bbff9c1-07e7-4008-bc15-eefe7ba8359a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:14.624464 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.624430    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:14.624464 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.624460    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v64kv\" (UniqueName: \"kubernetes.io/projected/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-kube-api-access-v64kv\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:14.624464 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:14.624471    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbff9c1-07e7-4008-bc15-eefe7ba8359a-util\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:15.250216 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:15.250190    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl"
Jul 28 17:24:15.250384 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:15.250228    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6jssl" event={"ID":"7bbff9c1-07e7-4008-bc15-eefe7ba8359a","Type":"ContainerDied","Data":"c628fe91202e5cbf32514bb1de9169a3a9f9f3a85a394c6cd03345ca2cc1491c"}
Jul 28 17:24:15.250384 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:15.250268    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c628fe91202e5cbf32514bb1de9169a3a9f9f3a85a394c6cd03345ca2cc1491c"
Jul 28 17:24:19.119464 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:19.119420    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:19.218175 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:19.218143    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:26.641304 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:26.641263    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:26.742749 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:26.742708    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:28.387469 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:28.387436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:30.754768 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:30.754720    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:35.902142 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.902102    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"]
Jul 28 17:24:35.902646 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.902626    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerName="util"
Jul 28 17:24:35.902723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.902648    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerName="util"
Jul 28 17:24:35.902723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.902679    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerName="pull"
Jul 28 17:24:35.902723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.902689    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerName="pull"
Jul 28 17:24:35.902723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.902705    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerName="extract"
Jul 28 17:24:35.902723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.902714    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerName="extract"
Jul 28 17:24:35.902955 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.902817    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbff9c1-07e7-4008-bc15-eefe7ba8359a" containerName="extract"
Jul 28 17:24:35.908518 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.908489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:35.909110 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.909091    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:35.911990 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.911941    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 17:24:35.911990 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.911985    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4rl4w\""
Jul 28 17:24:35.912210 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.912013    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 17:24:35.912210 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.912102    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 17:24:35.912210 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.912196    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 17:24:35.912210 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.912206    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 17:24:35.912399 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.912386    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 17:24:35.920483 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.920462    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"]
Jul 28 17:24:35.980520 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:35.980482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:36.015213 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.015177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs26g\" (UniqueName: \"kubernetes.io/projected/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-kube-api-access-rs26g\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.015213 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.015218    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.015429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.015239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.015429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.015301    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.015429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.015334    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.015429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.015366    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.015429 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.015384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.115837 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.115798    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.115837 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.115839    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.116120 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.115879    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs26g\" (UniqueName: \"kubernetes.io/projected/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-kube-api-access-rs26g\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.116120 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.115907    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.116120 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.115927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.116120 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.115987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.116120 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.116020    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.116755 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.116727    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.118368 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.118339    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.118464 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.118392    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.118577 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.118552    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.118646 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.118632    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.124590 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.124558    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs26g\" (UniqueName: \"kubernetes.io/projected/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-kube-api-access-rs26g\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.124670 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.124610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92b31cc8-c6f2-4d4f-bfc3-b6562120f883-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-bv8fm\" (UID: \"92b31cc8-c6f2-4d4f-bfc3-b6562120f883\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.218631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.218534    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:36.355927 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.355897    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"]
Jul 28 17:24:36.358287 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:24:36.358261    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b31cc8_c6f2_4d4f_bfc3_b6562120f883.slice/crio-c3f3552588875f831d3843f6c65b98be9aed9250db703cc5cad12d573252ab16 WatchSource:0}: Error finding container c3f3552588875f831d3843f6c65b98be9aed9250db703cc5cad12d573252ab16: Status 404 returned error can't find the container with id c3f3552588875f831d3843f6c65b98be9aed9250db703cc5cad12d573252ab16
Jul 28 17:24:36.969499 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:36.969460    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:37.351358 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:37.351322    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm" event={"ID":"92b31cc8-c6f2-4d4f-bfc3-b6562120f883","Type":"ContainerStarted","Data":"c3f3552588875f831d3843f6c65b98be9aed9250db703cc5cad12d573252ab16"}
Jul 28 17:24:39.256786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:39.256735    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 28 17:24:39.257024 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:39.256833    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 28 17:24:39.363953 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:39.363888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm" event={"ID":"92b31cc8-c6f2-4d4f-bfc3-b6562120f883","Type":"ContainerStarted","Data":"2d529e4610219ad0c9f53e37500212780687b5ab658811638b1b4ba0d6f44e79"}
Jul 28 17:24:39.364356 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:39.364326    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:39.387772 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:39.387715    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm" podStartSLOduration=1.491487008 podStartE2EDuration="4.387699982s" totalImagesPullingTime="2.896212974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:39.387025435 +0000 UTC m=+466.814804673" watchObservedRunningTime="2026-07-28 17:24:39.387699982 +0000 UTC m=+466.815479220"
Jul 28 17:24:40.127083 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:40.127023    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:40.227049 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:40.226992    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:40.370986 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:40.370956    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-bv8fm"
Jul 28 17:24:42.440823 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:42.440789    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:42.538557 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:42.538522    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:45.888210 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:45.888167    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:47.929530 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:47.929491    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:48.031238 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:48.031201    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:51.539615 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.539578    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"]
Jul 28 17:24:51.542483 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.542457    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.545453 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.545423    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 17:24:51.545571 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.545423    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 17:24:51.545571 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.545466    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nbztt\""
Jul 28 17:24:51.552575 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.552550    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"]
Jul 28 17:24:51.635362 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.635326    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"]
Jul 28 17:24:51.637878 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.637862    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.647462 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.647429    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"]
Jul 28 17:24:51.656127 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.656099    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.656284 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.656131    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2bbp\" (UniqueName: \"kubernetes.io/projected/256bdefe-7981-4364-8c18-d3f9b05730d7-kube-api-access-l2bbp\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.656284 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.656193    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.735260 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.735227    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"]
Jul 28 17:24:51.737910 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.737894    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.748100 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.748058    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"]
Jul 28 17:24:51.757355 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.757326    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.757355 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.757357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2bbp\" (UniqueName: \"kubernetes.io/projected/256bdefe-7981-4364-8c18-d3f9b05730d7-kube-api-access-l2bbp\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.757564 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.757385    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.757564 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.757432    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7dqx\" (UniqueName: \"kubernetes.io/projected/5d78e220-304c-4d56-bd3f-257365746cb2-kube-api-access-z7dqx\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.757564 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.757502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.757733 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.757626    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.757733 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.757704    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.757840 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.757768    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.775905 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.775878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2bbp\" (UniqueName: \"kubernetes.io/projected/256bdefe-7981-4364-8c18-d3f9b05730d7-kube-api-access-l2bbp\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.844479 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.844389    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"]
Jul 28 17:24:51.847128 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.847104    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:51.853006 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.852980    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:51.858326 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.858294    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.858447 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.858388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnr9k\" (UniqueName: \"kubernetes.io/projected/a502e861-c017-414c-ac06-e90ee696f8aa-kube-api-access-hnr9k\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.858510 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.858454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.858596 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.858572    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.858653 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.858615    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7dqx\" (UniqueName: \"kubernetes.io/projected/5d78e220-304c-4d56-bd3f-257365746cb2-kube-api-access-z7dqx\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.858706 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.858666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.858924 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.858904    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.859021 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.858989    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.860611 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.860579    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"]
Jul 28 17:24:51.870565 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.870545    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7dqx\" (UniqueName: \"kubernetes.io/projected/5d78e220-304c-4d56-bd3f-257365746cb2-kube-api-access-z7dqx\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.947465 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.947430    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:51.959378 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.959344    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.959527 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.959395    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnr9k\" (UniqueName: \"kubernetes.io/projected/a502e861-c017-414c-ac06-e90ee696f8aa-kube-api-access-hnr9k\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.959618 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.959569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:51.959740 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.959714    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:51.959822 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.959769    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-269hv\" (UniqueName: \"kubernetes.io/projected/12e26435-4794-46fd-911d-a5d381394ce6-kube-api-access-269hv\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:51.959877 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.959825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.960056 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.959972    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.960204 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.960179    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.968972 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.968941    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnr9k\" (UniqueName: \"kubernetes.io/projected/a502e861-c017-414c-ac06-e90ee696f8aa-kube-api-access-hnr9k\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:51.993532 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:51.993501    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"]
Jul 28 17:24:51.995243 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:24:51.995216    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256bdefe_7981_4364_8c18_d3f9b05730d7.slice/crio-cf69734f65ffdd07fd8906ae76d27568fdd1bbf45b420fe28fd90bfb760b5852 WatchSource:0}: Error finding container cf69734f65ffdd07fd8906ae76d27568fdd1bbf45b420fe28fd90bfb760b5852: Status 404 returned error can't find the container with id cf69734f65ffdd07fd8906ae76d27568fdd1bbf45b420fe28fd90bfb760b5852
Jul 28 17:24:52.047714 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.047689    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:52.060941 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.060916    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:52.061059 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.060998    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:52.061059 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.061036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-269hv\" (UniqueName: \"kubernetes.io/projected/12e26435-4794-46fd-911d-a5d381394ce6-kube-api-access-269hv\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:52.061537 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.061346    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:52.061537 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.061357    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:52.070795 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.070756    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-269hv\" (UniqueName: \"kubernetes.io/projected/12e26435-4794-46fd-911d-a5d381394ce6-kube-api-access-269hv\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:52.099868 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.099836    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"]
Jul 28 17:24:52.101736 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:24:52.101704    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d78e220_304c_4d56_bd3f_257365746cb2.slice/crio-cabf6cc7ce963dc17cef9f84b8de56d702474f051cb1f47f882ff48dd0d0289b WatchSource:0}: Error finding container cabf6cc7ce963dc17cef9f84b8de56d702474f051cb1f47f882ff48dd0d0289b: Status 404 returned error can't find the container with id cabf6cc7ce963dc17cef9f84b8de56d702474f051cb1f47f882ff48dd0d0289b
Jul 28 17:24:52.156967 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.156938    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:52.203636 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.203146    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"]
Jul 28 17:24:52.206605 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:24:52.206568    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda502e861_c017_414c_ac06_e90ee696f8aa.slice/crio-bef6b90ec75659e0f6eea8d489706605e407bcd788cab8708e111f30adb88151 WatchSource:0}: Error finding container bef6b90ec75659e0f6eea8d489706605e407bcd788cab8708e111f30adb88151: Status 404 returned error can't find the container with id bef6b90ec75659e0f6eea8d489706605e407bcd788cab8708e111f30adb88151
Jul 28 17:24:52.311339 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.311311    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"]
Jul 28 17:24:52.376139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:24:52.376035    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e26435_4794_46fd_911d_a5d381394ce6.slice/crio-73791f948e216001c368da8406774b1e8b93b7bc8888bed2b3b6010c7cd93af4 WatchSource:0}: Error finding container 73791f948e216001c368da8406774b1e8b93b7bc8888bed2b3b6010c7cd93af4: Status 404 returned error can't find the container with id 73791f948e216001c368da8406774b1e8b93b7bc8888bed2b3b6010c7cd93af4
Jul 28 17:24:52.425906 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.425877    2574 generic.go:356] "Generic (PLEG): container finished" podID="a502e861-c017-414c-ac06-e90ee696f8aa" containerID="24b3ac0a17174bc9019269b20413b1c058709e2c4ab0e5f1ba2276a407b75aa3" exitCode=0
Jul 28 17:24:52.426040 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.426015    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g" event={"ID":"a502e861-c017-414c-ac06-e90ee696f8aa","Type":"ContainerDied","Data":"24b3ac0a17174bc9019269b20413b1c058709e2c4ab0e5f1ba2276a407b75aa3"}
Jul 28 17:24:52.426141 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.426090    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g" event={"ID":"a502e861-c017-414c-ac06-e90ee696f8aa","Type":"ContainerStarted","Data":"bef6b90ec75659e0f6eea8d489706605e407bcd788cab8708e111f30adb88151"}
Jul 28 17:24:52.427530 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.427471    2574 generic.go:356] "Generic (PLEG): container finished" podID="5d78e220-304c-4d56-bd3f-257365746cb2" containerID="e5ac003272180002c18dbecaa5ac77ea253194a5eeb18d933981f970d7d176fd" exitCode=0
Jul 28 17:24:52.427641 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.427563    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn" event={"ID":"5d78e220-304c-4d56-bd3f-257365746cb2","Type":"ContainerDied","Data":"e5ac003272180002c18dbecaa5ac77ea253194a5eeb18d933981f970d7d176fd"}
Jul 28 17:24:52.427641 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.427613    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn" event={"ID":"5d78e220-304c-4d56-bd3f-257365746cb2","Type":"ContainerStarted","Data":"cabf6cc7ce963dc17cef9f84b8de56d702474f051cb1f47f882ff48dd0d0289b"}
Jul 28 17:24:52.429682 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.429645    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl" event={"ID":"12e26435-4794-46fd-911d-a5d381394ce6","Type":"ContainerStarted","Data":"73791f948e216001c368da8406774b1e8b93b7bc8888bed2b3b6010c7cd93af4"}
Jul 28 17:24:52.431376 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.431352    2574 generic.go:356] "Generic (PLEG): container finished" podID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerID="c298b969bd4339e2229b10c153044f9c304fb21ee879c29a4a35a41bef046e46" exitCode=0
Jul 28 17:24:52.431483 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.431441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq" event={"ID":"256bdefe-7981-4364-8c18-d3f9b05730d7","Type":"ContainerDied","Data":"c298b969bd4339e2229b10c153044f9c304fb21ee879c29a4a35a41bef046e46"}
Jul 28 17:24:52.431555 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:52.431485    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq" event={"ID":"256bdefe-7981-4364-8c18-d3f9b05730d7","Type":"ContainerStarted","Data":"cf69734f65ffdd07fd8906ae76d27568fdd1bbf45b420fe28fd90bfb760b5852"}
Jul 28 17:24:53.438547 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:53.438518    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g" event={"ID":"a502e861-c017-414c-ac06-e90ee696f8aa","Type":"ContainerStarted","Data":"b242769822bf2c954d557c1c23c7f006f50e2b585eacaa3f7319c1a0a16499ce"}
Jul 28 17:24:53.440397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:53.440373    2574 generic.go:356] "Generic (PLEG): container finished" podID="5d78e220-304c-4d56-bd3f-257365746cb2" containerID="041ee73cd876286e24d46bbbe1ca3296b2e8bbe3279d38f22f8d9361339efd7c" exitCode=0
Jul 28 17:24:53.440498 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:53.440447    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn" event={"ID":"5d78e220-304c-4d56-bd3f-257365746cb2","Type":"ContainerDied","Data":"041ee73cd876286e24d46bbbe1ca3296b2e8bbe3279d38f22f8d9361339efd7c"}
Jul 28 17:24:53.442026 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:53.442004    2574 generic.go:356] "Generic (PLEG): container finished" podID="12e26435-4794-46fd-911d-a5d381394ce6" containerID="6554099e677c81e016d03241796bb84d47bbad72dac9d5d8b939769071a08a05" exitCode=0
Jul 28 17:24:53.442154 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:53.442039    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl" event={"ID":"12e26435-4794-46fd-911d-a5d381394ce6","Type":"ContainerDied","Data":"6554099e677c81e016d03241796bb84d47bbad72dac9d5d8b939769071a08a05"}
Jul 28 17:24:53.444125 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:53.444107    2574 generic.go:356] "Generic (PLEG): container finished" podID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerID="97c3327d376ff6a5298e8b5766b7a19f7d2836af05709ba0a90dd2737b025233" exitCode=0
Jul 28 17:24:53.444260 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:53.444177    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq" event={"ID":"256bdefe-7981-4364-8c18-d3f9b05730d7","Type":"ContainerDied","Data":"97c3327d376ff6a5298e8b5766b7a19f7d2836af05709ba0a90dd2737b025233"}
Jul 28 17:24:53.698244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:53.698208    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:53.780005 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:53.779975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:54.451649 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.451617    2574 generic.go:356] "Generic (PLEG): container finished" podID="12e26435-4794-46fd-911d-a5d381394ce6" containerID="fa2286d634494e7481fc6a237fa4452d6e69bce432769eea6dcd9d096d6b7674" exitCode=0
Jul 28 17:24:54.452087 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.451691    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl" event={"ID":"12e26435-4794-46fd-911d-a5d381394ce6","Type":"ContainerDied","Data":"fa2286d634494e7481fc6a237fa4452d6e69bce432769eea6dcd9d096d6b7674"}
Jul 28 17:24:54.453917 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.453893    2574 generic.go:356] "Generic (PLEG): container finished" podID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerID="41a54ac13add65a0e436247a25b62b06e49c30e636dc505181eae524e7932c91" exitCode=0
Jul 28 17:24:54.454017 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.453978    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq" event={"ID":"256bdefe-7981-4364-8c18-d3f9b05730d7","Type":"ContainerDied","Data":"41a54ac13add65a0e436247a25b62b06e49c30e636dc505181eae524e7932c91"}
Jul 28 17:24:54.455985 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.455964    2574 generic.go:356] "Generic (PLEG): container finished" podID="a502e861-c017-414c-ac06-e90ee696f8aa" containerID="b242769822bf2c954d557c1c23c7f006f50e2b585eacaa3f7319c1a0a16499ce" exitCode=0
Jul 28 17:24:54.455985 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.455982    2574 generic.go:356] "Generic (PLEG): container finished" podID="a502e861-c017-414c-ac06-e90ee696f8aa" containerID="b7d53589e904d00788edb16fb7da14a19692c718cd52bcdb37e8890258766d31" exitCode=0
Jul 28 17:24:54.456221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.456042    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g" event={"ID":"a502e861-c017-414c-ac06-e90ee696f8aa","Type":"ContainerDied","Data":"b242769822bf2c954d557c1c23c7f006f50e2b585eacaa3f7319c1a0a16499ce"}
Jul 28 17:24:54.456221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.456105    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g" event={"ID":"a502e861-c017-414c-ac06-e90ee696f8aa","Type":"ContainerDied","Data":"b7d53589e904d00788edb16fb7da14a19692c718cd52bcdb37e8890258766d31"}
Jul 28 17:24:54.458185 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.458163    2574 generic.go:356] "Generic (PLEG): container finished" podID="5d78e220-304c-4d56-bd3f-257365746cb2" containerID="1d641c2f1572686b4b8c4e88b53f387ee4866b431329b6872d8b7eda767c6b96" exitCode=0
Jul 28 17:24:54.458289 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:54.458201    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn" event={"ID":"5d78e220-304c-4d56-bd3f-257365746cb2","Type":"ContainerDied","Data":"1d641c2f1572686b4b8c4e88b53f387ee4866b431329b6872d8b7eda767c6b96"}
Jul 28 17:24:55.465763 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.465728    2574 generic.go:356] "Generic (PLEG): container finished" podID="12e26435-4794-46fd-911d-a5d381394ce6" containerID="38820d9415037eaeb395c91652e80d72a6c8ce8db3a25400a7d6df21359a8f3a" exitCode=0
Jul 28 17:24:55.466283 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.465809    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl" event={"ID":"12e26435-4794-46fd-911d-a5d381394ce6","Type":"ContainerDied","Data":"38820d9415037eaeb395c91652e80d72a6c8ce8db3a25400a7d6df21359a8f3a"}
Jul 28 17:24:55.609876 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.609845    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:55.659352 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.659324    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:55.662167 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.662145    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:55.695281 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.695254    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7dqx\" (UniqueName: \"kubernetes.io/projected/5d78e220-304c-4d56-bd3f-257365746cb2-kube-api-access-z7dqx\") pod \"5d78e220-304c-4d56-bd3f-257365746cb2\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") "
Jul 28 17:24:55.695281 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.695285    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-bundle\") pod \"5d78e220-304c-4d56-bd3f-257365746cb2\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") "
Jul 28 17:24:55.695507 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.695309    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-util\") pod \"5d78e220-304c-4d56-bd3f-257365746cb2\" (UID: \"5d78e220-304c-4d56-bd3f-257365746cb2\") "
Jul 28 17:24:55.695820 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.695792    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-bundle" (OuterVolumeSpecName: "bundle") pod "5d78e220-304c-4d56-bd3f-257365746cb2" (UID: "5d78e220-304c-4d56-bd3f-257365746cb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:55.697502 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.697480    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d78e220-304c-4d56-bd3f-257365746cb2-kube-api-access-z7dqx" (OuterVolumeSpecName: "kube-api-access-z7dqx") pod "5d78e220-304c-4d56-bd3f-257365746cb2" (UID: "5d78e220-304c-4d56-bd3f-257365746cb2"). InnerVolumeSpecName "kube-api-access-z7dqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:24:55.703288 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.703263    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-util" (OuterVolumeSpecName: "util") pod "5d78e220-304c-4d56-bd3f-257365746cb2" (UID: "5d78e220-304c-4d56-bd3f-257365746cb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:55.796024 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.795984    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-bundle\") pod \"256bdefe-7981-4364-8c18-d3f9b05730d7\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") "
Jul 28 17:24:55.796024 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796030    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2bbp\" (UniqueName: \"kubernetes.io/projected/256bdefe-7981-4364-8c18-d3f9b05730d7-kube-api-access-l2bbp\") pod \"256bdefe-7981-4364-8c18-d3f9b05730d7\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") "
Jul 28 17:24:55.796292 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796063    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-bundle\") pod \"a502e861-c017-414c-ac06-e90ee696f8aa\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") "
Jul 28 17:24:55.796292 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796150    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-util\") pod \"256bdefe-7981-4364-8c18-d3f9b05730d7\" (UID: \"256bdefe-7981-4364-8c18-d3f9b05730d7\") "
Jul 28 17:24:55.796292 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796170    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnr9k\" (UniqueName: \"kubernetes.io/projected/a502e861-c017-414c-ac06-e90ee696f8aa-kube-api-access-hnr9k\") pod \"a502e861-c017-414c-ac06-e90ee696f8aa\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") "
Jul 28 17:24:55.796292 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796188    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-util\") pod \"a502e861-c017-414c-ac06-e90ee696f8aa\" (UID: \"a502e861-c017-414c-ac06-e90ee696f8aa\") "
Jul 28 17:24:55.796493 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796387    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7dqx\" (UniqueName: \"kubernetes.io/projected/5d78e220-304c-4d56-bd3f-257365746cb2-kube-api-access-z7dqx\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:55.796493 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796406    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:55.796493 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796420    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d78e220-304c-4d56-bd3f-257365746cb2-util\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:55.796675 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796652    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-bundle" (OuterVolumeSpecName: "bundle") pod "256bdefe-7981-4364-8c18-d3f9b05730d7" (UID: "256bdefe-7981-4364-8c18-d3f9b05730d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:55.796970 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.796946    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-bundle" (OuterVolumeSpecName: "bundle") pod "a502e861-c017-414c-ac06-e90ee696f8aa" (UID: "a502e861-c017-414c-ac06-e90ee696f8aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:55.798619 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.798599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256bdefe-7981-4364-8c18-d3f9b05730d7-kube-api-access-l2bbp" (OuterVolumeSpecName: "kube-api-access-l2bbp") pod "256bdefe-7981-4364-8c18-d3f9b05730d7" (UID: "256bdefe-7981-4364-8c18-d3f9b05730d7"). InnerVolumeSpecName "kube-api-access-l2bbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:24:55.798714 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.798695    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a502e861-c017-414c-ac06-e90ee696f8aa-kube-api-access-hnr9k" (OuterVolumeSpecName: "kube-api-access-hnr9k") pod "a502e861-c017-414c-ac06-e90ee696f8aa" (UID: "a502e861-c017-414c-ac06-e90ee696f8aa"). InnerVolumeSpecName "kube-api-access-hnr9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:24:55.802643 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.802621    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-util" (OuterVolumeSpecName: "util") pod "a502e861-c017-414c-ac06-e90ee696f8aa" (UID: "a502e861-c017-414c-ac06-e90ee696f8aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:55.802696 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.802655    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-util" (OuterVolumeSpecName: "util") pod "256bdefe-7981-4364-8c18-d3f9b05730d7" (UID: "256bdefe-7981-4364-8c18-d3f9b05730d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:55.897094 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.897026    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:55.897094 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.897060    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-util\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:55.897094 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.897091    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnr9k\" (UniqueName: \"kubernetes.io/projected/a502e861-c017-414c-ac06-e90ee696f8aa-kube-api-access-hnr9k\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:55.897094 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.897100    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a502e861-c017-414c-ac06-e90ee696f8aa-util\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:55.897094 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.897109    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/256bdefe-7981-4364-8c18-d3f9b05730d7-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:55.897374 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:55.897117    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2bbp\" (UniqueName: \"kubernetes.io/projected/256bdefe-7981-4364-8c18-d3f9b05730d7-kube-api-access-l2bbp\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:56.472489 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.472463    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g"
Jul 28 17:24:56.472946 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.472457    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d870532hc9g" event={"ID":"a502e861-c017-414c-ac06-e90ee696f8aa","Type":"ContainerDied","Data":"bef6b90ec75659e0f6eea8d489706605e407bcd788cab8708e111f30adb88151"}
Jul 28 17:24:56.472946 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.472612    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bef6b90ec75659e0f6eea8d489706605e407bcd788cab8708e111f30adb88151"
Jul 28 17:24:56.474500 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.474484    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn"
Jul 28 17:24:56.474597 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.474519    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chkqkn" event={"ID":"5d78e220-304c-4d56-bd3f-257365746cb2","Type":"ContainerDied","Data":"cabf6cc7ce963dc17cef9f84b8de56d702474f051cb1f47f882ff48dd0d0289b"}
Jul 28 17:24:56.474597 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.474562    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cabf6cc7ce963dc17cef9f84b8de56d702474f051cb1f47f882ff48dd0d0289b"
Jul 28 17:24:56.476514 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.476496    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq"
Jul 28 17:24:56.476624 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.476537    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbm2ltq" event={"ID":"256bdefe-7981-4364-8c18-d3f9b05730d7","Type":"ContainerDied","Data":"cf69734f65ffdd07fd8906ae76d27568fdd1bbf45b420fe28fd90bfb760b5852"}
Jul 28 17:24:56.476624 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.476575    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf69734f65ffdd07fd8906ae76d27568fdd1bbf45b420fe28fd90bfb760b5852"
Jul 28 17:24:56.611776 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.611752    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:56.704686 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.704653    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-util\") pod \"12e26435-4794-46fd-911d-a5d381394ce6\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") "
Jul 28 17:24:56.704829 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.704764    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-bundle\") pod \"12e26435-4794-46fd-911d-a5d381394ce6\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") "
Jul 28 17:24:56.704829 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.704797    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-269hv\" (UniqueName: \"kubernetes.io/projected/12e26435-4794-46fd-911d-a5d381394ce6-kube-api-access-269hv\") pod \"12e26435-4794-46fd-911d-a5d381394ce6\" (UID: \"12e26435-4794-46fd-911d-a5d381394ce6\") "
Jul 28 17:24:56.705295 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.705261    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-bundle" (OuterVolumeSpecName: "bundle") pod "12e26435-4794-46fd-911d-a5d381394ce6" (UID: "12e26435-4794-46fd-911d-a5d381394ce6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:56.706923 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.706904    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e26435-4794-46fd-911d-a5d381394ce6-kube-api-access-269hv" (OuterVolumeSpecName: "kube-api-access-269hv") pod "12e26435-4794-46fd-911d-a5d381394ce6" (UID: "12e26435-4794-46fd-911d-a5d381394ce6"). InnerVolumeSpecName "kube-api-access-269hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:24:56.710120 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.710083    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-util" (OuterVolumeSpecName: "util") pod "12e26435-4794-46fd-911d-a5d381394ce6" (UID: "12e26435-4794-46fd-911d-a5d381394ce6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:56.806295 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.806260    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:56.806295 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.806296    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-269hv\" (UniqueName: \"kubernetes.io/projected/12e26435-4794-46fd-911d-a5d381394ce6-kube-api-access-269hv\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:56.806507 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:56.806306    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12e26435-4794-46fd-911d-a5d381394ce6-util\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:24:57.484743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:57.484654    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl" event={"ID":"12e26435-4794-46fd-911d-a5d381394ce6","Type":"ContainerDied","Data":"73791f948e216001c368da8406774b1e8b93b7bc8888bed2b3b6010c7cd93af4"}
Jul 28 17:24:57.484743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:57.484713    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73791f948e216001c368da8406774b1e8b93b7bc8888bed2b3b6010c7cd93af4"
Jul 28 17:24:57.484743 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:57.484677    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0vdjgl"
Jul 28 17:24:59.602640 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:24:59.602605    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:00.421114 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:00.421046    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:02.907565 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907531    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-56fb6f6856-2kw2j"]
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907906    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerName="pull"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907917    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerName="pull"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907927    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a502e861-c017-414c-ac06-e90ee696f8aa" containerName="util"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907932    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a502e861-c017-414c-ac06-e90ee696f8aa" containerName="util"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907939    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a502e861-c017-414c-ac06-e90ee696f8aa" containerName="pull"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907945    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a502e861-c017-414c-ac06-e90ee696f8aa" containerName="pull"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907952    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerName="extract"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907957    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerName="extract"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907964    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e26435-4794-46fd-911d-a5d381394ce6" containerName="util"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907969    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e26435-4794-46fd-911d-a5d381394ce6" containerName="util"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907979    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a502e861-c017-414c-ac06-e90ee696f8aa" containerName="extract"
Jul 28 17:25:02.907980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907984    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a502e861-c017-414c-ac06-e90ee696f8aa" containerName="extract"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907993    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d78e220-304c-4d56-bd3f-257365746cb2" containerName="util"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.907998    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d78e220-304c-4d56-bd3f-257365746cb2" containerName="util"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908006    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d78e220-304c-4d56-bd3f-257365746cb2" containerName="pull"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908011    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d78e220-304c-4d56-bd3f-257365746cb2" containerName="pull"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908019    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e26435-4794-46fd-911d-a5d381394ce6" containerName="extract"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908024    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e26435-4794-46fd-911d-a5d381394ce6" containerName="extract"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908031    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d78e220-304c-4d56-bd3f-257365746cb2" containerName="extract"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908036    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d78e220-304c-4d56-bd3f-257365746cb2" containerName="extract"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908043    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerName="util"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908047    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerName="util"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908052    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e26435-4794-46fd-911d-a5d381394ce6" containerName="pull"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908057    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e26435-4794-46fd-911d-a5d381394ce6" containerName="pull"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908125    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e26435-4794-46fd-911d-a5d381394ce6" containerName="extract"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908131    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a502e861-c017-414c-ac06-e90ee696f8aa" containerName="extract"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908138    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="256bdefe-7981-4364-8c18-d3f9b05730d7" containerName="extract"
Jul 28 17:25:02.908405 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.908144    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d78e220-304c-4d56-bd3f-257365746cb2" containerName="extract"
Jul 28 17:25:02.911261 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.911240    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j"
Jul 28 17:25:02.914414 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.914385    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cx7t5\""
Jul 28 17:25:02.914990 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.914976    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 17:25:02.915609 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.915596    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 17:25:02.923889 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.923868    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-56fb6f6856-2kw2j"]
Jul 28 17:25:02.962127 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:02.962059    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tkhm\" (UniqueName: \"kubernetes.io/projected/4f986299-6e67-4498-a1d4-e68a33f877ff-kube-api-access-8tkhm\") pod \"authorino-operator-56fb6f6856-2kw2j\" (UID: \"4f986299-6e67-4498-a1d4-e68a33f877ff\") " pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j"
Jul 28 17:25:03.063326 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:03.063272    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tkhm\" (UniqueName: \"kubernetes.io/projected/4f986299-6e67-4498-a1d4-e68a33f877ff-kube-api-access-8tkhm\") pod \"authorino-operator-56fb6f6856-2kw2j\" (UID: \"4f986299-6e67-4498-a1d4-e68a33f877ff\") " pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j"
Jul 28 17:25:03.072525 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:03.072487    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tkhm\" (UniqueName: \"kubernetes.io/projected/4f986299-6e67-4498-a1d4-e68a33f877ff-kube-api-access-8tkhm\") pod \"authorino-operator-56fb6f6856-2kw2j\" (UID: \"4f986299-6e67-4498-a1d4-e68a33f877ff\") " pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j"
Jul 28 17:25:03.221965 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:03.221885    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j"
Jul 28 17:25:03.356961 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:03.356936    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-56fb6f6856-2kw2j"]
Jul 28 17:25:03.357635 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:25:03.357612    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f986299_6e67_4498_a1d4_e68a33f877ff.slice/crio-581d03d600b838c2e2cde4ef850204af292e58e184747b04884849e4e80d0f47 WatchSource:0}: Error finding container 581d03d600b838c2e2cde4ef850204af292e58e184747b04884849e4e80d0f47: Status 404 returned error can't find the container with id 581d03d600b838c2e2cde4ef850204af292e58e184747b04884849e4e80d0f47
Jul 28 17:25:03.452184 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:03.452146    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:03.515812 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:03.515779    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j" event={"ID":"4f986299-6e67-4498-a1d4-e68a33f877ff","Type":"ContainerStarted","Data":"581d03d600b838c2e2cde4ef850204af292e58e184747b04884849e4e80d0f47"}
Jul 28 17:25:03.580271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:03.580236    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:03.688089 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:03.688035    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:05.166836 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.166799    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"]
Jul 28 17:25:05.175867 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.175840    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"
Jul 28 17:25:05.178612 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.178575    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9lrcl\""
Jul 28 17:25:05.179028 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.179002    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xnj2\" (UniqueName: \"kubernetes.io/projected/17489ec7-bb33-417f-91cf-e47595c89aa9-kube-api-access-8xnj2\") pod \"limitador-operator-controller-manager-774d94476f-xhtkz\" (UID: \"17489ec7-bb33-417f-91cf-e47595c89aa9\") " pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"
Jul 28 17:25:05.184778 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.184752    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"]
Jul 28 17:25:05.212733 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.212695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:05.279949 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.279910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xnj2\" (UniqueName: \"kubernetes.io/projected/17489ec7-bb33-417f-91cf-e47595c89aa9-kube-api-access-8xnj2\") pod \"limitador-operator-controller-manager-774d94476f-xhtkz\" (UID: \"17489ec7-bb33-417f-91cf-e47595c89aa9\") " pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"
Jul 28 17:25:05.293792 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.293761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xnj2\" (UniqueName: \"kubernetes.io/projected/17489ec7-bb33-417f-91cf-e47595c89aa9-kube-api-access-8xnj2\") pod \"limitador-operator-controller-manager-774d94476f-xhtkz\" (UID: \"17489ec7-bb33-417f-91cf-e47595c89aa9\") " pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"
Jul 28 17:25:05.326617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.326577    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:05.491826 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.491738    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"
Jul 28 17:25:05.552820 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.552781    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:05.651116 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.651077    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:05.935384 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:05.935345    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:06.035566 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.035535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:06.068055 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.068027    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"]
Jul 28 17:25:06.071083 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:25:06.071045    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17489ec7_bb33_417f_91cf_e47595c89aa9.slice/crio-597a56b81d7d0c82395121a6cd0ab20417d06b4317813428fb6c66f3f7785e1d WatchSource:0}: Error finding container 597a56b81d7d0c82395121a6cd0ab20417d06b4317813428fb6c66f3f7785e1d: Status 404 returned error can't find the container with id 597a56b81d7d0c82395121a6cd0ab20417d06b4317813428fb6c66f3f7785e1d
Jul 28 17:25:06.214696 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.214603    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:06.487133 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.487018    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:06.535506 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.535475    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz" event={"ID":"17489ec7-bb33-417f-91cf-e47595c89aa9","Type":"ContainerStarted","Data":"597a56b81d7d0c82395121a6cd0ab20417d06b4317813428fb6c66f3f7785e1d"}
Jul 28 17:25:06.537078 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.537044    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j" event={"ID":"4f986299-6e67-4498-a1d4-e68a33f877ff","Type":"ContainerStarted","Data":"e638c41cf95e882ba9b52d6f52f2a1e5dbc8d1371c7cc8e52d59ff56b357d825"}
Jul 28 17:25:06.537214 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.537113    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j"
Jul 28 17:25:06.555502 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.555451    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j" podStartSLOduration=1.914119304 podStartE2EDuration="4.555437521s" totalImagesPullingTime="2.641318217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:25:06.554272254 +0000 UTC m=+493.982051503" watchObservedRunningTime="2026-07-28 17:25:06.555437521 +0000 UTC m=+493.983216759"
Jul 28 17:25:06.559902 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.559866    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:06.643125 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:06.643095    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:08.549370 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:08.549337    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz" event={"ID":"17489ec7-bb33-417f-91cf-e47595c89aa9","Type":"ContainerStarted","Data":"5445ae07cdd6d71df95df1c0cef38fd5bc4cd05e3115926ed49af13a96eacc4d"}
Jul 28 17:25:08.549915 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:08.549429    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"
Jul 28 17:25:08.572061 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:08.572000    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz" podStartSLOduration=2.14195243 podStartE2EDuration="3.571983671s" totalImagesPullingTime="1.430031241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:25:08.570207044 +0000 UTC m=+495.997986282" watchObservedRunningTime="2026-07-28 17:25:08.571983671 +0000 UTC m=+495.999762909"
Jul 28 17:25:10.061190 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:10.061154    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:10.841079 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:10.841042    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:11.765812 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:11.765779    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"]
Jul 28 17:25:11.769438 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:11.769421    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"
Jul 28 17:25:11.772360 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:11.772338    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 17:25:11.773484 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:11.773453    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s65p2\""
Jul 28 17:25:11.782877 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:11.782850    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"]
Jul 28 17:25:11.840751 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:11.840710    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9p2f\" (UniqueName: \"kubernetes.io/projected/99ad4cfb-67b1-462c-b0f3-69adf799fb84-kube-api-access-b9p2f\") pod \"dns-operator-controller-manager-ccbdf686-qq2zk\" (UID: \"99ad4cfb-67b1-462c-b0f3-69adf799fb84\") " pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"
Jul 28 17:25:11.941697 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:11.941659    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9p2f\" (UniqueName: \"kubernetes.io/projected/99ad4cfb-67b1-462c-b0f3-69adf799fb84-kube-api-access-b9p2f\") pod \"dns-operator-controller-manager-ccbdf686-qq2zk\" (UID: \"99ad4cfb-67b1-462c-b0f3-69adf799fb84\") " pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"
Jul 28 17:25:11.957593 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:11.957559    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9p2f\" (UniqueName: \"kubernetes.io/projected/99ad4cfb-67b1-462c-b0f3-69adf799fb84-kube-api-access-b9p2f\") pod \"dns-operator-controller-manager-ccbdf686-qq2zk\" (UID: \"99ad4cfb-67b1-462c-b0f3-69adf799fb84\") " pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"
Jul 28 17:25:12.080451 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:12.080361    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"
Jul 28 17:25:12.225244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:12.225219    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"]
Jul 28 17:25:12.226847 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:25:12.226813    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ad4cfb_67b1_462c_b0f3_69adf799fb84.slice/crio-64167722bc2c6c89dafaa08edcdb4f7970a7931bf7317cd78c00acca9ccea1d7 WatchSource:0}: Error finding container 64167722bc2c6c89dafaa08edcdb4f7970a7931bf7317cd78c00acca9ccea1d7: Status 404 returned error can't find the container with id 64167722bc2c6c89dafaa08edcdb4f7970a7931bf7317cd78c00acca9ccea1d7
Jul 28 17:25:12.570360 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:12.570327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk" event={"ID":"99ad4cfb-67b1-462c-b0f3-69adf799fb84","Type":"ContainerStarted","Data":"64167722bc2c6c89dafaa08edcdb4f7970a7931bf7317cd78c00acca9ccea1d7"}
Jul 28 17:25:13.126796 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:13.126753    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:13.381847 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:13.381753    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:13.492395 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:13.492363    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:14.586714 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:14.586622    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk" event={"ID":"99ad4cfb-67b1-462c-b0f3-69adf799fb84","Type":"ContainerStarted","Data":"a7f6522fe361b6893770af8a1fde025cfe19ebc78f5bbd9710ce470260444aad"}
Jul 28 17:25:14.586714 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:14.586685    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"
Jul 28 17:25:14.606710 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:14.606663    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk" podStartSLOduration=1.517518556 podStartE2EDuration="3.606647516s" totalImagesPullingTime="2.08912896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:25:14.605369933 +0000 UTC m=+502.033149171" watchObservedRunningTime="2026-07-28 17:25:14.606647516 +0000 UTC m=+502.034426754"
Jul 28 17:25:15.513737 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:15.513699    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c4fcd685f-jqqvm"]
Jul 28 17:25:15.633327 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:15.633288    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:15.734244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:15.734201    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:15.833631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:15.833537    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:16.234837 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:16.234747    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:16.365621 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:16.365586    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:16.624355 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:16.624325    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:16.724921 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:16.724887    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:17.545199 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:17.545171    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-56fb6f6856-2kw2j"
Jul 28 17:25:19.557336 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:19.557308    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-774d94476f-xhtkz"
Jul 28 17:25:20.567665 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:20.567632    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:20.662182 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:20.662148    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:20.771225 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:20.771188    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:25.593633 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:25.593601    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-ccbdf686-qq2zk"
Jul 28 17:25:27.047501 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:27.047464    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:27.147091 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:27.147036    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:32.613870 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:32.613835    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:32.714457 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:32.714423    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:33.183177 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:33.183133    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:33.284431 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:33.284400    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:35.616176 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:35.616144    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:35.711947 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:35.711901    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:40.533191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.533153    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c4fcd685f-jqqvm" podUID="71095130-c734-4194-acb6-12d764fd6b28" containerName="console" containerID="cri-o://b12d28707088d839d37318964cbd331e10c7da224ff58df431aded7c3f14a24a" gracePeriod=15
Jul 28 17:25:40.732387 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.732343    2574 generic.go:356] "Generic (PLEG): container finished" podID="71095130-c734-4194-acb6-12d764fd6b28" containerID="b12d28707088d839d37318964cbd331e10c7da224ff58df431aded7c3f14a24a" exitCode=0
Jul 28 17:25:40.732552 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.732406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4fcd685f-jqqvm" event={"ID":"71095130-c734-4194-acb6-12d764fd6b28","Type":"ContainerDied","Data":"b12d28707088d839d37318964cbd331e10c7da224ff58df431aded7c3f14a24a"}
Jul 28 17:25:40.780033 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.780005    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:25:40.786493 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.786427    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:40.887930 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.887888    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:40.899840 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.899808    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-console-config\") pod \"71095130-c734-4194-acb6-12d764fd6b28\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") "
Jul 28 17:25:40.899840 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.899844    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-service-ca\") pod \"71095130-c734-4194-acb6-12d764fd6b28\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") "
Jul 28 17:25:40.900092 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.899863    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-serving-cert\") pod \"71095130-c734-4194-acb6-12d764fd6b28\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") "
Jul 28 17:25:40.900092 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.899887    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9pwm\" (UniqueName: \"kubernetes.io/projected/71095130-c734-4194-acb6-12d764fd6b28-kube-api-access-m9pwm\") pod \"71095130-c734-4194-acb6-12d764fd6b28\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") "
Jul 28 17:25:40.900092 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900031    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-oauth-serving-cert\") pod \"71095130-c734-4194-acb6-12d764fd6b28\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") "
Jul 28 17:25:40.900263 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900097    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-oauth-config\") pod \"71095130-c734-4194-acb6-12d764fd6b28\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") "
Jul 28 17:25:40.900263 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900132    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-trusted-ca-bundle\") pod \"71095130-c734-4194-acb6-12d764fd6b28\" (UID: \"71095130-c734-4194-acb6-12d764fd6b28\") "
Jul 28 17:25:40.900364 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900259    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-service-ca" (OuterVolumeSpecName: "service-ca") pod "71095130-c734-4194-acb6-12d764fd6b28" (UID: "71095130-c734-4194-acb6-12d764fd6b28"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:25:40.900495 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900469    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "71095130-c734-4194-acb6-12d764fd6b28" (UID: "71095130-c734-4194-acb6-12d764fd6b28"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:25:40.900561 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900529    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-console-config" (OuterVolumeSpecName: "console-config") pod "71095130-c734-4194-acb6-12d764fd6b28" (UID: "71095130-c734-4194-acb6-12d764fd6b28"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:25:40.900561 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900540    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "71095130-c734-4194-acb6-12d764fd6b28" (UID: "71095130-c734-4194-acb6-12d764fd6b28"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:25:40.900675 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900638    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-console-config\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:25:40.900675 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900654    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-service-ca\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:25:40.900675 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900666    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-oauth-serving-cert\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:25:40.900828 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.900681    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71095130-c734-4194-acb6-12d764fd6b28-trusted-ca-bundle\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:25:40.902239 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.902210    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "71095130-c734-4194-acb6-12d764fd6b28" (UID: "71095130-c734-4194-acb6-12d764fd6b28"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:25:40.902336 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.902243    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71095130-c734-4194-acb6-12d764fd6b28-kube-api-access-m9pwm" (OuterVolumeSpecName: "kube-api-access-m9pwm") pod "71095130-c734-4194-acb6-12d764fd6b28" (UID: "71095130-c734-4194-acb6-12d764fd6b28"). InnerVolumeSpecName "kube-api-access-m9pwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:25:40.902336 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.902297    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "71095130-c734-4194-acb6-12d764fd6b28" (UID: "71095130-c734-4194-acb6-12d764fd6b28"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:25:40.988213 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:40.988181    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:41.002150 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.002103    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-oauth-config\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:25:41.002150 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.002143    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71095130-c734-4194-acb6-12d764fd6b28-console-serving-cert\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:25:41.002150 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.002153    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9pwm\" (UniqueName: \"kubernetes.io/projected/71095130-c734-4194-acb6-12d764fd6b28-kube-api-access-m9pwm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:25:41.064111 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.064016    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:41.178055 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.178026    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:41.280022 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.279982    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:41.739476 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.739446    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4fcd685f-jqqvm"
Jul 28 17:25:41.739898 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.739445    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4fcd685f-jqqvm" event={"ID":"71095130-c734-4194-acb6-12d764fd6b28","Type":"ContainerDied","Data":"9ddafa77f9cfebfcbb6a2d03610132087f422dab2a3ce2b191ceff4ac35e6030"}
Jul 28 17:25:41.739898 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.739584    2574 scope.go:117] "RemoveContainer" containerID="b12d28707088d839d37318964cbd331e10c7da224ff58df431aded7c3f14a24a"
Jul 28 17:25:41.760129 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.760098    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c4fcd685f-jqqvm"]
Jul 28 17:25:41.764906 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:41.764878    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c4fcd685f-jqqvm"]
Jul 28 17:25:43.147531 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:43.147499    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71095130-c734-4194-acb6-12d764fd6b28" path="/var/lib/kubelet/pods/71095130-c734-4194-acb6-12d764fd6b28/volumes"
Jul 28 17:25:50.757617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:50.757519    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:50.857715 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:25:50.857670    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:00.675421 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:00.675386    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:00.773223 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:00.773175    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:00.904589 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:00.904549    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:01.137311 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.137275    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"]
Jul 28 17:26:01.137685 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.137672    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71095130-c734-4194-acb6-12d764fd6b28" containerName="console"
Jul 28 17:26:01.137739 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.137686    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="71095130-c734-4194-acb6-12d764fd6b28" containerName="console"
Jul 28 17:26:01.137777 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.137756    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="71095130-c734-4194-acb6-12d764fd6b28" containerName="console"
Jul 28 17:26:01.142355 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.142333    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:01.145347 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.145305    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cbt59\""
Jul 28 17:26:01.145347 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.145347    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 17:26:01.151265 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.151238    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"]
Jul 28 17:26:01.164956 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.164914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff4z7\" (UniqueName: \"kubernetes.io/projected/855336d4-cccc-4ef1-9452-37086fb23276-kube-api-access-ff4z7\") pod \"limitador-limitador-85d9db4d5d-5xp74\" (UID: \"855336d4-cccc-4ef1-9452-37086fb23276\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:01.164956 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.164975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/855336d4-cccc-4ef1-9452-37086fb23276-config-file\") pod \"limitador-limitador-85d9db4d5d-5xp74\" (UID: \"855336d4-cccc-4ef1-9452-37086fb23276\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:01.184864 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.184832    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"]
Jul 28 17:26:01.265865 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.265826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff4z7\" (UniqueName: \"kubernetes.io/projected/855336d4-cccc-4ef1-9452-37086fb23276-kube-api-access-ff4z7\") pod \"limitador-limitador-85d9db4d5d-5xp74\" (UID: \"855336d4-cccc-4ef1-9452-37086fb23276\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:01.265865 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.265869    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/855336d4-cccc-4ef1-9452-37086fb23276-config-file\") pod \"limitador-limitador-85d9db4d5d-5xp74\" (UID: \"855336d4-cccc-4ef1-9452-37086fb23276\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:01.266595 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.266576    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/855336d4-cccc-4ef1-9452-37086fb23276-config-file\") pod \"limitador-limitador-85d9db4d5d-5xp74\" (UID: \"855336d4-cccc-4ef1-9452-37086fb23276\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:01.274621 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.274597    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff4z7\" (UniqueName: \"kubernetes.io/projected/855336d4-cccc-4ef1-9452-37086fb23276-kube-api-access-ff4z7\") pod \"limitador-limitador-85d9db4d5d-5xp74\" (UID: \"855336d4-cccc-4ef1-9452-37086fb23276\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:01.455676 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.455592    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:01.593496 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.593468    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"]
Jul 28 17:26:01.595393 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:26:01.595363    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod855336d4_cccc_4ef1_9452_37086fb23276.slice/crio-f8820bee1012415190dca7e49f23c96be77f5b64c4b0debd82bec888cd958c71 WatchSource:0}: Error finding container f8820bee1012415190dca7e49f23c96be77f5b64c4b0debd82bec888cd958c71: Status 404 returned error can't find the container with id f8820bee1012415190dca7e49f23c96be77f5b64c4b0debd82bec888cd958c71
Jul 28 17:26:01.595850 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.595827    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-f9z6l"]
Jul 28 17:26:01.599524 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.599501    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:01.600379 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.600360    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-f9z6l"
Jul 28 17:26:01.603338 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.603310    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jwzhh\""
Jul 28 17:26:01.607041 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.607016    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-f9z6l"]
Jul 28 17:26:01.669394 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.669360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtrk7\" (UniqueName: \"kubernetes.io/projected/cb526656-d27a-4893-84b4-490eda588c9e-kube-api-access-gtrk7\") pod \"authorino-c548b5d7d-f9z6l\" (UID: \"cb526656-d27a-4893-84b4-490eda588c9e\") " pod="kuadrant-system/authorino-c548b5d7d-f9z6l"
Jul 28 17:26:01.730631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.730526    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:01.770774 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.770737    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtrk7\" (UniqueName: \"kubernetes.io/projected/cb526656-d27a-4893-84b4-490eda588c9e-kube-api-access-gtrk7\") pod \"authorino-c548b5d7d-f9z6l\" (UID: \"cb526656-d27a-4893-84b4-490eda588c9e\") " pod="kuadrant-system/authorino-c548b5d7d-f9z6l"
Jul 28 17:26:01.780086 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.780048    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtrk7\" (UniqueName: \"kubernetes.io/projected/cb526656-d27a-4893-84b4-490eda588c9e-kube-api-access-gtrk7\") pod \"authorino-c548b5d7d-f9z6l\" (UID: \"cb526656-d27a-4893-84b4-490eda588c9e\") " pod="kuadrant-system/authorino-c548b5d7d-f9z6l"
Jul 28 17:26:01.846237 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.846208    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74" event={"ID":"855336d4-cccc-4ef1-9452-37086fb23276","Type":"ContainerStarted","Data":"f8820bee1012415190dca7e49f23c96be77f5b64c4b0debd82bec888cd958c71"}
Jul 28 17:26:01.930629 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:01.930595    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-f9z6l"
Jul 28 17:26:02.063374 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:02.063345    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-f9z6l"]
Jul 28 17:26:02.065466 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:26:02.065439    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb526656_d27a_4893_84b4_490eda588c9e.slice/crio-c364276279099a1d078b6be31a6470b74fab83e4746eccdf1a1be840f53b9f21 WatchSource:0}: Error finding container c364276279099a1d078b6be31a6470b74fab83e4746eccdf1a1be840f53b9f21: Status 404 returned error can't find the container with id c364276279099a1d078b6be31a6470b74fab83e4746eccdf1a1be840f53b9f21
Jul 28 17:26:02.852907 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:02.852804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74" event={"ID":"855336d4-cccc-4ef1-9452-37086fb23276","Type":"ContainerStarted","Data":"dc77cf16c5f3454594d6060303f5405a4efc7af42102064724b22f8cf53cc13b"}
Jul 28 17:26:02.852907 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:02.852875    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:02.854018 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:02.854000    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-f9z6l" event={"ID":"cb526656-d27a-4893-84b4-490eda588c9e","Type":"ContainerStarted","Data":"c364276279099a1d078b6be31a6470b74fab83e4746eccdf1a1be840f53b9f21"}
Jul 28 17:26:02.877871 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:02.877819    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74" podStartSLOduration=0.925280862 podStartE2EDuration="1.877801487s" totalImagesPullingTime="952.520625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:26:02.876592819 +0000 UTC m=+550.304372040" watchObservedRunningTime="2026-07-28 17:26:02.877801487 +0000 UTC m=+550.305580725"
Jul 28 17:26:04.870147 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:04.870112    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-f9z6l" event={"ID":"cb526656-d27a-4893-84b4-490eda588c9e","Type":"ContainerStarted","Data":"fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e"}
Jul 28 17:26:04.887958 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:04.887909    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-f9z6l" podStartSLOduration=1.675633508 podStartE2EDuration="3.887894439s" totalImagesPullingTime="2.212260931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:26:04.886501806 +0000 UTC m=+552.314281054" watchObservedRunningTime="2026-07-28 17:26:04.887894439 +0000 UTC m=+552.315673676"
Jul 28 17:26:08.563580 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:08.563542    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:13.862162 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:13.862123    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5xp74"
Jul 28 17:26:19.940735 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:19.940701    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:20.277857 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:20.277824    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:26.497890 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.497847    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-f9z6l"]
Jul 28 17:26:26.498643 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.498502    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-f9z6l" podUID="cb526656-d27a-4893-84b4-490eda588c9e" containerName="authorino" containerID="cri-o://fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e" gracePeriod=30
Jul 28 17:26:26.752614 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.752549    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-f9z6l"
Jul 28 17:26:26.903483 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.903454    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtrk7\" (UniqueName: \"kubernetes.io/projected/cb526656-d27a-4893-84b4-490eda588c9e-kube-api-access-gtrk7\") pod \"cb526656-d27a-4893-84b4-490eda588c9e\" (UID: \"cb526656-d27a-4893-84b4-490eda588c9e\") "
Jul 28 17:26:26.905717 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.905692    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb526656-d27a-4893-84b4-490eda588c9e-kube-api-access-gtrk7" (OuterVolumeSpecName: "kube-api-access-gtrk7") pod "cb526656-d27a-4893-84b4-490eda588c9e" (UID: "cb526656-d27a-4893-84b4-490eda588c9e"). InnerVolumeSpecName "kube-api-access-gtrk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:26:26.993646 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.993608    2574 generic.go:356] "Generic (PLEG): container finished" podID="cb526656-d27a-4893-84b4-490eda588c9e" containerID="fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e" exitCode=0
Jul 28 17:26:26.993646 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.993649    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-f9z6l"
Jul 28 17:26:26.993874 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.993699    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-f9z6l" event={"ID":"cb526656-d27a-4893-84b4-490eda588c9e","Type":"ContainerDied","Data":"fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e"}
Jul 28 17:26:26.993874 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.993738    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-f9z6l" event={"ID":"cb526656-d27a-4893-84b4-490eda588c9e","Type":"ContainerDied","Data":"c364276279099a1d078b6be31a6470b74fab83e4746eccdf1a1be840f53b9f21"}
Jul 28 17:26:26.993874 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:26.993757    2574 scope.go:117] "RemoveContainer" containerID="fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e"
Jul 28 17:26:27.003006 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:27.002986    2574 scope.go:117] "RemoveContainer" containerID="fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e"
Jul 28 17:26:27.003326 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:26:27.003305    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e\": container with ID starting with fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e not found: ID does not exist" containerID="fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e"
Jul 28 17:26:27.003411 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:27.003335    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e"} err="failed to get container status \"fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e\": rpc error: code = NotFound desc = could not find container \"fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e\": container with ID starting with fb47472cf727bde202a3e874c5364004946e38cdc031e6e746b42f76470dbb3e not found: ID does not exist"
Jul 28 17:26:27.004707 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:27.004685    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtrk7\" (UniqueName: \"kubernetes.io/projected/cb526656-d27a-4893-84b4-490eda588c9e-kube-api-access-gtrk7\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:26:27.017795 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:27.017770    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-f9z6l"]
Jul 28 17:26:27.021485 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:27.021462    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-f9z6l"]
Jul 28 17:26:27.147448 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:27.147409    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb526656-d27a-4893-84b4-490eda588c9e" path="/var/lib/kubelet/pods/cb526656-d27a-4893-84b4-490eda588c9e/volumes"
Jul 28 17:26:31.204302 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:31.204266    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:31.278777 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:31.278733    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:53.056136 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:53.056109    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:26:53.057771 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:26:53.057745    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:27:09.711674 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:27:09.711623    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:09.808998 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:27:09.808956    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:09.909558 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:27:09.909521    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:10.286358 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:27:10.286324    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:10.542119 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:27:10.542022    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:10.619959 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:27:10.619922    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:12.161113 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:27:12.161054    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:39.469538 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:27:39.469502    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:39.571632 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:27:39.571588    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:24.508607 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:28:24.508563    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:57.458019 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:28:57.457935    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:57.555484 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:28:57.555447    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:10.976082 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:10.976032    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:11.073913 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:11.073868    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:17.101060 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.099222    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"]
Jul 28 17:29:17.101060 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.100057    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb526656-d27a-4893-84b4-490eda588c9e" containerName="authorino"
Jul 28 17:29:17.101060 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.100103    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb526656-d27a-4893-84b4-490eda588c9e" containerName="authorino"
Jul 28 17:29:17.101060 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.100318    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb526656-d27a-4893-84b4-490eda588c9e" containerName="authorino"
Jul 28 17:29:17.105232 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.105201    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.110683 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.110658    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"kube-root-ca.crt\""
Jul 28 17:29:17.112170 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.112144    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"openshift-service-ca.crt\""
Jul 28 17:29:17.112273 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.112227    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"default-dockercfg-5bgfn\""
Jul 28 17:29:17.112330 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.112287    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-4f8df83c\"/\"fc-smoke-test-kserve-self-signed-certs\""
Jul 28 17:29:17.115918 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.115896    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"]
Jul 28 17:29:17.118126 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.118100    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-home\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.118228 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.118134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62k29\" (UniqueName: \"kubernetes.io/projected/5e7f5673-909c-4939-a13a-5af8dad0ea56-kube-api-access-62k29\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.118228 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.118159    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e7f5673-909c-4939-a13a-5af8dad0ea56-tls-certs\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.118335 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.118271    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-tmp-dir\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.118397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.118343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-dshm\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.118397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.118365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-model-cache\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.136432 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.136397    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:17.218980 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.218951    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-dshm\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.219216 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.218985    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-model-cache\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.219216 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.219046    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-home\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.219216 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.219086    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k29\" (UniqueName: \"kubernetes.io/projected/5e7f5673-909c-4939-a13a-5af8dad0ea56-kube-api-access-62k29\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.219216 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.219114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e7f5673-909c-4939-a13a-5af8dad0ea56-tls-certs\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.219432 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.219253    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-tmp-dir\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.219528 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.219498    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-home\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.219595 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.219543    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-model-cache\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.219595 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.219583    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-tmp-dir\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.221316 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.221299    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-dshm\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.221537 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.221517    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e7f5673-909c-4939-a13a-5af8dad0ea56-tls-certs\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.227927 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.227907    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62k29\" (UniqueName: \"kubernetes.io/projected/5e7f5673-909c-4939-a13a-5af8dad0ea56-kube-api-access-62k29\") pod \"fc-smoke-test-kserve-7f4687897-l8kz2\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") " pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.416589 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.416487    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:17.514360 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.514327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:17.562477 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.562455    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"]
Jul 28 17:29:17.563853 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:29:17.563827    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7f5673_909c_4939_a13a_5af8dad0ea56.slice/crio-12027c3f154a87dedd575624f5128d1915ea877a4d279850283fcbfe82ca1dc5 WatchSource:0}: Error finding container 12027c3f154a87dedd575624f5128d1915ea877a4d279850283fcbfe82ca1dc5: Status 404 returned error can't find the container with id 12027c3f154a87dedd575624f5128d1915ea877a4d279850283fcbfe82ca1dc5
Jul 28 17:29:17.565699 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.565683    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:29:17.897158 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:17.897117    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2" event={"ID":"5e7f5673-909c-4939-a13a-5af8dad0ea56","Type":"ContainerStarted","Data":"12027c3f154a87dedd575624f5128d1915ea877a4d279850283fcbfe82ca1dc5"}
Jul 28 17:29:20.916755 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:20.916716    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2" event={"ID":"5e7f5673-909c-4939-a13a-5af8dad0ea56","Type":"ContainerStarted","Data":"9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8"}
Jul 28 17:29:20.936739 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:20.936685    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2" podStartSLOduration=1.302378254 podStartE2EDuration="3.936668469s" totalImagesPullingTime="2.634290215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:29:20.935596576 +0000 UTC m=+748.363375817" watchObservedRunningTime="2026-07-28 17:29:20.936668469 +0000 UTC m=+748.364447706"
Jul 28 17:29:20.953991 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:20.953956    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:21.417386 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:21.417352    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:27.417338 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:27.417297    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:27.430185 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:27.430158    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:27.966825 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:27.966798    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:29:37.163506 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:37.163468    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:39.031214 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:39.031175    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:43.561544 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:43.561506    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:58.105080 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:29:58.105043    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:00.071125 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:00.071093    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:05.370049 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:05.370012    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"]
Jul 28 17:30:05.372668 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:05.372616    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:05.379534 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:30:05.379498    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 17:30:05.379534 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:30:05.379534 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:30:05.379534 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8" cmd=["/bin/sleep","15"]
Jul 28 17:30:05.379853 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:05.379553    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2" message="" err=<
Jul 28 17:30:05.379853 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:30:05.379853 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:30:05.379853 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 17:30:05.379853 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:30:05.379565    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 17:30:05.379853 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:30:05.379853 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:30:05.379853 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2" podUID="5e7f5673-909c-4939-a13a-5af8dad0ea56" containerName="main" containerID="cri-o://9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8"
Jul 28 17:30:05.379853 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:05.379610    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2" podUID="5e7f5673-909c-4939-a13a-5af8dad0ea56" containerName="main" containerID="cri-o://9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8" gracePeriod=60
Jul 28 17:30:05.442012 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:05.441974    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:05.956641 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:05.956594    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2" podUID="5e7f5673-909c-4939-a13a-5af8dad0ea56" containerName="main" probeResult="failure" output="Get \"https://10.133.0.42:8000/health\": dial tcp 10.133.0.42:8000: connect: connection refused"
Jul 28 17:30:06.125559 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.125534    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:30:06.154086 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.154042    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e7f5673-909c-4939-a13a-5af8dad0ea56-tls-certs\") pod \"5e7f5673-909c-4939-a13a-5af8dad0ea56\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") "
Jul 28 17:30:06.154266 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.154116    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62k29\" (UniqueName: \"kubernetes.io/projected/5e7f5673-909c-4939-a13a-5af8dad0ea56-kube-api-access-62k29\") pod \"5e7f5673-909c-4939-a13a-5af8dad0ea56\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") "
Jul 28 17:30:06.154266 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.154185    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-model-cache\") pod \"5e7f5673-909c-4939-a13a-5af8dad0ea56\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") "
Jul 28 17:30:06.154266 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.154216    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-home\") pod \"5e7f5673-909c-4939-a13a-5af8dad0ea56\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") "
Jul 28 17:30:06.154266 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.154236    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-dshm\") pod \"5e7f5673-909c-4939-a13a-5af8dad0ea56\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") "
Jul 28 17:30:06.154474 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.154272    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-tmp-dir\") pod \"5e7f5673-909c-4939-a13a-5af8dad0ea56\" (UID: \"5e7f5673-909c-4939-a13a-5af8dad0ea56\") "
Jul 28 17:30:06.154537 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.154504    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e7f5673-909c-4939-a13a-5af8dad0ea56" (UID: "5e7f5673-909c-4939-a13a-5af8dad0ea56"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:30:06.154749 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.154709    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-home" (OuterVolumeSpecName: "home") pod "5e7f5673-909c-4939-a13a-5af8dad0ea56" (UID: "5e7f5673-909c-4939-a13a-5af8dad0ea56"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:30:06.154749 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.154716    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e7f5673-909c-4939-a13a-5af8dad0ea56" (UID: "5e7f5673-909c-4939-a13a-5af8dad0ea56"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:30:06.157001 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.156969    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e7f5673-909c-4939-a13a-5af8dad0ea56-kube-api-access-62k29" (OuterVolumeSpecName: "kube-api-access-62k29") pod "5e7f5673-909c-4939-a13a-5af8dad0ea56" (UID: "5e7f5673-909c-4939-a13a-5af8dad0ea56"). InnerVolumeSpecName "kube-api-access-62k29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:30:06.157001 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.156981    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-dshm" (OuterVolumeSpecName: "dshm") pod "5e7f5673-909c-4939-a13a-5af8dad0ea56" (UID: "5e7f5673-909c-4939-a13a-5af8dad0ea56"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:30:06.157174 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.157019    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e7f5673-909c-4939-a13a-5af8dad0ea56-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e7f5673-909c-4939-a13a-5af8dad0ea56" (UID: "5e7f5673-909c-4939-a13a-5af8dad0ea56"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:30:06.167035 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.167005    2574 generic.go:356] "Generic (PLEG): container finished" podID="5e7f5673-909c-4939-a13a-5af8dad0ea56" containerID="9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8" exitCode=0
Jul 28 17:30:06.167142 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.167046    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"
Jul 28 17:30:06.167142 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.167101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2" event={"ID":"5e7f5673-909c-4939-a13a-5af8dad0ea56","Type":"ContainerDied","Data":"9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8"}
Jul 28 17:30:06.167221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.167168    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2" event={"ID":"5e7f5673-909c-4939-a13a-5af8dad0ea56","Type":"ContainerDied","Data":"12027c3f154a87dedd575624f5128d1915ea877a4d279850283fcbfe82ca1dc5"}
Jul 28 17:30:06.167221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.167202    2574 scope.go:117] "RemoveContainer" containerID="9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8"
Jul 28 17:30:06.176934 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.176917    2574 scope.go:117] "RemoveContainer" containerID="9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8"
Jul 28 17:30:06.177272 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:30:06.177250    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8\": container with ID starting with 9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8 not found: ID does not exist" containerID="9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8"
Jul 28 17:30:06.177329 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.177281    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8"} err="failed to get container status \"9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8\": rpc error: code = NotFound desc = could not find container \"9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8\": container with ID starting with 9fc719c077aa12cb3a28216ea90d13330ccdc9f813de53bb580716547fcd23e8 not found: ID does not exist"
Jul 28 17:30:06.190452 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.190418    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"]
Jul 28 17:30:06.194254 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.194227    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-flow-control-smoke-4f8df83c/fc-smoke-test-kserve-7f4687897-l8kz2"]
Jul 28 17:30:06.255417 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.255344    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:30:06.255417 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.255368    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:30:06.255417 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.255378    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:30:06.255417 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.255406    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e7f5673-909c-4939-a13a-5af8dad0ea56-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:30:06.255417 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.255415    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e7f5673-909c-4939-a13a-5af8dad0ea56-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:30:06.255684 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:06.255424    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62k29\" (UniqueName: \"kubernetes.io/projected/5e7f5673-909c-4939-a13a-5af8dad0ea56-kube-api-access-62k29\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:30:07.147803 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:07.147767    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e7f5673-909c-4939-a13a-5af8dad0ea56" path="/var/lib/kubelet/pods/5e7f5673-909c-4939-a13a-5af8dad0ea56/volumes"
Jul 28 17:30:25.418402 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:25.418312    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:25.512877 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:25.512838    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:28.305253 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.305215    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"]
Jul 28 17:30:28.306670 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.306643    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e7f5673-909c-4939-a13a-5af8dad0ea56" containerName="main"
Jul 28 17:30:28.306816 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.306805    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e7f5673-909c-4939-a13a-5af8dad0ea56" containerName="main"
Jul 28 17:30:28.307121 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.307106    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e7f5673-909c-4939-a13a-5af8dad0ea56" containerName="main"
Jul 28 17:30:28.311440 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.311417    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.315599 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.315575    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"fc-concurrency-test-kserve-self-signed-certs\""
Jul 28 17:30:28.315725 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.315634    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"default-dockercfg-vc5sh\""
Jul 28 17:30:28.315725 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.315651    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"openshift-service-ca.crt\""
Jul 28 17:30:28.315725 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.315721    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-flow-control-smoke-1e98f46d\"/\"kube-root-ca.crt\""
Jul 28 17:30:28.320756 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.320734    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"]
Jul 28 17:30:28.335891 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.335848    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:28.348002 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.347969    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-model-cache\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.348189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.348014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-dshm\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.348189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.348050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-tmp-dir\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.348189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.348123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-home\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.348189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.348176    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2b35393-a2bb-44e3-864f-a84d93686fd6-tls-certs\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.348382 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.348259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjbdg\" (UniqueName: \"kubernetes.io/projected/c2b35393-a2bb-44e3-864f-a84d93686fd6-kube-api-access-tjbdg\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.449180 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.449138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-model-cache\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.449180 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.449184    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-dshm\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.449438 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.449220    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-tmp-dir\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.449438 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.449265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-home\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.449438 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.449319    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2b35393-a2bb-44e3-864f-a84d93686fd6-tls-certs\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.449438 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.449370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjbdg\" (UniqueName: \"kubernetes.io/projected/c2b35393-a2bb-44e3-864f-a84d93686fd6-kube-api-access-tjbdg\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.449656 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.449594    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-model-cache\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.449714 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.449674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-tmp-dir\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.449755 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.449724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-home\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.451529 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.451511    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-dshm\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.451695 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.451678    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2b35393-a2bb-44e3-864f-a84d93686fd6-tls-certs\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.457929 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.457902    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjbdg\" (UniqueName: \"kubernetes.io/projected/c2b35393-a2bb-44e3-864f-a84d93686fd6-kube-api-access-tjbdg\") pod \"fc-concurrency-test-kserve-b5d44467c-zspzk\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") " pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.622967 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.622872    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:28.688020 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.687898    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:28.766493 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:28.766462    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"]
Jul 28 17:30:28.768139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:30:28.768103    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b35393_a2bb_44e3_864f_a84d93686fd6.slice/crio-6fc9f4f9281f7e8e58dc5e8a86648d723365e3fc3ee2e12f553c6d0e1efbfd73 WatchSource:0}: Error finding container 6fc9f4f9281f7e8e58dc5e8a86648d723365e3fc3ee2e12f553c6d0e1efbfd73: Status 404 returned error can't find the container with id 6fc9f4f9281f7e8e58dc5e8a86648d723365e3fc3ee2e12f553c6d0e1efbfd73
Jul 28 17:30:29.291315 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:29.291278    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk" event={"ID":"c2b35393-a2bb-44e3-864f-a84d93686fd6","Type":"ContainerStarted","Data":"1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53"}
Jul 28 17:30:29.291491 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:29.291336    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk" event={"ID":"c2b35393-a2bb-44e3-864f-a84d93686fd6","Type":"ContainerStarted","Data":"6fc9f4f9281f7e8e58dc5e8a86648d723365e3fc3ee2e12f553c6d0e1efbfd73"}
Jul 28 17:30:29.311741 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:29.311692    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk" podStartSLOduration=1.31167715 podStartE2EDuration="1.31167715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:30:29.309338096 +0000 UTC m=+816.737117370" watchObservedRunningTime="2026-07-28 17:30:29.31167715 +0000 UTC m=+816.739456387"
Jul 28 17:30:29.623911 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:29.623824    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:31.826811 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:31.826775    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:37.450726 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:37.450693    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:37.511766 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:37.511730    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:38.623244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:38.623205    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:38.637106 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:38.637081    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:39.357598 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:39.357568    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:30:45.083714 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:45.083682    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:53.891012 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:53.890974    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:53.992057 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:30:53.992024    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:07.411353 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:07.411316    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:07.422191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:07.422159    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"]
Jul 28 17:31:07.432627 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:07.432591    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 17:31:07.432627 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:31:07.432627 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:31:07.432627 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53" cmd=["/bin/sleep","15"]
Jul 28 17:31:07.432930 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:07.432642    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk" message="" err=<
Jul 28 17:31:07.432930 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:31:07.432930 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:31:07.432930 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 17:31:07.432930 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:07.432654    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 17:31:07.432930 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:31:07.432930 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:31:07.432930 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk" podUID="c2b35393-a2bb-44e3-864f-a84d93686fd6" containerName="main" containerID="cri-o://1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53"
Jul 28 17:31:07.432930 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:07.432689    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk" podUID="c2b35393-a2bb-44e3-864f-a84d93686fd6" containerName="main" containerID="cri-o://1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53" gracePeriod=60
Jul 28 17:31:07.464572 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:07.464528    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:08.184902 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.184878    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:31:08.205880 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.205847    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2b35393-a2bb-44e3-864f-a84d93686fd6-tls-certs\") pod \"c2b35393-a2bb-44e3-864f-a84d93686fd6\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") "
Jul 28 17:31:08.206051 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.205903    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-dshm\") pod \"c2b35393-a2bb-44e3-864f-a84d93686fd6\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") "
Jul 28 17:31:08.206051 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.205930    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-home\") pod \"c2b35393-a2bb-44e3-864f-a84d93686fd6\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") "
Jul 28 17:31:08.206051 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.205967    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-model-cache\") pod \"c2b35393-a2bb-44e3-864f-a84d93686fd6\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") "
Jul 28 17:31:08.206051 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.205991    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjbdg\" (UniqueName: \"kubernetes.io/projected/c2b35393-a2bb-44e3-864f-a84d93686fd6-kube-api-access-tjbdg\") pod \"c2b35393-a2bb-44e3-864f-a84d93686fd6\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") "
Jul 28 17:31:08.206302 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.206087    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-tmp-dir\") pod \"c2b35393-a2bb-44e3-864f-a84d93686fd6\" (UID: \"c2b35393-a2bb-44e3-864f-a84d93686fd6\") "
Jul 28 17:31:08.206373 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.206320    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-model-cache" (OuterVolumeSpecName: "model-cache") pod "c2b35393-a2bb-44e3-864f-a84d93686fd6" (UID: "c2b35393-a2bb-44e3-864f-a84d93686fd6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:31:08.206665 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.206600    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:08.206881 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.206845    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-home" (OuterVolumeSpecName: "home") pod "c2b35393-a2bb-44e3-864f-a84d93686fd6" (UID: "c2b35393-a2bb-44e3-864f-a84d93686fd6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:31:08.207262 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.207225    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c2b35393-a2bb-44e3-864f-a84d93686fd6" (UID: "c2b35393-a2bb-44e3-864f-a84d93686fd6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:31:08.208626 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.208592    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-dshm" (OuterVolumeSpecName: "dshm") pod "c2b35393-a2bb-44e3-864f-a84d93686fd6" (UID: "c2b35393-a2bb-44e3-864f-a84d93686fd6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:31:08.208626 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.208611    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b35393-a2bb-44e3-864f-a84d93686fd6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c2b35393-a2bb-44e3-864f-a84d93686fd6" (UID: "c2b35393-a2bb-44e3-864f-a84d93686fd6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:31:08.209231 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.209201    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b35393-a2bb-44e3-864f-a84d93686fd6-kube-api-access-tjbdg" (OuterVolumeSpecName: "kube-api-access-tjbdg") pod "c2b35393-a2bb-44e3-864f-a84d93686fd6" (UID: "c2b35393-a2bb-44e3-864f-a84d93686fd6"). InnerVolumeSpecName "kube-api-access-tjbdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:31:08.307702 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.307614    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2b35393-a2bb-44e3-864f-a84d93686fd6-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:08.307702 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.307643    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:08.307702 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.307651    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:08.307702 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.307659    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjbdg\" (UniqueName: \"kubernetes.io/projected/c2b35393-a2bb-44e3-864f-a84d93686fd6-kube-api-access-tjbdg\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:08.307702 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.307668    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2b35393-a2bb-44e3-864f-a84d93686fd6-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:08.498885 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.498852    2574 generic.go:356] "Generic (PLEG): container finished" podID="c2b35393-a2bb-44e3-864f-a84d93686fd6" containerID="1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53" exitCode=0
Jul 28 17:31:08.499323 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.498940    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk" event={"ID":"c2b35393-a2bb-44e3-864f-a84d93686fd6","Type":"ContainerDied","Data":"1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53"}
Jul 28 17:31:08.499323 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.499005    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk" event={"ID":"c2b35393-a2bb-44e3-864f-a84d93686fd6","Type":"ContainerDied","Data":"6fc9f4f9281f7e8e58dc5e8a86648d723365e3fc3ee2e12f553c6d0e1efbfd73"}
Jul 28 17:31:08.499323 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.498956    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"
Jul 28 17:31:08.499323 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.499034    2574 scope.go:117] "RemoveContainer" containerID="1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53"
Jul 28 17:31:08.510006 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.509987    2574 scope.go:117] "RemoveContainer" containerID="1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53"
Jul 28 17:31:08.510355 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:08.510323    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53\": container with ID starting with 1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53 not found: ID does not exist" containerID="1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53"
Jul 28 17:31:08.510464 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.510362    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53"} err="failed to get container status \"1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53\": rpc error: code = NotFound desc = could not find container \"1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53\": container with ID starting with 1a2e05a9cc7cee00548f95523217f6fb7bc37840b8f97289be89caa34947ad53 not found: ID does not exist"
Jul 28 17:31:08.521621 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.521590    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"]
Jul 28 17:31:08.524787 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:08.524762    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-flow-control-smoke-1e98f46d/fc-concurrency-test-kserve-b5d44467c-zspzk"]
Jul 28 17:31:09.147663 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:09.147631    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b35393-a2bb-44e3-864f-a84d93686fd6" path="/var/lib/kubelet/pods/c2b35393-a2bb-44e3-864f-a84d93686fd6/volumes"
Jul 28 17:31:27.455401 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:27.455357    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:27.558194 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:27.558155    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:27.658033 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:27.658004    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:27.793287 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:27.793238    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:27.875867 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:27.875833    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:32.368674 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:32.368632    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:33.976397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:33.976340    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:39.833937 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:39.833900    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:39.934128 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:39.934064    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:53.097896 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.097801    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:31:53.098562 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.098543    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:31:53.896506 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.896466    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"]
Jul 28 17:31:53.896938 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.896918    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b35393-a2bb-44e3-864f-a84d93686fd6" containerName="main"
Jul 28 17:31:53.897034 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.896939    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b35393-a2bb-44e3-864f-a84d93686fd6" containerName="main"
Jul 28 17:31:53.897106 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.897094    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b35393-a2bb-44e3-864f-a84d93686fd6" containerName="main"
Jul 28 17:31:53.901056 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.901032    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:53.905263 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.905237    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-49b5edd9\"/\"openshift-service-ca.crt\""
Jul 28 17:31:53.905263 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.905254    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-gateway-section-name-propagation-49b5edd9\"/\"default-dockercfg-hzzz6\""
Jul 28 17:31:53.905432 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.905239    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-gateway-section-name-propagation-49b5edd9\"/\"gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs\""
Jul 28 17:31:53.905432 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.905322    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-49b5edd9\"/\"kube-root-ca.crt\""
Jul 28 17:31:53.910873 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.910846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:53.910993 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.910898    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:53.910993 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.910938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdtgg\" (UniqueName: \"kubernetes.io/projected/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-kube-api-access-rdtgg\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:53.910993 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.910967    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:53.911216 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.911035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:53.911216 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.911111    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:53.912160 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.912141    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"]
Jul 28 17:31:53.927483 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:53.927449    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:54.011742 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.011711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.011941 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.011749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.011941 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.011783    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdtgg\" (UniqueName: \"kubernetes.io/projected/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-kube-api-access-rdtgg\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.011941 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.011900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.012179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.011943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.012179 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.011983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.012297 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.012218    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-model-cache\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.012334 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.012309    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-home\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.012383 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.012366    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tmp-dir\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.014026 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.014008    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-dshm\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.014485 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.014465    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.019510 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.019493    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdtgg\" (UniqueName: \"kubernetes.io/projected/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-kube-api-access-rdtgg\") pod \"gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") " pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.213152 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.213028    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:54.362183 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.362152    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"]
Jul 28 17:31:54.364229 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:31:54.364206    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e905e58_4c23_4c85_9fc3_8f79e7925fe8.slice/crio-6d986869b0b290238bb100176d6a8e5f0221059b45834df1cb96afe2e7bc01d2 WatchSource:0}: Error finding container 6d986869b0b290238bb100176d6a8e5f0221059b45834df1cb96afe2e7bc01d2: Status 404 returned error can't find the container with id 6d986869b0b290238bb100176d6a8e5f0221059b45834df1cb96afe2e7bc01d2
Jul 28 17:31:54.753257 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.753219    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" event={"ID":"4e905e58-4c23-4c85-9fc3-8f79e7925fe8","Type":"ContainerStarted","Data":"4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79"}
Jul 28 17:31:54.753423 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.753284    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" event={"ID":"4e905e58-4c23-4c85-9fc3-8f79e7925fe8","Type":"ContainerStarted","Data":"6d986869b0b290238bb100176d6a8e5f0221059b45834df1cb96afe2e7bc01d2"}
Jul 28 17:31:54.772140 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:54.772087    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" podStartSLOduration=1.7720530719999998 podStartE2EDuration="1.772053072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:31:54.771168201 +0000 UTC m=+902.198947440" watchObservedRunningTime="2026-07-28 17:31:54.772053072 +0000 UTC m=+902.199832309"
Jul 28 17:31:55.213842 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:55.213803    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:56.044274 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:56.044236    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:56.148776 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:56.148741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:56.254588 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:56.254553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:56.307993 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:56.307907    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"]
Jul 28 17:31:56.389218 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:56.389181    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:56.502490 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:56.502456    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:31:56.833926 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:56.833889    2574 secret.go:189] Couldn't get secret e2e-test-gateway-section-name-propagation-49b5edd9/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs: secret "gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs" not found
Jul 28 17:31:56.834177 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:56.833969    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs podName:4e905e58-4c23-4c85-9fc3-8f79e7925fe8 nodeName:}" failed. No retries permitted until 2026-07-28 17:31:57.333947681 +0000 UTC m=+904.761726899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs") pod "gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" (UID: "4e905e58-4c23-4c85-9fc3-8f79e7925fe8") : secret "gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs" not found
Jul 28 17:31:57.337325 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:57.337251    2574 secret.go:189] Couldn't get secret e2e-test-gateway-section-name-propagation-49b5edd9/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs: secret "gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs" not found
Jul 28 17:31:57.337325 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:57.337329    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs podName:4e905e58-4c23-4c85-9fc3-8f79e7925fe8 nodeName:}" failed. No retries permitted until 2026-07-28 17:31:58.337312842 +0000 UTC m=+905.765092062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs") pod "gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" (UID: "4e905e58-4c23-4c85-9fc3-8f79e7925fe8") : secret "gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs" not found
Jul 28 17:31:57.784830 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:57.784766    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 17:31:57.784830 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:31:57.784830 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:31:57.784830 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79" cmd=["/bin/sleep","15"]
Jul 28 17:31:57.785122 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:57.784875    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" message="" err=<
Jul 28 17:31:57.785122 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:31:57.785122 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:31:57.785122 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 17:31:57.785122 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:57.784904    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 17:31:57.785122 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:31:57.785122 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:31:57.785122 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" podUID="4e905e58-4c23-4c85-9fc3-8f79e7925fe8" containerName="main" containerID="cri-o://4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79"
Jul 28 17:31:57.785122 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:57.784981    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" podUID="4e905e58-4c23-4c85-9fc3-8f79e7925fe8" containerName="main" containerID="cri-o://4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79" gracePeriod=60
Jul 28 17:31:58.040833 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.040765    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:58.042860 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.042838    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-home\") pod \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") "
Jul 28 17:31:58.042992 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.042875    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs\") pod \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") "
Jul 28 17:31:58.042992 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.042929    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-dshm\") pod \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") "
Jul 28 17:31:58.042992 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.042961    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdtgg\" (UniqueName: \"kubernetes.io/projected/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-kube-api-access-rdtgg\") pod \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") "
Jul 28 17:31:58.043203 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.043026    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-model-cache\") pod \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") "
Jul 28 17:31:58.043203 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.043052    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tmp-dir\") pod \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\" (UID: \"4e905e58-4c23-4c85-9fc3-8f79e7925fe8\") "
Jul 28 17:31:58.043203 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.043062    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-home" (OuterVolumeSpecName: "home") pod "4e905e58-4c23-4c85-9fc3-8f79e7925fe8" (UID: "4e905e58-4c23-4c85-9fc3-8f79e7925fe8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:31:58.043346 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.043300    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-model-cache" (OuterVolumeSpecName: "model-cache") pod "4e905e58-4c23-4c85-9fc3-8f79e7925fe8" (UID: "4e905e58-4c23-4c85-9fc3-8f79e7925fe8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:31:58.043346 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.043319    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:58.043346 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.043327    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4e905e58-4c23-4c85-9fc3-8f79e7925fe8" (UID: "4e905e58-4c23-4c85-9fc3-8f79e7925fe8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:31:58.045408 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.045381    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-kube-api-access-rdtgg" (OuterVolumeSpecName: "kube-api-access-rdtgg") pod "4e905e58-4c23-4c85-9fc3-8f79e7925fe8" (UID: "4e905e58-4c23-4c85-9fc3-8f79e7925fe8"). InnerVolumeSpecName "kube-api-access-rdtgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:31:58.045408 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.045388    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4e905e58-4c23-4c85-9fc3-8f79e7925fe8" (UID: "4e905e58-4c23-4c85-9fc3-8f79e7925fe8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:31:58.045561 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.045511    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-dshm" (OuterVolumeSpecName: "dshm") pod "4e905e58-4c23-4c85-9fc3-8f79e7925fe8" (UID: "4e905e58-4c23-4c85-9fc3-8f79e7925fe8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:31:58.144455 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.144419    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:58.144455 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.144449    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdtgg\" (UniqueName: \"kubernetes.io/projected/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-kube-api-access-rdtgg\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:58.144455 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.144459    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:58.144712 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.144470    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:58.144712 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.144477    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e905e58-4c23-4c85-9fc3-8f79e7925fe8-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:31:58.776164 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.776133    2574 generic.go:356] "Generic (PLEG): container finished" podID="4e905e58-4c23-4c85-9fc3-8f79e7925fe8" containerID="4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79" exitCode=0
Jul 28 17:31:58.776631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.776181    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"
Jul 28 17:31:58.776631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.776227    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" event={"ID":"4e905e58-4c23-4c85-9fc3-8f79e7925fe8","Type":"ContainerDied","Data":"4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79"}
Jul 28 17:31:58.776631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.776280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl" event={"ID":"4e905e58-4c23-4c85-9fc3-8f79e7925fe8","Type":"ContainerDied","Data":"6d986869b0b290238bb100176d6a8e5f0221059b45834df1cb96afe2e7bc01d2"}
Jul 28 17:31:58.776631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.776303    2574 scope.go:117] "RemoveContainer" containerID="4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79"
Jul 28 17:31:58.786028 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.785890    2574 scope.go:117] "RemoveContainer" containerID="4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79"
Jul 28 17:31:58.786218 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:31:58.786200    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79\": container with ID starting with 4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79 not found: ID does not exist" containerID="4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79"
Jul 28 17:31:58.786265 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.786227    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79"} err="failed to get container status \"4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79\": rpc error: code = NotFound desc = could not find container \"4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79\": container with ID starting with 4af98b1ac274e50d9c3f4b223a15e36128a84de0e2b1d2569f5d179d2d66de79 not found: ID does not exist"
Jul 28 17:31:58.801798 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.801768    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"]
Jul 28 17:31:58.807690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:58.807666    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-gateway-section-name-propagation-49b5edd9/gw-section-name-router-with-gat-2f0a622e-kserve-8dc8c8494-rzqbl"]
Jul 28 17:31:59.147753 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:31:59.147670    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e905e58-4c23-4c85-9fc3-8f79e7925fe8" path="/var/lib/kubelet/pods/4e905e58-4c23-4c85-9fc3-8f79e7925fe8/volumes"
Jul 28 17:32:00.105916 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:00.105885    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:01.139119 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:01.139084    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:06.694912 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:06.694876    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:07.154218 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:07.154187    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:12.953518 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.953481    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"]
Jul 28 17:32:12.955784 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.953889    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e905e58-4c23-4c85-9fc3-8f79e7925fe8" containerName="main"
Jul 28 17:32:12.955784 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.953904    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e905e58-4c23-4c85-9fc3-8f79e7925fe8" containerName="main"
Jul 28 17:32:12.955784 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.953980    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e905e58-4c23-4c85-9fc3-8f79e7925fe8" containerName="main"
Jul 28 17:32:12.956824 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.956808    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:12.965020 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.964997    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"kube-root-ca.crt\""
Jul 28 17:32:12.965181 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.965161    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"default-dockercfg-xsb57\""
Jul 28 17:32:12.966100 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.966059    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"openshift-service-ca.crt\""
Jul 28 17:32:12.966454 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.966440    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs\""
Jul 28 17:32:12.984380 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:12.984350    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"]
Jul 28 17:32:13.034811 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.034768    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:13.079895 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.079858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj2fp\" (UniqueName: \"kubernetes.io/projected/37139c8b-d433-471f-b1ab-b6c9b6fad092-kube-api-access-gj2fp\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.080117 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.079927    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.080117 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.080039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.080213 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.080117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.080213 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.080172    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.080213 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.080208    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.180837 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.180797    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.180837 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.180842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.181132 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.180980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.181132 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.181035    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.181132 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.181085    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj2fp\" (UniqueName: \"kubernetes.io/projected/37139c8b-d433-471f-b1ab-b6c9b6fad092-kube-api-access-gj2fp\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.181294 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.181153    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.181294 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.181248    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-model-cache\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.181400 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.181341    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-home\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.181400 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.181377    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-tmp-dir\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.183252 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.183223    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-dshm\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.183498 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.183483    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.189110 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.189088    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj2fp\" (UniqueName: \"kubernetes.io/projected/37139c8b-d433-471f-b1ab-b6c9b6fad092-kube-api-access-gj2fp\") pod \"gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") " pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.266469 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.266438    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:13.303234 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.303198    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:13.422901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.422864    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"]
Jul 28 17:32:13.424028 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:32:13.423998    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37139c8b_d433_471f_b1ab_b6c9b6fad092.slice/crio-ac1130dbec6d89283234145fa5183f5c4963a1aacb87bcebc09f68813dfbbe24 WatchSource:0}: Error finding container ac1130dbec6d89283234145fa5183f5c4963a1aacb87bcebc09f68813dfbbe24: Status 404 returned error can't find the container with id ac1130dbec6d89283234145fa5183f5c4963a1aacb87bcebc09f68813dfbbe24
Jul 28 17:32:13.865617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.865575    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" event={"ID":"37139c8b-d433-471f-b1ab-b6c9b6fad092","Type":"ContainerStarted","Data":"b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d"}
Jul 28 17:32:13.865826 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.865634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" event={"ID":"37139c8b-d433-471f-b1ab-b6c9b6fad092","Type":"ContainerStarted","Data":"ac1130dbec6d89283234145fa5183f5c4963a1aacb87bcebc09f68813dfbbe24"}
Jul 28 17:32:13.883509 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:13.883459    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" podStartSLOduration=1.883441428 podStartE2EDuration="1.883441428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:32:13.882187899 +0000 UTC m=+921.309967137" watchObservedRunningTime="2026-07-28 17:32:13.883441428 +0000 UTC m=+921.311220723"
Jul 28 17:32:14.266669 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:14.266643    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:15.154670 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:15.154639    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:15.248130 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:15.248098    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:15.341164 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:15.341128    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"]
Jul 28 17:32:15.370878 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:15.370845    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:16.008171 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:32:16.008123    2574 secret.go:189] Couldn't get secret e2e-test-gateway-section-name-propagation-94799d44/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 28 17:32:16.008370 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:32:16.008209    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs podName:37139c8b-d433-471f-b1ab-b6c9b6fad092 nodeName:}" failed. No retries permitted until 2026-07-28 17:32:16.5081917 +0000 UTC m=+923.935970919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" (UID: "37139c8b-d433-471f-b1ab-b6c9b6fad092") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 28 17:32:16.513450 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:32:16.513405    2574 secret.go:189] Couldn't get secret e2e-test-gateway-section-name-propagation-94799d44/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs: secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 28 17:32:16.513864 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:32:16.513487    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs podName:37139c8b-d433-471f-b1ab-b6c9b6fad092 nodeName:}" failed. No retries permitted until 2026-07-28 17:32:17.513471716 +0000 UTC m=+924.941250933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs") pod "gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" (UID: "37139c8b-d433-471f-b1ab-b6c9b6fad092") : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:32:16.890219    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d" cmd=["/bin/sleep","15"]
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:16.890270    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" message="" err=<
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:32:16.890281    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:32:16.890306 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" podUID="37139c8b-d433-471f-b1ab-b6c9b6fad092" containerName="main" containerID="cri-o://b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d"
Jul 28 17:32:16.890786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:16.890319    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" podUID="37139c8b-d433-471f-b1ab-b6c9b6fad092" containerName="main" containerID="cri-o://b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d" gracePeriod=60
Jul 28 17:32:17.247936 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.247911    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:17.321971 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.321933    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs\") pod \"37139c8b-d433-471f-b1ab-b6c9b6fad092\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") "
Jul 28 17:32:17.321971 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.321977    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-home\") pod \"37139c8b-d433-471f-b1ab-b6c9b6fad092\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") "
Jul 28 17:32:17.322244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.322188    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-dshm\") pod \"37139c8b-d433-471f-b1ab-b6c9b6fad092\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") "
Jul 28 17:32:17.322244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.322225    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-tmp-dir\") pod \"37139c8b-d433-471f-b1ab-b6c9b6fad092\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") "
Jul 28 17:32:17.322351 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.322238    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-home" (OuterVolumeSpecName: "home") pod "37139c8b-d433-471f-b1ab-b6c9b6fad092" (UID: "37139c8b-d433-471f-b1ab-b6c9b6fad092"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:32:17.322351 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.322273    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj2fp\" (UniqueName: \"kubernetes.io/projected/37139c8b-d433-471f-b1ab-b6c9b6fad092-kube-api-access-gj2fp\") pod \"37139c8b-d433-471f-b1ab-b6c9b6fad092\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") "
Jul 28 17:32:17.322351 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.322323    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-model-cache\") pod \"37139c8b-d433-471f-b1ab-b6c9b6fad092\" (UID: \"37139c8b-d433-471f-b1ab-b6c9b6fad092\") "
Jul 28 17:32:17.322514 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.322450    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "37139c8b-d433-471f-b1ab-b6c9b6fad092" (UID: "37139c8b-d433-471f-b1ab-b6c9b6fad092"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:32:17.322663 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.322639    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-model-cache" (OuterVolumeSpecName: "model-cache") pod "37139c8b-d433-471f-b1ab-b6c9b6fad092" (UID: "37139c8b-d433-471f-b1ab-b6c9b6fad092"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:32:17.322736 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.322660    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:32:17.322736 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.322680    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:32:17.324282 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.324252    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "37139c8b-d433-471f-b1ab-b6c9b6fad092" (UID: "37139c8b-d433-471f-b1ab-b6c9b6fad092"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:32:17.324426 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.324411    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-dshm" (OuterVolumeSpecName: "dshm") pod "37139c8b-d433-471f-b1ab-b6c9b6fad092" (UID: "37139c8b-d433-471f-b1ab-b6c9b6fad092"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:32:17.324519 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.324503    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37139c8b-d433-471f-b1ab-b6c9b6fad092-kube-api-access-gj2fp" (OuterVolumeSpecName: "kube-api-access-gj2fp") pod "37139c8b-d433-471f-b1ab-b6c9b6fad092" (UID: "37139c8b-d433-471f-b1ab-b6c9b6fad092"). InnerVolumeSpecName "kube-api-access-gj2fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:32:17.423243 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.423151    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:32:17.423243 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.423182    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37139c8b-d433-471f-b1ab-b6c9b6fad092-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:32:17.423243 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.423191    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37139c8b-d433-471f-b1ab-b6c9b6fad092-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:32:17.423243 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.423199    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj2fp\" (UniqueName: \"kubernetes.io/projected/37139c8b-d433-471f-b1ab-b6c9b6fad092-kube-api-access-gj2fp\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:32:17.887559 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.887521    2574 generic.go:356] "Generic (PLEG): container finished" podID="37139c8b-d433-471f-b1ab-b6c9b6fad092" containerID="b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d" exitCode=0
Jul 28 17:32:17.887994 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.887575    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"
Jul 28 17:32:17.887994 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.887602    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" event={"ID":"37139c8b-d433-471f-b1ab-b6c9b6fad092","Type":"ContainerDied","Data":"b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d"}
Jul 28 17:32:17.887994 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.887658    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z" event={"ID":"37139c8b-d433-471f-b1ab-b6c9b6fad092","Type":"ContainerDied","Data":"ac1130dbec6d89283234145fa5183f5c4963a1aacb87bcebc09f68813dfbbe24"}
Jul 28 17:32:17.887994 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.887673    2574 scope.go:117] "RemoveContainer" containerID="b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d"
Jul 28 17:32:17.897631 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.897453    2574 scope.go:117] "RemoveContainer" containerID="b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d"
Jul 28 17:32:17.897772 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:32:17.897745    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d\": container with ID starting with b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d not found: ID does not exist" containerID="b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d"
Jul 28 17:32:17.897816 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.897780    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d"} err="failed to get container status \"b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d\": rpc error: code = NotFound desc = could not find container \"b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d\": container with ID starting with b952cc6e29856af8f2109ed3b0d9e7be33d9a29b4948c9e2995909105b46e22d not found: ID does not exist"
Jul 28 17:32:17.915826 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.915793    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"]
Jul 28 17:32:17.916599 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:17.916575    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/gw-section-name-router-with-gat-f1d92d0f-kserve-5f5b776bbfj7m4z"]
Jul 28 17:32:19.148155 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:19.148119    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37139c8b-d433-471f-b1ab-b6c9b6fad092" path="/var/lib/kubelet/pods/37139c8b-d433-471f-b1ab-b6c9b6fad092/volumes"
Jul 28 17:32:20.163049 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:20.163007    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:21.538389 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:21.538356    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:21.641867 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:21.641828    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:24.622395 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.622349    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"]
Jul 28 17:32:24.622823 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.622752    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37139c8b-d433-471f-b1ab-b6c9b6fad092" containerName="main"
Jul 28 17:32:24.622823 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.622763    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="37139c8b-d433-471f-b1ab-b6c9b6fad092" containerName="main"
Jul 28 17:32:24.622905 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.622832    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="37139c8b-d433-471f-b1ab-b6c9b6fad092" containerName="main"
Jul 28 17:32:24.625794 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.625775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.629006 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.628984    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"kube-root-ca.crt\""
Jul 28 17:32:24.629137 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.629018    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"openshift-service-ca.crt\""
Jul 28 17:32:24.629137 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.629028    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"seaweedfs-s3-creds\""
Jul 28 17:32:24.629236 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.629154    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"default-dockercfg-xrt2x\""
Jul 28 17:32:24.629484 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.629470    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-enabled-requires-token-d4ed2c08\"/\"auth-enabled-test-kserve-self-signed-certs\""
Jul 28 17:32:24.637653 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.637628    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"]
Jul 28 17:32:24.708058 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.708022    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:24.788472 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.788432    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-home\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.788690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.788501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-kserve-provision-location\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.788690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.788547    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xkhq\" (UniqueName: \"kubernetes.io/projected/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-kube-api-access-8xkhq\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.788690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.788616    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-tls-certs\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.788690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.788650    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-model-cache\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.788690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.788690    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-dshm\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.788916 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.788752    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-tmp-dir\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.889596 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.889496    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-tls-certs\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.889596 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.889537    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-model-cache\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.889596 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.889560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-dshm\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.889596 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.889594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-tmp-dir\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.889965 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.889616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-home\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.889965 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.889662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-kserve-provision-location\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.889965 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.889687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xkhq\" (UniqueName: \"kubernetes.io/projected/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-kube-api-access-8xkhq\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.889965 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.889953    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-model-cache\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.890168 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.890047    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-tmp-dir\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.890168 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.890119    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-home\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.890168 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.890143    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-kserve-provision-location\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.891955 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.891938    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-dshm\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.892150 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.892133    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-tls-certs\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.898581 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.898556    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xkhq\" (UniqueName: \"kubernetes.io/projected/0cb87bd2-bbb9-4adf-901e-ec29b1b15f19-kube-api-access-8xkhq\") pod \"auth-enabled-test-kserve-766449dfcf-hn46v\" (UID: \"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19\") " pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:24.937381 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:24.937344    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"
Jul 28 17:32:25.090978 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:25.090861    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v"]
Jul 28 17:32:25.093376 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:32:25.093349    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb87bd2_bbb9_4adf_901e_ec29b1b15f19.slice/crio-6f6f8ea72ba435ea5ceca6bb98b62768d4b0766ccc9a042fcc667864656b31fa WatchSource:0}: Error finding container 6f6f8ea72ba435ea5ceca6bb98b62768d4b0766ccc9a042fcc667864656b31fa: Status 404 returned error can't find the container with id 6f6f8ea72ba435ea5ceca6bb98b62768d4b0766ccc9a042fcc667864656b31fa
Jul 28 17:32:25.113441 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:25.113411    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:25.680054 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:25.680019    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:25.932859 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:25.932772    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v" event={"ID":"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19","Type":"ContainerStarted","Data":"6f6f8ea72ba435ea5ceca6bb98b62768d4b0766ccc9a042fcc667864656b31fa"}
Jul 28 17:32:27.513040 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:27.512999    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:29.959091 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:29.959031    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-enabled-requires-token-d4ed2c08/auth-enabled-test-kserve-766449dfcf-hn46v" event={"ID":"0cb87bd2-bbb9-4adf-901e-ec29b1b15f19","Type":"ContainerStarted","Data":"1b96e55b3acb3fcab66126d92e868cc484e4db0136a0a471236fa1d5f236dc4b"}
Jul 28 17:32:32.157763 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:32.157729    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:33.420484 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:33.420446    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:33.495113 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:33.495082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:37.976683 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:32:37.976594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:33:02.797938 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:33:02.797898    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:07.982031 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:34:07.981992    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:45.468817 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:36:45.468783    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:45.558742 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:36:45.558711    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:53.133950 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:36:53.133914    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:36:53.137383 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:36:53.137361    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:36:55.358396 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:36:55.358342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:38:39.995836 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:38:39.995798    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:39:35.306406 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:39:35.306289    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:41:53.169219 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:41:53.169182    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:41:53.174611 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:41:53.174590    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:43:22.905150 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:43:22.905114    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:13.842059 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:13.841971    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:13.941592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:13.941551    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:28.253605 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.253559    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:28.387443 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.387400    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:28.505658 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.505568    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:28.608180 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.608151    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:28.626214 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.626186    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jul 28 17:44:28.629729 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.629710    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.632735 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.632706    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"seaweedfs-s3-creds\""
Jul 28 17:44:28.632735 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.632706    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"default-dockercfg-wqpph\""
Jul 28 17:44:28.633745 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.633695    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"llmisvc-model-fb-opt-125m-route-dc21cb-57cf7736-dockercfg-4fw8t\""
Jul 28 17:44:28.633890 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.633756    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"kube-root-ca.crt\""
Jul 28 17:44:28.633966 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.633761    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"openshift-service-ca.crt\""
Jul 28 17:44:28.633966 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.633762    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-63a03ef4\"/\"llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs\""
Jul 28 17:44:28.642087 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.642042    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jul 28 17:44:28.730678 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.730643    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1821795f-3f13-4755-8b7e-f8075ee3e894-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.730852 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.730685    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.730852 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.730710    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.730852 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.730751    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj8jb\" (UniqueName: \"kubernetes.io/projected/1821795f-3f13-4755-8b7e-f8075ee3e894-kube-api-access-kj8jb\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.730852 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.730777    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-home\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.730852 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.730812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-dshm\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.731024 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.730911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.831509 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.831470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1821795f-3f13-4755-8b7e-f8075ee3e894-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.831725 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.831525    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.831725 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.831556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.831725 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.831674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj8jb\" (UniqueName: \"kubernetes.io/projected/1821795f-3f13-4755-8b7e-f8075ee3e894-kube-api-access-kj8jb\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.831901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.831744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-home\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.831901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.831770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-dshm\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.831901 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.831861    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.832058 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.831932    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.832058 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.831979    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.832159 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.832126    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-home\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.832254 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.832230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.834045 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.834010    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-dshm\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.834419 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.834396    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1821795f-3f13-4755-8b7e-f8075ee3e894-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.840455 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.840434    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj8jb\" (UniqueName: \"kubernetes.io/projected/1821795f-3f13-4755-8b7e-f8075ee3e894-kube-api-access-kj8jb\") pod \"llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") " pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:28.942620 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:28.942584    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:44:29.090107 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:29.090059    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jul 28 17:44:29.092139 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:44:29.092108    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1821795f_3f13_4755_8b7e_f8075ee3e894.slice/crio-72f52a75102886d19e5e481e6300b50ccae737c3cd0c3f16351f5a5243d626ff WatchSource:0}: Error finding container 72f52a75102886d19e5e481e6300b50ccae737c3cd0c3f16351f5a5243d626ff: Status 404 returned error can't find the container with id 72f52a75102886d19e5e481e6300b50ccae737c3cd0c3f16351f5a5243d626ff
Jul 28 17:44:29.769441 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:29.769401    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"1821795f-3f13-4755-8b7e-f8075ee3e894","Type":"ContainerStarted","Data":"209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c"}
Jul 28 17:44:29.769814 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:29.769471    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"1821795f-3f13-4755-8b7e-f8075ee3e894","Type":"ContainerStarted","Data":"72f52a75102886d19e5e481e6300b50ccae737c3cd0c3f16351f5a5243d626ff"}
Jul 28 17:44:36.280263 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:36.280224    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:38.820228 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:38.820193    2574 generic.go:356] "Generic (PLEG): container finished" podID="1821795f-3f13-4755-8b7e-f8075ee3e894" containerID="209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c" exitCode=0
Jul 28 17:44:38.820228 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:38.820231    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"1821795f-3f13-4755-8b7e-f8075ee3e894","Type":"ContainerDied","Data":"209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c"}
Jul 28 17:44:38.821655 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:44:38.821638    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:45:08.022535 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:45:08.022501    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"1821795f-3f13-4755-8b7e-f8075ee3e894","Type":"ContainerStarted","Data":"b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f"}
Jul 28 17:45:08.045947 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:45:08.045891    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" podStartSLOduration=2.03603289 podStartE2EDuration="40.045872771s" totalImagesPullingTime="28.725106473s" totalInitContainerRuntime="9.284733408s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:45:08.0443008 +0000 UTC m=+1695.472080039" watchObservedRunningTime="2026-07-28 17:45:08.045872771 +0000 UTC m=+1695.473652015"
Jul 28 17:46:53.204590 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:46:53.204556    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:46:53.211215 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:46:53.211192    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:47:16.824683 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:47:16.824650    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-llm-auth-enabled-requires-token-d4ed2c08_auth-enabled-test-kserve-766449dfcf-hn46v_0cb87bd2-bbb9-4adf-901e-ec29b1b15f19/storage-initializer/0.log"
Jul 28 17:47:18.262669 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:47:18.262627    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:47:19.548975 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:47:19.548938    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:47:28.335614 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:47:28.335578    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:47:28.604587 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:47:28.604501    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:47:38.303572 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:47:38.303537    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:47:40.034244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:47:40.034203    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:47:40.134509 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:47:40.134476    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:47:56.520922 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:47:56.520874    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jul 28 17:48:11.543370 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:11.543313    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" podUID="1821795f-3f13-4755-8b7e-f8075ee3e894" containerName="main" containerID="cri-o://b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f" gracePeriod=45
Jul 28 17:48:12.288640 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.288612    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:48:12.395289 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395198    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-kserve-provision-location\") pod \"1821795f-3f13-4755-8b7e-f8075ee3e894\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") "
Jul 28 17:48:12.395289 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395258    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-tmp-dir\") pod \"1821795f-3f13-4755-8b7e-f8075ee3e894\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") "
Jul 28 17:48:12.395521 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395309    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-home\") pod \"1821795f-3f13-4755-8b7e-f8075ee3e894\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") "
Jul 28 17:48:12.395521 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395339    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-model-cache\") pod \"1821795f-3f13-4755-8b7e-f8075ee3e894\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") "
Jul 28 17:48:12.395521 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395421    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-dshm\") pod \"1821795f-3f13-4755-8b7e-f8075ee3e894\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") "
Jul 28 17:48:12.395521 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395452    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj8jb\" (UniqueName: \"kubernetes.io/projected/1821795f-3f13-4755-8b7e-f8075ee3e894-kube-api-access-kj8jb\") pod \"1821795f-3f13-4755-8b7e-f8075ee3e894\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") "
Jul 28 17:48:12.395521 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395478    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1821795f-3f13-4755-8b7e-f8075ee3e894-tls-certs\") pod \"1821795f-3f13-4755-8b7e-f8075ee3e894\" (UID: \"1821795f-3f13-4755-8b7e-f8075ee3e894\") "
Jul 28 17:48:12.395764 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395634    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-model-cache" (OuterVolumeSpecName: "model-cache") pod "1821795f-3f13-4755-8b7e-f8075ee3e894" (UID: "1821795f-3f13-4755-8b7e-f8075ee3e894"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:48:12.395830 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395785    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:48:12.395958 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.395927    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-home" (OuterVolumeSpecName: "home") pod "1821795f-3f13-4755-8b7e-f8075ee3e894" (UID: "1821795f-3f13-4755-8b7e-f8075ee3e894"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:48:12.397748 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.397725    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-dshm" (OuterVolumeSpecName: "dshm") pod "1821795f-3f13-4755-8b7e-f8075ee3e894" (UID: "1821795f-3f13-4755-8b7e-f8075ee3e894"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:48:12.397856 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.397781    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1821795f-3f13-4755-8b7e-f8075ee3e894-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1821795f-3f13-4755-8b7e-f8075ee3e894" (UID: "1821795f-3f13-4755-8b7e-f8075ee3e894"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:48:12.397944 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.397920    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1821795f-3f13-4755-8b7e-f8075ee3e894-kube-api-access-kj8jb" (OuterVolumeSpecName: "kube-api-access-kj8jb") pod "1821795f-3f13-4755-8b7e-f8075ee3e894" (UID: "1821795f-3f13-4755-8b7e-f8075ee3e894"). InnerVolumeSpecName "kube-api-access-kj8jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:48:12.407703 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.407675    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1821795f-3f13-4755-8b7e-f8075ee3e894" (UID: "1821795f-3f13-4755-8b7e-f8075ee3e894"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:48:12.451408 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.451349    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "1821795f-3f13-4755-8b7e-f8075ee3e894" (UID: "1821795f-3f13-4755-8b7e-f8075ee3e894"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:48:12.496425 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.496389    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:48:12.496425 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.496421    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj8jb\" (UniqueName: \"kubernetes.io/projected/1821795f-3f13-4755-8b7e-f8075ee3e894-kube-api-access-kj8jb\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:48:12.496592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.496433    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1821795f-3f13-4755-8b7e-f8075ee3e894-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:48:12.496592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.496447    2574 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-kserve-provision-location\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:48:12.496592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.496456    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:48:12.496592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:12.496464    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1821795f-3f13-4755-8b7e-f8075ee3e894-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:48:13.055437 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.055406    2574 generic.go:356] "Generic (PLEG): container finished" podID="1821795f-3f13-4755-8b7e-f8075ee3e894" containerID="b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f" exitCode=0
Jul 28 17:48:13.055879 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.055460    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"
Jul 28 17:48:13.055879 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.055477    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"1821795f-3f13-4755-8b7e-f8075ee3e894","Type":"ContainerDied","Data":"b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f"}
Jul 28 17:48:13.055879 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.055522    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1" event={"ID":"1821795f-3f13-4755-8b7e-f8075ee3e894","Type":"ContainerDied","Data":"72f52a75102886d19e5e481e6300b50ccae737c3cd0c3f16351f5a5243d626ff"}
Jul 28 17:48:13.055879 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.055542    2574 scope.go:117] "RemoveContainer" containerID="b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f"
Jul 28 17:48:13.065212 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.065194    2574 scope.go:117] "RemoveContainer" containerID="209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c"
Jul 28 17:48:13.073799 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.073780    2574 scope.go:117] "RemoveContainer" containerID="b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f"
Jul 28 17:48:13.074110 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:48:13.074087    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f\": container with ID starting with b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f not found: ID does not exist" containerID="b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f"
Jul 28 17:48:13.074159 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.074122    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f"} err="failed to get container status \"b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f\": rpc error: code = NotFound desc = could not find container \"b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f\": container with ID starting with b919f14d61ac53dd063e782662e6187fdc77c325d5ace0f3a2408860d554849f not found: ID does not exist"
Jul 28 17:48:13.074159 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.074142    2574 scope.go:117] "RemoveContainer" containerID="209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c"
Jul 28 17:48:13.074386 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:48:13.074371    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c\": container with ID starting with 209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c not found: ID does not exist" containerID="209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c"
Jul 28 17:48:13.074423 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.074392    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c"} err="failed to get container status \"209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c\": rpc error: code = NotFound desc = could not find container \"209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c\": container with ID starting with 209b16efb55a0fe3f2f2a691e710f6388de27f43f9201a1e2ef9ab5aa12a0d9c not found: ID does not exist"
Jul 28 17:48:13.080592 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.080562    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jul 28 17:48:13.086205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.086179    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-63a03ef4/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1"]
Jul 28 17:48:13.147804 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:13.147768    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1821795f-3f13-4755-8b7e-f8075ee3e894" path="/var/lib/kubelet/pods/1821795f-3f13-4755-8b7e-f8075ee3e894/volumes"
Jul 28 17:48:16.427280 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:16.427205    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:17.731199 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:17.731166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:17.830205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:17.830166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:24.147527 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:24.147495    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:29.877452 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:29.877418    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:29.978672 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:29.978633    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:36.605589 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.605546    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"]
Jul 28 17:48:36.605976 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.605944    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1821795f-3f13-4755-8b7e-f8075ee3e894" containerName="main"
Jul 28 17:48:36.605976 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.605955    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1821795f-3f13-4755-8b7e-f8075ee3e894" containerName="main"
Jul 28 17:48:36.605976 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.605967    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1821795f-3f13-4755-8b7e-f8075ee3e894" containerName="storage-initializer"
Jul 28 17:48:36.605976 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.605973    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1821795f-3f13-4755-8b7e-f8075ee3e894" containerName="storage-initializer"
Jul 28 17:48:36.606235 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.606036    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1821795f-3f13-4755-8b7e-f8075ee3e894" containerName="main"
Jul 28 17:48:36.607920 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.607897    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.612190 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.612171    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"kube-root-ca.crt\""
Jul 28 17:48:36.612323 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.612229    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
Jul 28 17:48:36.612323 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.612172    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"openshift-service-ca.crt\""
Jul 28 17:48:36.612323 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.612292    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-47655ff5\"/\"default-dockercfg-jrtdk\""
Jul 28 17:48:36.620463 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.620435    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"]
Jul 28 17:48:36.633194 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.633150    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:36.719453 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.719417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e401414-9ebf-425e-a8af-82f8b3099f2c-tls-certs\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.719654 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.719468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-model-cache\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.719654 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.719496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-dshm\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.719654 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.719512    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-tmp-dir\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.719654 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.719622    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7p9v\" (UniqueName: \"kubernetes.io/projected/0e401414-9ebf-425e-a8af-82f8b3099f2c-kube-api-access-f7p9v\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.719815 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.719656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-home\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.820397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.820365    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e401414-9ebf-425e-a8af-82f8b3099f2c-tls-certs\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.820607 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.820415    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-model-cache\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.820607 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.820435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-dshm\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.820607 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.820456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-tmp-dir\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.820607 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.820547    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7p9v\" (UniqueName: \"kubernetes.io/projected/0e401414-9ebf-425e-a8af-82f8b3099f2c-kube-api-access-f7p9v\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.820607 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.820588    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-home\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.820894 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.820856    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-model-cache\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.821014 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.820992    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-home\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.821193 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.821026    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-tmp-dir\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.823250 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.823221    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-dshm\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.823548 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.823525    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e401414-9ebf-425e-a8af-82f8b3099f2c-tls-certs\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.832993 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.832964    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7p9v\" (UniqueName: \"kubernetes.io/projected/0e401414-9ebf-425e-a8af-82f8b3099f2c-kube-api-access-f7p9v\") pod \"scheduler-inline-config-test-kserve-8655bc757-mlzlp\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") " pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:36.866456 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.866372    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:36.919548 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:36.919505    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:37.057585 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:37.057556    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"]
Jul 28 17:48:37.059433 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:48:37.059405    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e401414_9ebf_425e_a8af_82f8b3099f2c.slice/crio-176fb1be5fa5ccdd489cfdd68c5694199eacb099e0a1f070f45ce230799b9469 WatchSource:0}: Error finding container 176fb1be5fa5ccdd489cfdd68c5694199eacb099e0a1f070f45ce230799b9469: Status 404 returned error can't find the container with id 176fb1be5fa5ccdd489cfdd68c5694199eacb099e0a1f070f45ce230799b9469
Jul 28 17:48:37.192386 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:37.192289    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp" event={"ID":"0e401414-9ebf-425e-a8af-82f8b3099f2c","Type":"ContainerStarted","Data":"2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88"}
Jul 28 17:48:37.192386 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:37.192344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp" event={"ID":"0e401414-9ebf-425e-a8af-82f8b3099f2c","Type":"ContainerStarted","Data":"176fb1be5fa5ccdd489cfdd68c5694199eacb099e0a1f070f45ce230799b9469"}
Jul 28 17:48:37.211724 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:37.211669    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp" podStartSLOduration=1.211646606 podStartE2EDuration="1.211646606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:48:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:48:37.210281118 +0000 UTC m=+1904.638060369" watchObservedRunningTime="2026-07-28 17:48:37.211646606 +0000 UTC m=+1904.639425842"
Jul 28 17:48:37.919831 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:37.919797    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:46.920641 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:46.920569    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:46.933436 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:46.933402    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:47.257144 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:47.257116    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:48:55.936716 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:48:55.936678    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:10.560435 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.560397    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"]
Jul 28 17:49:10.569833 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:49:10.569796    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 17:49:10.569833 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:49:10.569833 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:49:10.569833 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88" cmd=["/bin/sleep","15"]
Jul 28 17:49:10.570171 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.569853    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp" message="" err=<
Jul 28 17:49:10.570171 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:49:10.570171 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:49:10.570171 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 17:49:10.570171 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:49:10.569869    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 17:49:10.570171 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:49:10.570171 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:49:10.570171 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp" podUID="0e401414-9ebf-425e-a8af-82f8b3099f2c" containerName="main" containerID="cri-o://2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88"
Jul 28 17:49:10.570171 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.569943    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp" podUID="0e401414-9ebf-425e-a8af-82f8b3099f2c" containerName="main" containerID="cri-o://2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88" gracePeriod=60
Jul 28 17:49:10.599244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.599211    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:10.699793 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.699760    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:10.814032 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.813964    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:49:10.925544 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.925507    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e401414-9ebf-425e-a8af-82f8b3099f2c-tls-certs\") pod \"0e401414-9ebf-425e-a8af-82f8b3099f2c\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") "
Jul 28 17:49:10.925723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.925583    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-home\") pod \"0e401414-9ebf-425e-a8af-82f8b3099f2c\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") "
Jul 28 17:49:10.925723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.925608    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-dshm\") pod \"0e401414-9ebf-425e-a8af-82f8b3099f2c\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") "
Jul 28 17:49:10.925723 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.925704    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-tmp-dir\") pod \"0e401414-9ebf-425e-a8af-82f8b3099f2c\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") "
Jul 28 17:49:10.925828 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.925746    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7p9v\" (UniqueName: \"kubernetes.io/projected/0e401414-9ebf-425e-a8af-82f8b3099f2c-kube-api-access-f7p9v\") pod \"0e401414-9ebf-425e-a8af-82f8b3099f2c\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") "
Jul 28 17:49:10.925828 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.925800    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-model-cache\") pod \"0e401414-9ebf-425e-a8af-82f8b3099f2c\" (UID: \"0e401414-9ebf-425e-a8af-82f8b3099f2c\") "
Jul 28 17:49:10.925925 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.925853    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-home" (OuterVolumeSpecName: "home") pod "0e401414-9ebf-425e-a8af-82f8b3099f2c" (UID: "0e401414-9ebf-425e-a8af-82f8b3099f2c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:49:10.925996 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.925961    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0e401414-9ebf-425e-a8af-82f8b3099f2c" (UID: "0e401414-9ebf-425e-a8af-82f8b3099f2c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:49:10.926200 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.926171    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-model-cache" (OuterVolumeSpecName: "model-cache") pod "0e401414-9ebf-425e-a8af-82f8b3099f2c" (UID: "0e401414-9ebf-425e-a8af-82f8b3099f2c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:49:10.926299 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.926218    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:49:10.926299 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.926233    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:49:10.927838 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.927812    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-dshm" (OuterVolumeSpecName: "dshm") pod "0e401414-9ebf-425e-a8af-82f8b3099f2c" (UID: "0e401414-9ebf-425e-a8af-82f8b3099f2c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:49:10.927930 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.927847    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e401414-9ebf-425e-a8af-82f8b3099f2c-kube-api-access-f7p9v" (OuterVolumeSpecName: "kube-api-access-f7p9v") pod "0e401414-9ebf-425e-a8af-82f8b3099f2c" (UID: "0e401414-9ebf-425e-a8af-82f8b3099f2c"). InnerVolumeSpecName "kube-api-access-f7p9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:49:10.927930 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:10.927868    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e401414-9ebf-425e-a8af-82f8b3099f2c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0e401414-9ebf-425e-a8af-82f8b3099f2c" (UID: "0e401414-9ebf-425e-a8af-82f8b3099f2c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:49:11.027340 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.027299    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:49:11.027340 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.027331    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7p9v\" (UniqueName: \"kubernetes.io/projected/0e401414-9ebf-425e-a8af-82f8b3099f2c-kube-api-access-f7p9v\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:49:11.027340 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.027342    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e401414-9ebf-425e-a8af-82f8b3099f2c-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:49:11.027340 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.027352    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e401414-9ebf-425e-a8af-82f8b3099f2c-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:49:11.376862 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.376825    2574 generic.go:356] "Generic (PLEG): container finished" podID="0e401414-9ebf-425e-a8af-82f8b3099f2c" containerID="2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88" exitCode=0
Jul 28 17:49:11.377041 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.376874    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"
Jul 28 17:49:11.377041 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.376897    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp" event={"ID":"0e401414-9ebf-425e-a8af-82f8b3099f2c","Type":"ContainerDied","Data":"2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88"}
Jul 28 17:49:11.377041 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.376953    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp" event={"ID":"0e401414-9ebf-425e-a8af-82f8b3099f2c","Type":"ContainerDied","Data":"176fb1be5fa5ccdd489cfdd68c5694199eacb099e0a1f070f45ce230799b9469"}
Jul 28 17:49:11.377041 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.376984    2574 scope.go:117] "RemoveContainer" containerID="2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88"
Jul 28 17:49:11.387914 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.387891    2574 scope.go:117] "RemoveContainer" containerID="2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88"
Jul 28 17:49:11.388268 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:49:11.388233    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88\": container with ID starting with 2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88 not found: ID does not exist" containerID="2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88"
Jul 28 17:49:11.388378 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.388268    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88"} err="failed to get container status \"2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88\": rpc error: code = NotFound desc = could not find container \"2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88\": container with ID starting with 2fba41b7bf0b80c7b276697bbe75108150fbb54243e9a6bababf642e3246de88 not found: ID does not exist"
Jul 28 17:49:11.396653 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.396623    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"]
Jul 28 17:49:11.400296 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:11.400269    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-47655ff5/scheduler-inline-config-test-kserve-8655bc757-mlzlp"]
Jul 28 17:49:13.154055 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:13.154021    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e401414-9ebf-425e-a8af-82f8b3099f2c" path="/var/lib/kubelet/pods/0e401414-9ebf-425e-a8af-82f8b3099f2c/volumes"
Jul 28 17:49:29.952700 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:29.952641    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:30.073252 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:30.073207    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:30.752796 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:30.752761    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:30.852278 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:30.852238    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:36.560764 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:36.560724    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:42.441477 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:42.441441    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:42.551860 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:42.551811    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:46.212459 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.212376    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:46.431040 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.431002    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"]
Jul 28 17:49:46.431456 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.431438    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e401414-9ebf-425e-a8af-82f8b3099f2c" containerName="main"
Jul 28 17:49:46.431456 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.431457    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e401414-9ebf-425e-a8af-82f8b3099f2c" containerName="main"
Jul 28 17:49:46.431582 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.431512    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e401414-9ebf-425e-a8af-82f8b3099f2c" containerName="main"
Jul 28 17:49:46.433456 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.433436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:49:46.439419 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.438206    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs\""
Jul 28 17:49:46.439419 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.438938    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"default-dockercfg-8b47b\""
Jul 28 17:49:46.439419 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.438986    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"openshift-service-ca.crt\""
Jul 28 17:49:46.440746 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.439872    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"kube-root-ca.crt\""
Jul 28 17:49:46.440746 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.440334    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-aae51b37\"/\"llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa-dockercfg-x7sw9\""
Jul 28 17:49:46.452118 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.452083    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"]
Jul 28 17:49:46.457518 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.457492    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgdvp\" (UniqueName: \"kubernetes.io/projected/453d447b-33c3-459c-9cd1-ebd067067abf-kube-api-access-dgdvp\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj\" (UID: \"453d447b-33c3-459c-9cd1-ebd067067abf\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:49:46.457659 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.457574    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/453d447b-33c3-459c-9cd1-ebd067067abf-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj\" (UID: \"453d447b-33c3-459c-9cd1-ebd067067abf\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:49:46.468172 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.468095    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:46.558187 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.558147    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/453d447b-33c3-459c-9cd1-ebd067067abf-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj\" (UID: \"453d447b-33c3-459c-9cd1-ebd067067abf\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:49:46.558385 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.558212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgdvp\" (UniqueName: \"kubernetes.io/projected/453d447b-33c3-459c-9cd1-ebd067067abf-kube-api-access-dgdvp\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj\" (UID: \"453d447b-33c3-459c-9cd1-ebd067067abf\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:49:46.560719 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.560691    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/453d447b-33c3-459c-9cd1-ebd067067abf-tls-certs\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj\" (UID: \"453d447b-33c3-459c-9cd1-ebd067067abf\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:49:46.566543 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.566513    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgdvp\" (UniqueName: \"kubernetes.io/projected/453d447b-33c3-459c-9cd1-ebd067067abf-kube-api-access-dgdvp\") pod \"llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj\" (UID: \"453d447b-33c3-459c-9cd1-ebd067067abf\") " pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:49:46.753244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.753152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:49:46.888990 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.888965    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"]
Jul 28 17:49:46.890678 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:49:46.890644    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453d447b_33c3_459c_9cd1_ebd067067abf.slice/crio-5bf113493c89f32153ae7e3774d5d7f36f8563985f16b0abf924087cce9a5c11 WatchSource:0}: Error finding container 5bf113493c89f32153ae7e3774d5d7f36f8563985f16b0abf924087cce9a5c11: Status 404 returned error can't find the container with id 5bf113493c89f32153ae7e3774d5d7f36f8563985f16b0abf924087cce9a5c11
Jul 28 17:49:46.892594 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:46.892575    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:49:47.576080 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:47.576031    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj" event={"ID":"453d447b-33c3-459c-9cd1-ebd067067abf","Type":"ContainerStarted","Data":"5bf113493c89f32153ae7e3774d5d7f36f8563985f16b0abf924087cce9a5c11"}
Jul 28 17:49:49.594032 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:49.593993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj" event={"ID":"453d447b-33c3-459c-9cd1-ebd067067abf","Type":"ContainerStarted","Data":"4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd"}
Jul 28 17:49:49.594441 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:49.594062    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:49:49.610958 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:49.610903    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj" podStartSLOduration=1.019797856 podStartE2EDuration="3.610887836s" totalImagesPullingTime="2.59108998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:49:49.60956012 +0000 UTC m=+1977.037339359" watchObservedRunningTime="2026-07-28 17:49:49.610887836 +0000 UTC m=+1977.038667073"
Jul 28 17:49:50.691842 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:50.691809    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:50.788001 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:50.787967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:49:56.965244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:49:56.965210    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:02.643001 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:02.642941    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:02.713549 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:02.713506    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:08.436112 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:08.436077    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:14.023343 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:14.023313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:14.277969 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:14.277885    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:20.602186 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:20.602146    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:50:33.093706 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:33.093660    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:37.063151 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:37.063111    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:37.097622 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:37.097585    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"]
Jul 28 17:50:37.229246 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:37.229215    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:40.491134 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:40.491056    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:40.602110 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:40.602047    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj" podUID="453d447b-33c3-459c-9cd1-ebd067067abf" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 28 17:50:50.601821 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:50.601779    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj" podUID="453d447b-33c3-459c-9cd1-ebd067067abf" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Jul 28 17:50:52.117061 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.117000    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj" podUID="453d447b-33c3-459c-9cd1-ebd067067abf" containerName="main" containerID="cri-o://4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd" gracePeriod=45
Jul 28 17:50:52.373497 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.373438    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:50:52.456404 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.456358    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/453d447b-33c3-459c-9cd1-ebd067067abf-tls-certs\") pod \"453d447b-33c3-459c-9cd1-ebd067067abf\" (UID: \"453d447b-33c3-459c-9cd1-ebd067067abf\") "
Jul 28 17:50:52.456404 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.456421    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgdvp\" (UniqueName: \"kubernetes.io/projected/453d447b-33c3-459c-9cd1-ebd067067abf-kube-api-access-dgdvp\") pod \"453d447b-33c3-459c-9cd1-ebd067067abf\" (UID: \"453d447b-33c3-459c-9cd1-ebd067067abf\") "
Jul 28 17:50:52.458674 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.458646    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/453d447b-33c3-459c-9cd1-ebd067067abf-kube-api-access-dgdvp" (OuterVolumeSpecName: "kube-api-access-dgdvp") pod "453d447b-33c3-459c-9cd1-ebd067067abf" (UID: "453d447b-33c3-459c-9cd1-ebd067067abf"). InnerVolumeSpecName "kube-api-access-dgdvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:50:52.458796 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.458681    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/453d447b-33c3-459c-9cd1-ebd067067abf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "453d447b-33c3-459c-9cd1-ebd067067abf" (UID: "453d447b-33c3-459c-9cd1-ebd067067abf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:50:52.557124 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.557047    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/453d447b-33c3-459c-9cd1-ebd067067abf-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:50:52.557124 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.557117    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgdvp\" (UniqueName: \"kubernetes.io/projected/453d447b-33c3-459c-9cd1-ebd067067abf-kube-api-access-dgdvp\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:50:52.939093 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.939032    2574 generic.go:356] "Generic (PLEG): container finished" podID="453d447b-33c3-459c-9cd1-ebd067067abf" containerID="4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd" exitCode=0
Jul 28 17:50:52.939271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.939098    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"
Jul 28 17:50:52.939271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.939102    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj" event={"ID":"453d447b-33c3-459c-9cd1-ebd067067abf","Type":"ContainerDied","Data":"4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd"}
Jul 28 17:50:52.939271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.939178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj" event={"ID":"453d447b-33c3-459c-9cd1-ebd067067abf","Type":"ContainerDied","Data":"5bf113493c89f32153ae7e3774d5d7f36f8563985f16b0abf924087cce9a5c11"}
Jul 28 17:50:52.939271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.939201    2574 scope.go:117] "RemoveContainer" containerID="4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd"
Jul 28 17:50:52.948616 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.948600    2574 scope.go:117] "RemoveContainer" containerID="4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd"
Jul 28 17:50:52.948894 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:50:52.948874    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd\": container with ID starting with 4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd not found: ID does not exist" containerID="4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd"
Jul 28 17:50:52.948943 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.948903    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd"} err="failed to get container status \"4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd\": rpc error: code = NotFound desc = could not find container \"4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd\": container with ID starting with 4352bd8e8a63099023406f16da402675b535ab443dd95a11c4c86f78535c65dd not found: ID does not exist"
Jul 28 17:50:52.967379 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.967348    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"]
Jul 28 17:50:52.972375 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:52.972346    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-aae51b37/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrqbj"]
Jul 28 17:50:53.148151 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:53.148120    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="453d447b-33c3-459c-9cd1-ebd067067abf" path="/var/lib/kubelet/pods/453d447b-33c3-459c-9cd1-ebd067067abf/volumes"
Jul 28 17:50:56.744602 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:56.744562    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:50:56.840964 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:50:56.840935    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:01.099439 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.099399    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"]
Jul 28 17:51:01.099801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.099789    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453d447b-33c3-459c-9cd1-ebd067067abf" containerName="main"
Jul 28 17:51:01.099801 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.099800    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="453d447b-33c3-459c-9cd1-ebd067067abf" containerName="main"
Jul 28 17:51:01.099894 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.099877    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="453d447b-33c3-459c-9cd1-ebd067067abf" containerName="main"
Jul 28 17:51:01.102206 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.102183    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.105094 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.105059    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"kube-root-ca.crt\""
Jul 28 17:51:01.106473 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.106450    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Jul 28 17:51:01.106578 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.106557    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"openshift-service-ca.crt\""
Jul 28 17:51:01.107304 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.107287    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"default-dockercfg-fbshb\""
Jul 28 17:51:01.113027 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.113002    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"]
Jul 28 17:51:01.129112 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.129079    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:01.239230 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.239197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-dshm\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.239230 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.239232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpqv9\" (UniqueName: \"kubernetes.io/projected/805f19e4-e438-4f12-ac59-4379faa15b7f-kube-api-access-dpqv9\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.239457 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.239353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-home\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.239505 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.239467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805f19e4-e438-4f12-ac59-4379faa15b7f-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.239505 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.239499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-model-cache\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.239582 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.239518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.340397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.340359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805f19e4-e438-4f12-ac59-4379faa15b7f-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.340397 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.340396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-model-cache\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.340667 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.340415    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.340667 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.340445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-dshm\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.340667 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.340463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpqv9\" (UniqueName: \"kubernetes.io/projected/805f19e4-e438-4f12-ac59-4379faa15b7f-kube-api-access-dpqv9\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.340667 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.340524    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-home\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.340886 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.340837    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-model-cache\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.340886 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.340876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-tmp-dir\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.340979 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.340912    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-home\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.342910 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.342885    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-dshm\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.343312 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.343291    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805f19e4-e438-4f12-ac59-4379faa15b7f-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.352101 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.351758    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpqv9\" (UniqueName: \"kubernetes.io/projected/805f19e4-e438-4f12-ac59-4379faa15b7f-kube-api-access-dpqv9\") pod \"scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.391267 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.391226    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:01.412962 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.412926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:01.555993 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.555962    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"]
Jul 28 17:51:01.558091 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:51:01.558043    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805f19e4_e438_4f12_ac59_4379faa15b7f.slice/crio-1cab74ab5720d0b99afb81d2172e53ece30ba7a63d97923716fd42f027b7ac86 WatchSource:0}: Error finding container 1cab74ab5720d0b99afb81d2172e53ece30ba7a63d97923716fd42f027b7ac86: Status 404 returned error can't find the container with id 1cab74ab5720d0b99afb81d2172e53ece30ba7a63d97923716fd42f027b7ac86
Jul 28 17:51:01.986710 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.986605    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf" event={"ID":"805f19e4-e438-4f12-ac59-4379faa15b7f","Type":"ContainerStarted","Data":"c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6"}
Jul 28 17:51:01.986710 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:01.986662    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf" event={"ID":"805f19e4-e438-4f12-ac59-4379faa15b7f","Type":"ContainerStarted","Data":"1cab74ab5720d0b99afb81d2172e53ece30ba7a63d97923716fd42f027b7ac86"}
Jul 28 17:51:02.006587 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:02.006521    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf" podStartSLOduration=1.006507048 podStartE2EDuration="1.006507048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:51:02.005042155 +0000 UTC m=+2049.432821405" watchObservedRunningTime="2026-07-28 17:51:02.006507048 +0000 UTC m=+2049.434286285"
Jul 28 17:51:02.414121 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:02.414090    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:03.443132 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:03.443097    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:09.328151 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:09.328116    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:09.398469 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:09.398437    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:11.413655 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:11.413623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:11.426751 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:11.426720    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:12.058087 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:12.058047    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:15.057160 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:15.057062    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:37.662145 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:37.662101    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"]
Jul 28 17:51:37.671655 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:51:37.671614    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 17:51:37.671655 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:51:37.671655 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:51:37.671655 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6" cmd=["/bin/sleep","15"]
Jul 28 17:51:37.671987 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:37.671675    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf" message="" err=<
Jul 28 17:51:37.671987 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:51:37.671987 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:51:37.671987 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 17:51:37.671987 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:51:37.671689    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 17:51:37.671987 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:51:37.671987 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:51:37.671987 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf" podUID="805f19e4-e438-4f12-ac59-4379faa15b7f" containerName="main" containerID="cri-o://c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6"
Jul 28 17:51:37.671987 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:37.671729    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf" podUID="805f19e4-e438-4f12-ac59-4379faa15b7f" containerName="main" containerID="cri-o://c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6" gracePeriod=60
Jul 28 17:51:37.698587 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:37.698553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:37.815994 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:37.815960    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:38.027652 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.027627    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:38.068347 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068319    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-tmp-dir\") pod \"805f19e4-e438-4f12-ac59-4379faa15b7f\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") "
Jul 28 17:51:38.068347 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068356    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-model-cache\") pod \"805f19e4-e438-4f12-ac59-4379faa15b7f\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") "
Jul 28 17:51:38.068602 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068389    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805f19e4-e438-4f12-ac59-4379faa15b7f-tls-certs\") pod \"805f19e4-e438-4f12-ac59-4379faa15b7f\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") "
Jul 28 17:51:38.068602 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068451    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpqv9\" (UniqueName: \"kubernetes.io/projected/805f19e4-e438-4f12-ac59-4379faa15b7f-kube-api-access-dpqv9\") pod \"805f19e4-e438-4f12-ac59-4379faa15b7f\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") "
Jul 28 17:51:38.068602 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068488    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-home\") pod \"805f19e4-e438-4f12-ac59-4379faa15b7f\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") "
Jul 28 17:51:38.068602 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068552    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-dshm\") pod \"805f19e4-e438-4f12-ac59-4379faa15b7f\" (UID: \"805f19e4-e438-4f12-ac59-4379faa15b7f\") "
Jul 28 17:51:38.068816 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068650    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-model-cache" (OuterVolumeSpecName: "model-cache") pod "805f19e4-e438-4f12-ac59-4379faa15b7f" (UID: "805f19e4-e438-4f12-ac59-4379faa15b7f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:51:38.068816 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068662    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "805f19e4-e438-4f12-ac59-4379faa15b7f" (UID: "805f19e4-e438-4f12-ac59-4379faa15b7f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:51:38.068914 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068880    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:51:38.068914 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068902    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:51:38.069029 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.068905    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-home" (OuterVolumeSpecName: "home") pod "805f19e4-e438-4f12-ac59-4379faa15b7f" (UID: "805f19e4-e438-4f12-ac59-4379faa15b7f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:51:38.070750 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.070719    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805f19e4-e438-4f12-ac59-4379faa15b7f-kube-api-access-dpqv9" (OuterVolumeSpecName: "kube-api-access-dpqv9") pod "805f19e4-e438-4f12-ac59-4379faa15b7f" (UID: "805f19e4-e438-4f12-ac59-4379faa15b7f"). InnerVolumeSpecName "kube-api-access-dpqv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:51:38.070750 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.070726    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-dshm" (OuterVolumeSpecName: "dshm") pod "805f19e4-e438-4f12-ac59-4379faa15b7f" (UID: "805f19e4-e438-4f12-ac59-4379faa15b7f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:51:38.070897 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.070789    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/805f19e4-e438-4f12-ac59-4379faa15b7f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "805f19e4-e438-4f12-ac59-4379faa15b7f" (UID: "805f19e4-e438-4f12-ac59-4379faa15b7f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:51:38.169432 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.169398    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpqv9\" (UniqueName: \"kubernetes.io/projected/805f19e4-e438-4f12-ac59-4379faa15b7f-kube-api-access-dpqv9\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:51:38.169432 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.169425    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:51:38.169432 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.169437    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/805f19e4-e438-4f12-ac59-4379faa15b7f-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:51:38.169681 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.169449    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/805f19e4-e438-4f12-ac59-4379faa15b7f-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:51:38.187524 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.187489    2574 generic.go:356] "Generic (PLEG): container finished" podID="805f19e4-e438-4f12-ac59-4379faa15b7f" containerID="c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6" exitCode=0
Jul 28 17:51:38.187677 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.187536    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"
Jul 28 17:51:38.187677 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.187575    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf" event={"ID":"805f19e4-e438-4f12-ac59-4379faa15b7f","Type":"ContainerDied","Data":"c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6"}
Jul 28 17:51:38.187677 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.187635    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf" event={"ID":"805f19e4-e438-4f12-ac59-4379faa15b7f","Type":"ContainerDied","Data":"1cab74ab5720d0b99afb81d2172e53ece30ba7a63d97923716fd42f027b7ac86"}
Jul 28 17:51:38.187677 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.187658    2574 scope.go:117] "RemoveContainer" containerID="c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6"
Jul 28 17:51:38.197131 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.197113    2574 scope.go:117] "RemoveContainer" containerID="c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6"
Jul 28 17:51:38.197402 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:51:38.197383    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6\": container with ID starting with c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6 not found: ID does not exist" containerID="c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6"
Jul 28 17:51:38.197477 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.197411    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6"} err="failed to get container status \"c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6\": rpc error: code = NotFound desc = could not find container \"c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6\": container with ID starting with c47e6305ca8e38a3c30dbb23e00b1f2bf81772b459545b2d467330f9b1c669c6 not found: ID does not exist"
Jul 28 17:51:38.210244 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.210213    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"]
Jul 28 17:51:38.213735 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:38.213708    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-5bff678dc7-v6jmf"]
Jul 28 17:51:39.147557 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:39.147524    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="805f19e4-e438-4f12-ac59-4379faa15b7f" path="/var/lib/kubelet/pods/805f19e4-e438-4f12-ac59-4379faa15b7f/volumes"
Jul 28 17:51:53.247250 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:53.247219    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:51:53.255518 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:53.255495    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:51:57.759002 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:57.758970    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:51:57.849279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:51:57.849239    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:03.888421 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:03.888384    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:09.495943 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.495907    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"]
Jul 28 17:52:09.496451 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.496337    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805f19e4-e438-4f12-ac59-4379faa15b7f" containerName="main"
Jul 28 17:52:09.496451 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.496350    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="805f19e4-e438-4f12-ac59-4379faa15b7f" containerName="main"
Jul 28 17:52:09.496451 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.496406    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="805f19e4-e438-4f12-ac59-4379faa15b7f" containerName="main"
Jul 28 17:52:09.498573 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.498558    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.502619 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.502593    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"openshift-service-ca.crt\""
Jul 28 17:52:09.502619 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.502607    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"kube-root-ca.crt\""
Jul 28 17:52:09.502826 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.502607    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
Jul 28 17:52:09.502826 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.502703    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-2541cd65\"/\"default-dockercfg-v568p\""
Jul 28 17:52:09.509950 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.509927    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"]
Jul 28 17:52:09.520768 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.520723    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:09.552958 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.552925    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-dshm\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.553172 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.552965    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8n9j\" (UniqueName: \"kubernetes.io/projected/1c8e9228-388f-4e3a-80b7-47d072a8082e-kube-api-access-s8n9j\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.553172 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.552988    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-model-cache\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.553172 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.553008    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.553172 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.553110    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-home\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.553172 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.553144    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8e9228-388f-4e3a-80b7-47d072a8082e-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.653565 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.653529    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8e9228-388f-4e3a-80b7-47d072a8082e-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.653737 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.653579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-dshm\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.653737 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.653604    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n9j\" (UniqueName: \"kubernetes.io/projected/1c8e9228-388f-4e3a-80b7-47d072a8082e-kube-api-access-s8n9j\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.653737 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.653625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-model-cache\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.653737 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.653639    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.653737 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.653693    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-home\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.654136 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.654108    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-model-cache\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.654136 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.654134    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-home\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.654310 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.654187    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-tmp-dir\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.655903 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.655885    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-dshm\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.656297 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.656279    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8e9228-388f-4e3a-80b7-47d072a8082e-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.662557 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.662529    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8n9j\" (UniqueName: \"kubernetes.io/projected/1c8e9228-388f-4e3a-80b7-47d072a8082e-kube-api-access-s8n9j\") pod \"scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") " pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.747422 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.747302    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:09.809553 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.809522    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:09.949316 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:09.949287    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"]
Jul 28 17:52:09.951041 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:52:09.951010    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8e9228_388f_4e3a_80b7_47d072a8082e.slice/crio-64910909e8ced1171ddb72cc0cd06220f97c67b2e78214798e2867b9eb9adf10 WatchSource:0}: Error finding container 64910909e8ced1171ddb72cc0cd06220f97c67b2e78214798e2867b9eb9adf10: Status 404 returned error can't find the container with id 64910909e8ced1171ddb72cc0cd06220f97c67b2e78214798e2867b9eb9adf10
Jul 28 17:52:10.044311 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:10.044256    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:10.144318 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:10.144274    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:10.371026 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:10.370993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9" event={"ID":"1c8e9228-388f-4e3a-80b7-47d072a8082e","Type":"ContainerStarted","Data":"09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db"}
Jul 28 17:52:10.371241 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:10.371047    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9" event={"ID":"1c8e9228-388f-4e3a-80b7-47d072a8082e","Type":"ContainerStarted","Data":"64910909e8ced1171ddb72cc0cd06220f97c67b2e78214798e2867b9eb9adf10"}
Jul 28 17:52:10.390222 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:10.390169    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9" podStartSLOduration=1.390152665 podStartE2EDuration="1.390152665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:52:10.388999286 +0000 UTC m=+2117.816778554" watchObservedRunningTime="2026-07-28 17:52:10.390152665 +0000 UTC m=+2117.817931902"
Jul 28 17:52:10.810421 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:10.810385    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:17.992742 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:17.992696    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:19.462007 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:19.461963    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:19.810121 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:19.810081    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:19.823155 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:19.823129    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:20.438833 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:20.438803    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:26.833567 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:26.833501    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:27.923733 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:27.923703    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:42.739964 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:42.739928    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"]
Jul 28 17:52:42.741836 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:42.741800    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:42.749528 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:52:42.749494    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 17:52:42.749528 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:52:42.749528 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:52:42.749528 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db" cmd=["/bin/sleep","15"]
Jul 28 17:52:42.749751 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:42.749548    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9" message="" err=<
Jul 28 17:52:42.749751 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:52:42.749751 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:52:42.749751 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 17:52:42.749751 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:52:42.749561    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 17:52:42.749751 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:52:42.749751 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:52:42.749751 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9" podUID="1c8e9228-388f-4e3a-80b7-47d072a8082e" containerName="main" containerID="cri-o://09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db"
Jul 28 17:52:42.749751 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:42.749609    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9" podUID="1c8e9228-388f-4e3a-80b7-47d072a8082e" containerName="main" containerID="cri-o://09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db" gracePeriod=60
Jul 28 17:52:42.804514 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:42.804480    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:43.109535 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.109508    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:43.250477 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250443    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-dshm\") pod \"1c8e9228-388f-4e3a-80b7-47d072a8082e\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") "
Jul 28 17:52:43.250652 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250489    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-home\") pod \"1c8e9228-388f-4e3a-80b7-47d072a8082e\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") "
Jul 28 17:52:43.250652 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250524    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8n9j\" (UniqueName: \"kubernetes.io/projected/1c8e9228-388f-4e3a-80b7-47d072a8082e-kube-api-access-s8n9j\") pod \"1c8e9228-388f-4e3a-80b7-47d072a8082e\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") "
Jul 28 17:52:43.250652 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250555    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-model-cache\") pod \"1c8e9228-388f-4e3a-80b7-47d072a8082e\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") "
Jul 28 17:52:43.250652 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250592    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-tmp-dir\") pod \"1c8e9228-388f-4e3a-80b7-47d072a8082e\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") "
Jul 28 17:52:43.250652 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250644    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8e9228-388f-4e3a-80b7-47d072a8082e-tls-certs\") pod \"1c8e9228-388f-4e3a-80b7-47d072a8082e\" (UID: \"1c8e9228-388f-4e3a-80b7-47d072a8082e\") "
Jul 28 17:52:43.250932 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250777    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-home" (OuterVolumeSpecName: "home") pod "1c8e9228-388f-4e3a-80b7-47d072a8082e" (UID: "1c8e9228-388f-4e3a-80b7-47d072a8082e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:52:43.250932 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250883    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-model-cache" (OuterVolumeSpecName: "model-cache") pod "1c8e9228-388f-4e3a-80b7-47d072a8082e" (UID: "1c8e9228-388f-4e3a-80b7-47d072a8082e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:52:43.250932 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250905    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:52:43.250932 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.250903    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1c8e9228-388f-4e3a-80b7-47d072a8082e" (UID: "1c8e9228-388f-4e3a-80b7-47d072a8082e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:52:43.252703 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.252682    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-dshm" (OuterVolumeSpecName: "dshm") pod "1c8e9228-388f-4e3a-80b7-47d072a8082e" (UID: "1c8e9228-388f-4e3a-80b7-47d072a8082e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:52:43.252804 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.252770    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8e9228-388f-4e3a-80b7-47d072a8082e-kube-api-access-s8n9j" (OuterVolumeSpecName: "kube-api-access-s8n9j") pod "1c8e9228-388f-4e3a-80b7-47d072a8082e" (UID: "1c8e9228-388f-4e3a-80b7-47d072a8082e"). InnerVolumeSpecName "kube-api-access-s8n9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:52:43.252852 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.252784    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c8e9228-388f-4e3a-80b7-47d072a8082e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1c8e9228-388f-4e3a-80b7-47d072a8082e" (UID: "1c8e9228-388f-4e3a-80b7-47d072a8082e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:52:43.351970 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.351879    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c8e9228-388f-4e3a-80b7-47d072a8082e-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:52:43.351970 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.351907    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:52:43.351970 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.351916    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8n9j\" (UniqueName: \"kubernetes.io/projected/1c8e9228-388f-4e3a-80b7-47d072a8082e-kube-api-access-s8n9j\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:52:43.351970 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.351927    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:52:43.351970 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.351965    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c8e9228-388f-4e3a-80b7-47d072a8082e-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:52:43.550189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.550156    2574 generic.go:356] "Generic (PLEG): container finished" podID="1c8e9228-388f-4e3a-80b7-47d072a8082e" containerID="09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db" exitCode=0
Jul 28 17:52:43.550371 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.550200    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"
Jul 28 17:52:43.550371 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.550241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9" event={"ID":"1c8e9228-388f-4e3a-80b7-47d072a8082e","Type":"ContainerDied","Data":"09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db"}
Jul 28 17:52:43.550371 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.550294    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9" event={"ID":"1c8e9228-388f-4e3a-80b7-47d072a8082e","Type":"ContainerDied","Data":"64910909e8ced1171ddb72cc0cd06220f97c67b2e78214798e2867b9eb9adf10"}
Jul 28 17:52:43.550371 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.550317    2574 scope.go:117] "RemoveContainer" containerID="09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db"
Jul 28 17:52:43.560335 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.560318    2574 scope.go:117] "RemoveContainer" containerID="09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db"
Jul 28 17:52:43.560629 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:52:43.560607    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db\": container with ID starting with 09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db not found: ID does not exist" containerID="09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db"
Jul 28 17:52:43.560679 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.560642    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db"} err="failed to get container status \"09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db\": rpc error: code = NotFound desc = could not find container \"09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db\": container with ID starting with 09ed2f7e2e46eea047e419c34d7b744fe5eccdd1258a35548fe48f8d015d52db not found: ID does not exist"
Jul 28 17:52:43.573629 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.573598    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"]
Jul 28 17:52:43.577213 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:43.577185    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-2541cd65/scheduler-ha-replicas-test-kserve-75747c94b5-hg2r9"]
Jul 28 17:52:45.146932 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:45.146832    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c8e9228-388f-4e3a-80b7-47d072a8082e" path="/var/lib/kubelet/pods/1c8e9228-388f-4e3a-80b7-47d072a8082e/volumes"
Jul 28 17:52:46.882586 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:46.882539    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:46.980292 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:46.980252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:50.116536 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.116500    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"]
Jul 28 17:52:50.117033 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.116952    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8e9228-388f-4e3a-80b7-47d072a8082e" containerName="main"
Jul 28 17:52:50.117033 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.116965    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8e9228-388f-4e3a-80b7-47d072a8082e" containerName="main"
Jul 28 17:52:50.117139 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.117041    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8e9228-388f-4e3a-80b7-47d072a8082e" containerName="main"
Jul 28 17:52:50.121373 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.121351    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.127231 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.127210    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4\"/\"openshift-service-ca.crt\""
Jul 28 17:52:50.127231 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.127228    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4\"/\"kube-root-ca.crt\""
Jul 28 17:52:50.127406 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.127217    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4\"/\"default-dockercfg-dk22b\""
Jul 28 17:52:50.127406 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.127209    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4\"/\"autoscale-hpa-deploy-kserve-self-signed-certs\""
Jul 28 17:52:50.137937 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.137912    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"]
Jul 28 17:52:50.167573 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.167534    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:50.207822 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.207784    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-home\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.208016 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.207845    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-tmp-dir\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.208016 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.207933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4d9s\" (UniqueName: \"kubernetes.io/projected/41c6ba76-0a66-4faf-a91f-2b64d0671601-kube-api-access-m4d9s\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.208016 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.207964    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c6ba76-0a66-4faf-a91f-2b64d0671601-tls-certs\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.208205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.208050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-dshm\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.208205 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.208092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-model-cache\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.309383 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.309337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-dshm\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.309383 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.309383    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-model-cache\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.309661 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.309423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-home\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.309661 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.309459    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-tmp-dir\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.309661 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.309630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4d9s\" (UniqueName: \"kubernetes.io/projected/41c6ba76-0a66-4faf-a91f-2b64d0671601-kube-api-access-m4d9s\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.309832 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.309678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c6ba76-0a66-4faf-a91f-2b64d0671601-tls-certs\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.309936 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.309850    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-model-cache\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.309936 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.309914    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-tmp-dir\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.310024 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.309953    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-home\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.311678 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.311652    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-dshm\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.312008 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.311991    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c6ba76-0a66-4faf-a91f-2b64d0671601-tls-certs\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.318786 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.318759    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4d9s\" (UniqueName: \"kubernetes.io/projected/41c6ba76-0a66-4faf-a91f-2b64d0671601-kube-api-access-m4d9s\") pod \"autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") " pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.430148 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.430051    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:50.431986 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.431963    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:50.601731 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:50.601708    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"]
Jul 28 17:52:50.603619 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:52:50.603591    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c6ba76_0a66_4faf_a91f_2b64d0671601.slice/crio-f272f5b279de9c0b38f2217d946b628cfe1ab0165c9cafa846a47d91c2004fc8 WatchSource:0}: Error finding container f272f5b279de9c0b38f2217d946b628cfe1ab0165c9cafa846a47d91c2004fc8: Status 404 returned error can't find the container with id f272f5b279de9c0b38f2217d946b628cfe1ab0165c9cafa846a47d91c2004fc8
Jul 28 17:52:51.600182 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:51.600148    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s" event={"ID":"41c6ba76-0a66-4faf-a91f-2b64d0671601","Type":"ContainerStarted","Data":"4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110"}
Jul 28 17:52:51.600605 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:51.600198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s" event={"ID":"41c6ba76-0a66-4faf-a91f-2b64d0671601","Type":"ContainerStarted","Data":"f272f5b279de9c0b38f2217d946b628cfe1ab0165c9cafa846a47d91c2004fc8"}
Jul 28 17:52:51.630359 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:51.630303    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s" podStartSLOduration=1.630287689 podStartE2EDuration="1.630287689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:52:51.626754386 +0000 UTC m=+2159.054533624" watchObservedRunningTime="2026-07-28 17:52:51.630287689 +0000 UTC m=+2159.058066927"
Jul 28 17:52:52.432572 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:52.432536    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:52:54.210982 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:52:54.210944    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:00.127811 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:00.127774    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:00.184767 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:00.184731    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:00.432509 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:00.432416    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:53:00.445134 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:00.445106    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:53:00.658241 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:00.658208    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 17:53:02.780570 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:02.780536    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:02.879923 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:02.879887    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:09.141057 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:09.141010    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:10.632701 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:10.632663    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:15.206497 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:15.206465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:15.307214 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:15.307182    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:22.725374 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:22.725337    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:22.961380 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:22.961347    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:34.430313 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:34.430279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:56.327794 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:56.327756    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:56.383867 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:53:56.383830    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:16.223868 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:54:16.223782    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:16.316115 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:54:16.316062    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:22.709858 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:54:22.709823    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:28.539296 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:54:28.539264    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:28.640418 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:54:28.640386    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:36.499479 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:54:36.499442    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:36.703839 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:54:36.703807    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:42.431438 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:54:42.431407    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:51.258861 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:54:51.258825    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:10.659607 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:10.659573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:10.734279 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:10.734243    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:21.667132 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:21.667079    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:21.736989 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:21.736950    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:30.568978 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:30.568936    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:30.670251 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:30.670216    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:31.244209 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:31.244166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:37.602787 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:37.602751    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:44.199907 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:44.199826    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:44.300242 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:44.300209    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:50.724813 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:50.724775    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:50.957690 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:55:50.957647    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:06.288360 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:06.288326    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:24.962589 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:24.962538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:25.049371 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:25.049322    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:44.959611 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:44.959564    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:45.098209 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:45.098166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:45.174935 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:45.174902    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:51.837022 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:51.836985    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:53.282630 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:53.282585    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:56:53.292466 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:53.292446    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 17:56:58.162371 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:58.162327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:58.231053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:56:58.231016    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:57:07.733131 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.733091    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"]
Jul 28 17:57:07.737048 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.737030    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.738545 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.738521    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-kserve-provision-location\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.738635 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.738556    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-tmp-dir\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.738635 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.738604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-model-cache\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.738635 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.738626    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzvv\" (UniqueName: \"kubernetes.io/projected/978167b9-8509-4cbb-85a8-718cc4edc231-kube-api-access-jfzvv\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.738741 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.738721    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/978167b9-8509-4cbb-85a8-718cc4edc231-tls-certs\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.738791 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.738780    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-home\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.738833 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.738804    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-dshm\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.740304 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.740283    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"openshift-service-ca.crt\""
Jul 28 17:57:07.741576 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.741558    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"default-dockercfg-8vd9t\""
Jul 28 17:57:07.741685 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.741574    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"seaweedfs-s3-creds\""
Jul 28 17:57:07.741685 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.741590    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"kube-root-ca.crt\""
Jul 28 17:57:07.741685 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.741579    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"tokenizer-clean-path-test-kserve-self-signed-certs\""
Jul 28 17:57:07.747730 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.747702    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:57:07.749612 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.749588    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"]
Jul 28 17:57:07.839221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-kserve-provision-location\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839221 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839224    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-tmp-dir\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839504 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839260    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-model-cache\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839504 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839290    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzvv\" (UniqueName: \"kubernetes.io/projected/978167b9-8509-4cbb-85a8-718cc4edc231-kube-api-access-jfzvv\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839504 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/978167b9-8509-4cbb-85a8-718cc4edc231-tls-certs\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839504 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839365    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-home\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839504 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-dshm\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839764 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839666    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-tmp-dir\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839764 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-kserve-provision-location\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839764 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839740    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-model-cache\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.839917 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.839764    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-home\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.841706 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.841682    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-dshm\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.842049 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.842025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/978167b9-8509-4cbb-85a8-718cc4edc231-tls-certs\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:07.849360 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:07.849332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzvv\" (UniqueName: \"kubernetes.io/projected/978167b9-8509-4cbb-85a8-718cc4edc231-kube-api-access-jfzvv\") pod \"tokenizer-clean-path-test-kserve-79847955cc-spwmp\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:08.001964 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:08.001852    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:57:08.049089 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:08.049034    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:08.122710 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:08.122675    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:57:08.191528 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:08.191502    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"]
Jul 28 17:57:08.193752 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:57:08.193717    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978167b9_8509_4cbb_85a8_718cc4edc231.slice/crio-c355d3bf4c554acb4ec19e47f4656140aa72e6c32556d38518b05d7ff4050a69 WatchSource:0}: Error finding container c355d3bf4c554acb4ec19e47f4656140aa72e6c32556d38518b05d7ff4050a69: Status 404 returned error can't find the container with id c355d3bf4c554acb4ec19e47f4656140aa72e6c32556d38518b05d7ff4050a69
Jul 28 17:57:08.984950 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:08.984918    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" event={"ID":"978167b9-8509-4cbb-85a8-718cc4edc231","Type":"ContainerStarted","Data":"d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae"}
Jul 28 17:57:08.985387 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:08.984969    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" event={"ID":"978167b9-8509-4cbb-85a8-718cc4edc231","Type":"ContainerStarted","Data":"c355d3bf4c554acb4ec19e47f4656140aa72e6c32556d38518b05d7ff4050a69"}
Jul 28 17:57:13.017552 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:13.017516    2574 generic.go:356] "Generic (PLEG): container finished" podID="978167b9-8509-4cbb-85a8-718cc4edc231" containerID="d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae" exitCode=0
Jul 28 17:57:13.017996 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:13.017589    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" event={"ID":"978167b9-8509-4cbb-85a8-718cc4edc231","Type":"ContainerDied","Data":"d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae"}
Jul 28 17:57:14.024664 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:14.024630    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" event={"ID":"978167b9-8509-4cbb-85a8-718cc4edc231","Type":"ContainerStarted","Data":"d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722"}
Jul 28 17:57:14.049277 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:14.049248    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:14.051566 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:14.051525    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" podStartSLOduration=2.4990047349999998 podStartE2EDuration="7.051511347s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.552506612s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:57:14.048330652 +0000 UTC m=+2421.476109921" watchObservedRunningTime="2026-07-28 17:57:14.051511347 +0000 UTC m=+2421.479290584"
Jul 28 17:57:16.307709 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:16.307671    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:57:18.049191 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:18.049160    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:18.061989 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:18.061961    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:19.060382 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:19.060353    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:57:54.357945 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:54.357910    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:57:55.622453 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:57:55.622421    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:20.658253 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:20.658215    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:20.673415 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:20.673383    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"]
Jul 28 17:58:20.683939 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:58:20.683897    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 17:58:20.683939 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:58:20.683939 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:58:20.683939 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722" cmd=["/bin/sleep","15"]
Jul 28 17:58:20.684224 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:20.683960    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" message="" err=<
Jul 28 17:58:20.684224 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:58:20.684224 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:58:20.684224 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 17:58:20.684224 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:58:20.683978    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 17:58:20.684224 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:58:20.684224 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:58:20.684224 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" podUID="978167b9-8509-4cbb-85a8-718cc4edc231" containerName="main" containerID="cri-o://d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722"
Jul 28 17:58:20.684224 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:20.684104    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" podUID="978167b9-8509-4cbb-85a8-718cc4edc231" containerName="main" containerID="cri-o://d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722" gracePeriod=60
Jul 28 17:58:20.754934 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:20.754899    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:21.040527 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.040496    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:58:21.101634 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.101601    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfzvv\" (UniqueName: \"kubernetes.io/projected/978167b9-8509-4cbb-85a8-718cc4edc231-kube-api-access-jfzvv\") pod \"978167b9-8509-4cbb-85a8-718cc4edc231\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") "
Jul 28 17:58:21.101634 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.101637    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/978167b9-8509-4cbb-85a8-718cc4edc231-tls-certs\") pod \"978167b9-8509-4cbb-85a8-718cc4edc231\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") "
Jul 28 17:58:21.101886 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.101658    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-model-cache\") pod \"978167b9-8509-4cbb-85a8-718cc4edc231\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") "
Jul 28 17:58:21.101886 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.101676    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-tmp-dir\") pod \"978167b9-8509-4cbb-85a8-718cc4edc231\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") "
Jul 28 17:58:21.101886 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.101692    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-dshm\") pod \"978167b9-8509-4cbb-85a8-718cc4edc231\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") "
Jul 28 17:58:21.101886 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.101710    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-kserve-provision-location\") pod \"978167b9-8509-4cbb-85a8-718cc4edc231\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") "
Jul 28 17:58:21.101886 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.101780    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-home\") pod \"978167b9-8509-4cbb-85a8-718cc4edc231\" (UID: \"978167b9-8509-4cbb-85a8-718cc4edc231\") "
Jul 28 17:58:21.102184 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.101991    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-model-cache" (OuterVolumeSpecName: "model-cache") pod "978167b9-8509-4cbb-85a8-718cc4edc231" (UID: "978167b9-8509-4cbb-85a8-718cc4edc231"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:58:21.102184 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.102003    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "978167b9-8509-4cbb-85a8-718cc4edc231" (UID: "978167b9-8509-4cbb-85a8-718cc4edc231"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:58:21.102184 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.102154    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:58:21.102184 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.102174    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:58:21.102390 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.102203    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-home" (OuterVolumeSpecName: "home") pod "978167b9-8509-4cbb-85a8-718cc4edc231" (UID: "978167b9-8509-4cbb-85a8-718cc4edc231"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:58:21.104098 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.104061    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-dshm" (OuterVolumeSpecName: "dshm") pod "978167b9-8509-4cbb-85a8-718cc4edc231" (UID: "978167b9-8509-4cbb-85a8-718cc4edc231"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:58:21.104227 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.104097    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978167b9-8509-4cbb-85a8-718cc4edc231-kube-api-access-jfzvv" (OuterVolumeSpecName: "kube-api-access-jfzvv") pod "978167b9-8509-4cbb-85a8-718cc4edc231" (UID: "978167b9-8509-4cbb-85a8-718cc4edc231"). InnerVolumeSpecName "kube-api-access-jfzvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:58:21.104411 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.104388    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/978167b9-8509-4cbb-85a8-718cc4edc231-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "978167b9-8509-4cbb-85a8-718cc4edc231" (UID: "978167b9-8509-4cbb-85a8-718cc4edc231"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:58:21.159911 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.159871    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "978167b9-8509-4cbb-85a8-718cc4edc231" (UID: "978167b9-8509-4cbb-85a8-718cc4edc231"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:58:21.203600 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.203491    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfzvv\" (UniqueName: \"kubernetes.io/projected/978167b9-8509-4cbb-85a8-718cc4edc231-kube-api-access-jfzvv\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:58:21.203600 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.203541    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/978167b9-8509-4cbb-85a8-718cc4edc231-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:58:21.203600 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.203556    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:58:21.203600 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.203568    2574 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-kserve-provision-location\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:58:21.203600 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.203582    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/978167b9-8509-4cbb-85a8-718cc4edc231-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:58:21.394189 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.394152    2574 generic.go:356] "Generic (PLEG): container finished" podID="978167b9-8509-4cbb-85a8-718cc4edc231" containerID="d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722" exitCode=0
Jul 28 17:58:21.394375 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.394218    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" event={"ID":"978167b9-8509-4cbb-85a8-718cc4edc231","Type":"ContainerDied","Data":"d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722"}
Jul 28 17:58:21.394375 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.394274    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp" event={"ID":"978167b9-8509-4cbb-85a8-718cc4edc231","Type":"ContainerDied","Data":"c355d3bf4c554acb4ec19e47f4656140aa72e6c32556d38518b05d7ff4050a69"}
Jul 28 17:58:21.394375 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.394303    2574 scope.go:117] "RemoveContainer" containerID="d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722"
Jul 28 17:58:21.394375 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.394340    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"
Jul 28 17:58:21.404381 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.404358    2574 scope.go:117] "RemoveContainer" containerID="d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae"
Jul 28 17:58:21.413193 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.413173    2574 scope.go:117] "RemoveContainer" containerID="d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722"
Jul 28 17:58:21.413437 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:58:21.413413    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722\": container with ID starting with d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722 not found: ID does not exist" containerID="d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722"
Jul 28 17:58:21.413500 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.413445    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722"} err="failed to get container status \"d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722\": rpc error: code = NotFound desc = could not find container \"d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722\": container with ID starting with d8a4d0458af192a512f18db245e00dbdc02f8a3fbdfce8687c8602567c652722 not found: ID does not exist"
Jul 28 17:58:21.413500 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.413464    2574 scope.go:117] "RemoveContainer" containerID="d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae"
Jul 28 17:58:21.413710 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:58:21.413691    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae\": container with ID starting with d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae not found: ID does not exist" containerID="d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae"
Jul 28 17:58:21.413748 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.413717    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae"} err="failed to get container status \"d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae\": rpc error: code = NotFound desc = could not find container \"d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae\": container with ID starting with d3a45fed43937527f0491980b3a1461e854772fa69d388ba34c3da4b35b73aae not found: ID does not exist"
Jul 28 17:58:21.419385 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.419359    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"]
Jul 28 17:58:21.423796 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:21.423772    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-79847955cc-spwmp"]
Jul 28 17:58:23.147371 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:23.147338    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="978167b9-8509-4cbb-85a8-718cc4edc231" path="/var/lib/kubelet/pods/978167b9-8509-4cbb-85a8-718cc4edc231/volumes"
Jul 28 17:58:39.661056 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:39.661018    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:40.298761 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:40.298722    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:40.395365 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:40.395323    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:44.702177 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.702077    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:44.799484 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.799451    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"]
Jul 28 17:58:44.799841 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.799829    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978167b9-8509-4cbb-85a8-718cc4edc231" containerName="main"
Jul 28 17:58:44.799897 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.799842    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="978167b9-8509-4cbb-85a8-718cc4edc231" containerName="main"
Jul 28 17:58:44.799897 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.799867    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978167b9-8509-4cbb-85a8-718cc4edc231" containerName="storage-initializer"
Jul 28 17:58:44.799897 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.799873    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="978167b9-8509-4cbb-85a8-718cc4edc231" containerName="storage-initializer"
Jul 28 17:58:44.800060 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.799932    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="978167b9-8509-4cbb-85a8-718cc4edc231" containerName="main"
Jul 28 17:58:44.802261 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.802240    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:44.807152 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.807116    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"seaweedfs-s3-creds\""
Jul 28 17:58:44.807373 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.807357    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"kube-root-ca.crt\""
Jul 28 17:58:44.807766 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.807749    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"openshift-service-ca.crt\""
Jul 28 17:58:44.808685 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.808664    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"tokenizer-migration-path-test-kserve-self-signed-certs\""
Jul 28 17:58:44.808802 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.808692    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"default-dockercfg-fxwf7\""
Jul 28 17:58:44.823228 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.823197    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"]
Jul 28 17:58:44.921825 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.921782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tls-certs\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:44.922036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.921851    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tmp-dir\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:44.922036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.921894    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4ms5\" (UniqueName: \"kubernetes.io/projected/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kube-api-access-t4ms5\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:44.922036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.921921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-model-cache\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:44.922036 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.921954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kserve-provision-location\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:44.922255 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.922097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-home\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:44.922255 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:44.922127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-dshm\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.023308 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.023256    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-home\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.023515 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.023328    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-dshm\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.023515 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.023377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tls-certs\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.023515 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.023437    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tmp-dir\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.023515 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.023472    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4ms5\" (UniqueName: \"kubernetes.io/projected/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kube-api-access-t4ms5\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.023515 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.023504    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-model-cache\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.023766 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.023553    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kserve-provision-location\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.023766 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.023651    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-home\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.023951 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.023927    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kserve-provision-location\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.024650 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.024620    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-model-cache\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.024970 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.024943    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tmp-dir\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.031462 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.031398    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tls-certs\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.031970 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.031947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-dshm\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.035513 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.035484    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4ms5\" (UniqueName: \"kubernetes.io/projected/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kube-api-access-t4ms5\") pod \"tokenizer-migration-path-test-kserve-754b496dd-7qr8l\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.112896 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.112859    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:45.117031 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.116996    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:45.215874 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.215836    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:45.275770 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.275735    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"]
Jul 28 17:58:45.276360 ip-10-0-140-52 kubenswrapper[2574]: W0728 17:58:45.276291    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876212df_3615_4ac8_b1e7_a1f1cfa4fe04.slice/crio-3f9956ce6d2d9084d005a600ae9049c1f2c1aeea1f6798d6b1d661f6832cba61 WatchSource:0}: Error finding container 3f9956ce6d2d9084d005a600ae9049c1f2c1aeea1f6798d6b1d661f6832cba61: Status 404 returned error can't find the container with id 3f9956ce6d2d9084d005a600ae9049c1f2c1aeea1f6798d6b1d661f6832cba61
Jul 28 17:58:45.523411 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.523375    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" event={"ID":"876212df-3615-4ac8-b1e7-a1f1cfa4fe04","Type":"ContainerStarted","Data":"ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4"}
Jul 28 17:58:45.523589 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:45.523433    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" event={"ID":"876212df-3615-4ac8-b1e7-a1f1cfa4fe04","Type":"ContainerStarted","Data":"3f9956ce6d2d9084d005a600ae9049c1f2c1aeea1f6798d6b1d661f6832cba61"}
Jul 28 17:58:47.878758 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:47.878690    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:51.562446 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:51.562393    2574 generic.go:356] "Generic (PLEG): container finished" podID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" containerID="ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4" exitCode=0
Jul 28 17:58:51.562446 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:51.562450    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" event={"ID":"876212df-3615-4ac8-b1e7-a1f1cfa4fe04","Type":"ContainerDied","Data":"ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4"}
Jul 28 17:58:52.569794 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:52.569759    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" event={"ID":"876212df-3615-4ac8-b1e7-a1f1cfa4fe04","Type":"ContainerStarted","Data":"25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db"}
Jul 28 17:58:52.592965 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:52.592907    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" podStartSLOduration=3.151010405 podStartE2EDuration="8.592889761s" totalImagesPullingTime="0s" totalInitContainerRuntime="5.441879356s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:58:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:58:52.590503892 +0000 UTC m=+2520.018283130" watchObservedRunningTime="2026-07-28 17:58:52.592889761 +0000 UTC m=+2520.020668998"
Jul 28 17:58:53.113264 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:53.113228    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:54.164464 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:54.164403    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:54.225357 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:54.225326    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:55.113082 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:55.113040    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:55.125800 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:55.125775    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:58:55.393375 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:55.393276    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:58:55.598476 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:58:55.598450    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:59:23.820273 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:23.820240    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:59:23.842654 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:23.842617    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"]
Jul 28 17:59:23.852441 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:59:23.852401    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 17:59:23.852441 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:59:23.852441 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:59:23.852441 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db" cmd=["/bin/sleep","15"]
Jul 28 17:59:23.852803 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:23.852454    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" message="" err=<
Jul 28 17:59:23.852803 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:59:23.852803 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:59:23.852803 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 17:59:23.852803 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:59:23.852467    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 17:59:23.852803 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 17:59:23.852803 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 17:59:23.852803 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" podUID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" containerName="main" containerID="cri-o://25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db"
Jul 28 17:59:23.852803 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:23.852506    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" podUID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" containerName="main" containerID="cri-o://25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db" gracePeriod=60
Jul 28 17:59:23.899045 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:23.899012    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:59:24.103408 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.103383    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:59:24.192386 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192352    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tmp-dir\") pod \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") "
Jul 28 17:59:24.192386 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192391    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kserve-provision-location\") pod \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") "
Jul 28 17:59:24.192617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192455    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-home\") pod \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") "
Jul 28 17:59:24.192617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192530    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tls-certs\") pod \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") "
Jul 28 17:59:24.192617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192558    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4ms5\" (UniqueName: \"kubernetes.io/projected/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kube-api-access-t4ms5\") pod \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") "
Jul 28 17:59:24.192617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192578    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-model-cache\") pod \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") "
Jul 28 17:59:24.192617 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192601    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-dshm\") pod \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\" (UID: \"876212df-3615-4ac8-b1e7-a1f1cfa4fe04\") "
Jul 28 17:59:24.192875 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192688    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "876212df-3615-4ac8-b1e7-a1f1cfa4fe04" (UID: "876212df-3615-4ac8-b1e7-a1f1cfa4fe04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:59:24.192875 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192758    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-home" (OuterVolumeSpecName: "home") pod "876212df-3615-4ac8-b1e7-a1f1cfa4fe04" (UID: "876212df-3615-4ac8-b1e7-a1f1cfa4fe04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:59:24.192987 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192896    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:59:24.192987 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192912    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:59:24.192987 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.192926    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-model-cache" (OuterVolumeSpecName: "model-cache") pod "876212df-3615-4ac8-b1e7-a1f1cfa4fe04" (UID: "876212df-3615-4ac8-b1e7-a1f1cfa4fe04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:59:24.194955 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.194933    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-dshm" (OuterVolumeSpecName: "dshm") pod "876212df-3615-4ac8-b1e7-a1f1cfa4fe04" (UID: "876212df-3615-4ac8-b1e7-a1f1cfa4fe04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:59:24.195169 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.195142    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "876212df-3615-4ac8-b1e7-a1f1cfa4fe04" (UID: "876212df-3615-4ac8-b1e7-a1f1cfa4fe04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:59:24.195271 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.195251    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kube-api-access-t4ms5" (OuterVolumeSpecName: "kube-api-access-t4ms5") pod "876212df-3615-4ac8-b1e7-a1f1cfa4fe04" (UID: "876212df-3615-4ac8-b1e7-a1f1cfa4fe04"). InnerVolumeSpecName "kube-api-access-t4ms5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:59:24.250620 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.250577    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "876212df-3615-4ac8-b1e7-a1f1cfa4fe04" (UID: "876212df-3615-4ac8-b1e7-a1f1cfa4fe04"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:59:24.293888 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.293852    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:59:24.293888 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.293881    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4ms5\" (UniqueName: \"kubernetes.io/projected/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kube-api-access-t4ms5\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:59:24.293888 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.293890    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:59:24.293888 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.293899    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:59:24.294195 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.293907    2574 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/876212df-3615-4ac8-b1e7-a1f1cfa4fe04-kserve-provision-location\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 17:59:24.749053 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.749014    2574 generic.go:356] "Generic (PLEG): container finished" podID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" containerID="25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db" exitCode=0
Jul 28 17:59:24.749259 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.749079    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"
Jul 28 17:59:24.749259 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.749118    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" event={"ID":"876212df-3615-4ac8-b1e7-a1f1cfa4fe04","Type":"ContainerDied","Data":"25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db"}
Jul 28 17:59:24.749259 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.749172    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l" event={"ID":"876212df-3615-4ac8-b1e7-a1f1cfa4fe04","Type":"ContainerDied","Data":"3f9956ce6d2d9084d005a600ae9049c1f2c1aeea1f6798d6b1d661f6832cba61"}
Jul 28 17:59:24.749259 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.749193    2574 scope.go:117] "RemoveContainer" containerID="25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db"
Jul 28 17:59:24.758913 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.758889    2574 scope.go:117] "RemoveContainer" containerID="ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4"
Jul 28 17:59:24.768568 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.768540    2574 scope.go:117] "RemoveContainer" containerID="25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db"
Jul 28 17:59:24.768906 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:59:24.768888    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db\": container with ID starting with 25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db not found: ID does not exist" containerID="25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db"
Jul 28 17:59:24.768963 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.768917    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db"} err="failed to get container status \"25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db\": rpc error: code = NotFound desc = could not find container \"25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db\": container with ID starting with 25809f31cc9c908757d1ca93a8302b798df1a22fa2de9ac95002181293f942db not found: ID does not exist"
Jul 28 17:59:24.768963 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.768935    2574 scope.go:117] "RemoveContainer" containerID="ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4"
Jul 28 17:59:24.769205 ip-10-0-140-52 kubenswrapper[2574]: E0728 17:59:24.769183    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4\": container with ID starting with ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4 not found: ID does not exist" containerID="ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4"
Jul 28 17:59:24.769272 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.769207    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4"} err="failed to get container status \"ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4\": rpc error: code = NotFound desc = could not find container \"ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4\": container with ID starting with ce758ec86cbf275b8cbf0eece1abfd50fa8808b7791fb271b67f38183f9a88e4 not found: ID does not exist"
Jul 28 17:59:24.775043 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.775013    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"]
Jul 28 17:59:24.778748 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:24.778721    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-754b496dd-7qr8l"]
Jul 28 17:59:25.147341 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:25.147307    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" path="/var/lib/kubelet/pods/876212df-3615-4ac8-b1e7-a1f1cfa4fe04/volumes"
Jul 28 17:59:43.875347 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:43.875307    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:59:43.966512 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:43.966473    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:59:50.830308 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:50.830275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:59:52.137252 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:52.137209    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:59:52.467503 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:52.467414    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:59:56.344319 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:56.344282    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:59:57.594474 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:57.594441    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 17:59:57.669434 ip-10-0-140-52 kubenswrapper[2574]: I0728 17:59:57.669401    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:06.155758 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:06.155702    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:25.911661 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:25.911563    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:26.021485 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:26.021451    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:45.911598 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:45.911561    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:46.015300 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:46.015263    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:46.117554 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:46.117514    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:51.039740 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:51.039696    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:51.475865 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:51.475781    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:53.692079 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:53.692038    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:59.697531 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:59.697492    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:00:59.762890 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:00:59.762849    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:01:01.938301 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:01:01.938261    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:01:05.500309 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:01:05.500275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:01:50.747609 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:01:50.747525    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:01:50.963624 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:01:50.963594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:01:53.325485 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:01:53.325458    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:01:53.337494 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:01:53.337470    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:02:03.645793 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:02:03.645748    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:02:24.239811 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:02:24.239778    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:02:24.378986 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:02:24.378955    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:02:45.125477 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:02:45.125436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:02:45.215797 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:02:45.215762    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:04.391730 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:04.391685    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:05.969811 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:05.969776    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:07.682907 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:07.682870    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:10.744062 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:10.744025    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:12.305751 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:12.305710    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:12.623197 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:12.623108    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:16.746738 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:16.746648    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:16.847986 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:16.847943    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:23.522812 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:23.522776    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:53.835383 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:53.835327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:03:54.106670 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:03:54.106582    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:04:19.086488 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:04:19.086453    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:04:28.863017 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:04:28.862982    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:04:28.934802 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:04:28.934761    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:04:37.529198 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:04:37.529163    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:04:48.492277 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:04:48.492161    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:04:48.594135 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:04:48.594104    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:08.466801 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:05:08.466769    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:08.584744 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:05:08.584697    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:08.693681 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:05:08.693648    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:17.932217 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:05:17.932182    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:23.801190 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:05:23.801156    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:24.176404 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:05:24.176294    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:26.930578 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:05:26.930546    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:27.054451 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:05:27.054391    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:36.322244 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:05:36.322196    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:06:53.359954 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:06:53.359920    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:06:53.375339 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:06:53.375316    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:07:11.822521 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:11.822473    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:11.899427 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:11.899388    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:31.522172 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:31.522128    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:31.624058 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:31.624000    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:38.313574 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:38.313525    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:44.001224 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:44.001183    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:44.061389 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:44.061353    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:44.934640 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:44.934594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:45.202447 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:45.202358    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:49.423910 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.423876    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"]
Jul 28 18:07:49.426359 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.426315    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:49.434261 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:07:49.434223    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 18:07:49.434261 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:07:49.434261 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:07:49.434261 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110" cmd=["/bin/sleep","15"]
Jul 28 18:07:49.434569 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.434285    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s" message="" err=<
Jul 28 18:07:49.434569 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:07:49.434569 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:07:49.434569 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 18:07:49.434569 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:07:49.434301    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 18:07:49.434569 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:07:49.434569 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:07:49.434569 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s" podUID="41c6ba76-0a66-4faf-a91f-2b64d0671601" containerName="main" containerID="cri-o://4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110"
Jul 28 18:07:49.434569 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.434362    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s" podUID="41c6ba76-0a66-4faf-a91f-2b64d0671601" containerName="main" containerID="cri-o://4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110" gracePeriod=60
Jul 28 18:07:49.527419 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.527384    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:49.692743 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.692717    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 18:07:49.789024 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.788986    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4d9s\" (UniqueName: \"kubernetes.io/projected/41c6ba76-0a66-4faf-a91f-2b64d0671601-kube-api-access-m4d9s\") pod \"41c6ba76-0a66-4faf-a91f-2b64d0671601\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") "
Jul 28 18:07:49.789232 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789041    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-home\") pod \"41c6ba76-0a66-4faf-a91f-2b64d0671601\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") "
Jul 28 18:07:49.789232 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789059    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c6ba76-0a66-4faf-a91f-2b64d0671601-tls-certs\") pod \"41c6ba76-0a66-4faf-a91f-2b64d0671601\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") "
Jul 28 18:07:49.789232 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789104    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-model-cache\") pod \"41c6ba76-0a66-4faf-a91f-2b64d0671601\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") "
Jul 28 18:07:49.789232 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789130    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-dshm\") pod \"41c6ba76-0a66-4faf-a91f-2b64d0671601\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") "
Jul 28 18:07:49.789232 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789181    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-tmp-dir\") pod \"41c6ba76-0a66-4faf-a91f-2b64d0671601\" (UID: \"41c6ba76-0a66-4faf-a91f-2b64d0671601\") "
Jul 28 18:07:49.789472 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789372    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-home" (OuterVolumeSpecName: "home") pod "41c6ba76-0a66-4faf-a91f-2b64d0671601" (UID: "41c6ba76-0a66-4faf-a91f-2b64d0671601"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:07:49.789472 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789395    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-model-cache" (OuterVolumeSpecName: "model-cache") pod "41c6ba76-0a66-4faf-a91f-2b64d0671601" (UID: "41c6ba76-0a66-4faf-a91f-2b64d0671601"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:07:49.789592 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789488    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:07:49.789592 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789505    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:07:49.789699 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.789589    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "41c6ba76-0a66-4faf-a91f-2b64d0671601" (UID: "41c6ba76-0a66-4faf-a91f-2b64d0671601"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:07:49.791317 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.791291    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-dshm" (OuterVolumeSpecName: "dshm") pod "41c6ba76-0a66-4faf-a91f-2b64d0671601" (UID: "41c6ba76-0a66-4faf-a91f-2b64d0671601"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:07:49.791423 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.791353    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41c6ba76-0a66-4faf-a91f-2b64d0671601-kube-api-access-m4d9s" (OuterVolumeSpecName: "kube-api-access-m4d9s") pod "41c6ba76-0a66-4faf-a91f-2b64d0671601" (UID: "41c6ba76-0a66-4faf-a91f-2b64d0671601"). InnerVolumeSpecName "kube-api-access-m4d9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:07:49.791423 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.791393    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41c6ba76-0a66-4faf-a91f-2b64d0671601-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "41c6ba76-0a66-4faf-a91f-2b64d0671601" (UID: "41c6ba76-0a66-4faf-a91f-2b64d0671601"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:07:49.889881 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.889830    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c6ba76-0a66-4faf-a91f-2b64d0671601-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:07:49.889881 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.889874    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:07:49.889881 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.889883    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c6ba76-0a66-4faf-a91f-2b64d0671601-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:07:49.889881 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:49.889892    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4d9s\" (UniqueName: \"kubernetes.io/projected/41c6ba76-0a66-4faf-a91f-2b64d0671601-kube-api-access-m4d9s\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:07:50.502487 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.502436    2574 generic.go:356] "Generic (PLEG): container finished" podID="41c6ba76-0a66-4faf-a91f-2b64d0671601" containerID="4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110" exitCode=0
Jul 28 18:07:50.502487 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.502479    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"
Jul 28 18:07:50.502982 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.502506    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s" event={"ID":"41c6ba76-0a66-4faf-a91f-2b64d0671601","Type":"ContainerDied","Data":"4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110"}
Jul 28 18:07:50.502982 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.502549    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s" event={"ID":"41c6ba76-0a66-4faf-a91f-2b64d0671601","Type":"ContainerDied","Data":"f272f5b279de9c0b38f2217d946b628cfe1ab0165c9cafa846a47d91c2004fc8"}
Jul 28 18:07:50.502982 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.502570    2574 scope.go:117] "RemoveContainer" containerID="4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110"
Jul 28 18:07:50.512799 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.512783    2574 scope.go:117] "RemoveContainer" containerID="4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110"
Jul 28 18:07:50.513050 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:07:50.513032    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110\": container with ID starting with 4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110 not found: ID does not exist" containerID="4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110"
Jul 28 18:07:50.513143 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.513059    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110"} err="failed to get container status \"4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110\": rpc error: code = NotFound desc = could not find container \"4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110\": container with ID starting with 4fd4949004cb5e4d5f4487a9ab24e267a7e2dcd672350c0533bf0749e191d110 not found: ID does not exist"
Jul 28 18:07:50.526932 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.526897    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"]
Jul 28 18:07:50.529023 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.529003    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s"]
Jul 28 18:07:50.648493 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:50.648449    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-autoscaling-hpa-deployment-9ba6f3f4/autoscale-hpa-deploy-kserve-66746bd8b9-pbt4s" podUID="41c6ba76-0a66-4faf-a91f-2b64d0671601" containerName="main" probeResult="failure" output="Get \"https://10.133.0.52:8000/health\": context deadline exceeded"
Jul 28 18:07:51.148620 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:51.148583    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41c6ba76-0a66-4faf-a91f-2b64d0671601" path="/var/lib/kubelet/pods/41c6ba76-0a66-4faf-a91f-2b64d0671601/volumes"
Jul 28 18:07:52.583258 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:52.583222    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:07:52.682601 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:07:52.682563    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:08:07.053616 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:07.053571    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:08:08.627094 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:08.627028    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:08:08.727325 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:08.727288    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:08:25.402218 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.402185    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"]
Jul 28 18:08:25.402727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.402570    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41c6ba76-0a66-4faf-a91f-2b64d0671601" containerName="main"
Jul 28 18:08:25.402727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.402581    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="41c6ba76-0a66-4faf-a91f-2b64d0671601" containerName="main"
Jul 28 18:08:25.402727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.402595    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" containerName="main"
Jul 28 18:08:25.402727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.402602    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" containerName="main"
Jul 28 18:08:25.402727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.402615    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" containerName="storage-initializer"
Jul 28 18:08:25.402727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.402621    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" containerName="storage-initializer"
Jul 28 18:08:25.402727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.402694    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="876212df-3615-4ac8-b1e7-a1f1cfa4fe04" containerName="main"
Jul 28 18:08:25.402727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.402701    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="41c6ba76-0a66-4faf-a91f-2b64d0671601" containerName="main"
Jul 28 18:08:25.405739 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.405721    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.410044 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.410017    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-deployment-b2150d0b\"/\"default-dockercfg-fnljc\""
Jul 28 18:08:25.410044 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.410027    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-keda-deployment-b2150d0b\"/\"kube-root-ca.crt\""
Jul 28 18:08:25.410252 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.410142    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-keda-deployment-b2150d0b\"/\"openshift-service-ca.crt\""
Jul 28 18:08:25.410252 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.410188    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-deployment-b2150d0b\"/\"autoscale-keda-deploy-kserve-self-signed-certs\""
Jul 28 18:08:25.415669 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.415644    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"]
Jul 28 18:08:25.425159 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.425128    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:08:25.482641 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.482604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-dshm\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.482641 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.482645    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tls-certs\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.482858 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.482665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-home\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.482858 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.482688    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tmp-dir\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.482858 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.482799    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-model-cache\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.482858 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.482832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pckx6\" (UniqueName: \"kubernetes.io/projected/a7e4ad24-a063-4c62-97ff-b79cae179bf9-kube-api-access-pckx6\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.583980 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.583943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-dshm\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.583980 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.583978    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tls-certs\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.584236 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.583996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-home\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.584236 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.584013    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tmp-dir\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.584236 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.584108    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-model-cache\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.584236 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.584138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pckx6\" (UniqueName: \"kubernetes.io/projected/a7e4ad24-a063-4c62-97ff-b79cae179bf9-kube-api-access-pckx6\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.584529 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.584503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-home\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.584609 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.584542    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tmp-dir\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.584609 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.584551    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-model-cache\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.586451 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.586421    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-dshm\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.586616 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.586600    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tls-certs\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.592235 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.592214    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pckx6\" (UniqueName: \"kubernetes.io/projected/a7e4ad24-a063-4c62-97ff-b79cae179bf9-kube-api-access-pckx6\") pod \"autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") " pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.716837 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.716748    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:25.858964 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:25.858930    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"]
Jul 28 18:08:25.860935 ip-10-0-140-52 kubenswrapper[2574]: W0728 18:08:25.860902    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e4ad24_a063_4c62_97ff_b79cae179bf9.slice/crio-05c7116ea0d6cb286b0e875c14078a0249da6d1276a52641e4d7fb374f5799f0 WatchSource:0}: Error finding container 05c7116ea0d6cb286b0e875c14078a0249da6d1276a52641e4d7fb374f5799f0: Status 404 returned error can't find the container with id 05c7116ea0d6cb286b0e875c14078a0249da6d1276a52641e4d7fb374f5799f0
Jul 28 18:08:26.027363 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:26.027327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:08:26.700303 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:26.700268    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g" event={"ID":"a7e4ad24-a063-4c62-97ff-b79cae179bf9","Type":"ContainerStarted","Data":"0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da"}
Jul 28 18:08:26.700762 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:26.700320    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g" event={"ID":"a7e4ad24-a063-4c62-97ff-b79cae179bf9","Type":"ContainerStarted","Data":"05c7116ea0d6cb286b0e875c14078a0249da6d1276a52641e4d7fb374f5799f0"}
Jul 28 18:08:26.717238 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:26.717210    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:26.721476 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:26.721426    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g" podStartSLOduration=1.7214108970000002 podStartE2EDuration="1.721410897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:08:26.719968005 +0000 UTC m=+3094.147747256" watchObservedRunningTime="2026-07-28 18:08:26.721410897 +0000 UTC m=+3094.149190135"
Jul 28 18:08:34.633670 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:34.633630    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:08:35.717848 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:35.717805    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:35.730771 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:35.730741    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:35.761826 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:35.761798    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:08:42.614818 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:08:42.614762    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:16.882569 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:16.882474    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:16.942602 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:16.942565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:36.885081 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:36.885034    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:37.267887 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:37.267852    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:37.365825 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:37.365787    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:39.573034 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:39.573002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:39.672615 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:39.672575    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:40.232603 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:40.232571    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:43.475993 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:43.475955    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:49.532117 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:49.532082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:09:49.591200 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:09:49.591164    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:10:03.438003 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:10:03.437963    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:10:03.741138 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:10:03.741031    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:10:21.827147 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:10:21.827090    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:10:32.071249 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:10:32.071209    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:10:43.636842 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:10:43.636806    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:11:53.395543 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:11:53.395515    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:11:53.412758 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:11:53.412717    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:12:08.110243 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:08.110197    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:08.211559 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:08.211525    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:27.046509 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:27.046402    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:27.141630 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:27.141585    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:27.272171 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:27.272132    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:27.376218 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:27.376118    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:29.548646 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:29.548605    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:29.649365 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:29.649291    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:30.435416 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:30.435368    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:33.323279 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:33.323218    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:33.437847 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:33.437814    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:33.695451 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:33.695362    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:33.776267 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:33.776218    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:33.937419 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:33.937376    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:40.236564 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:40.236512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:40.346354 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:40.346316    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:43.495788 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:43.495755    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:46.735115 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:12:46.735054    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:13:01.392932 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:13:01.392894    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:13:01.669086 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:13:01.668982    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:13:10.631587 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:13:10.631508    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:13:28.758333 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:13:28.758294    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:14:58.455589 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:14:58.455544    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:14:58.519220 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:14:58.519183    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:15:21.118485 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:15:21.118398    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:16:32.827293 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:16:32.827239    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:16:32.928836 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:16:32.928805    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:16:53.430440 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:16:53.430411    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:16:53.449019 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:16:53.448990    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:20:01.672062 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:20:01.672023    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:21:53.466811 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:21:53.466784    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:21:53.484626 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:21:53.484602    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:23:24.962476 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:24.962443    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:23:27.128392 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.128358    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:23:27.128780 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.128755    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"]
Jul 28 18:23:27.139722 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:23:27.139683    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 18:23:27.139722 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:23:27.139722 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:23:27.139722 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da" cmd=["/bin/sleep","15"]
Jul 28 18:23:27.140041 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.139737    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g" message="" err=<
Jul 28 18:23:27.140041 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:23:27.140041 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:23:27.140041 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 18:23:27.140041 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:23:27.139753    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 18:23:27.140041 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:23:27.140041 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:23:27.140041 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g" podUID="a7e4ad24-a063-4c62-97ff-b79cae179bf9" containerName="main" containerID="cri-o://0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da"
Jul 28 18:23:27.140041 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.139800    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g" podUID="a7e4ad24-a063-4c62-97ff-b79cae179bf9" containerName="main" containerID="cri-o://0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da" gracePeriod=60
Jul 28 18:23:27.190973 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.190938    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:23:27.492352 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.492325    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:23:27.587122 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587085    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tmp-dir\") pod \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") "
Jul 28 18:23:27.587333 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587134    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-dshm\") pod \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") "
Jul 28 18:23:27.587333 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587158    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pckx6\" (UniqueName: \"kubernetes.io/projected/a7e4ad24-a063-4c62-97ff-b79cae179bf9-kube-api-access-pckx6\") pod \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") "
Jul 28 18:23:27.587333 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587179    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tls-certs\") pod \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") "
Jul 28 18:23:27.587333 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587209    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-model-cache\") pod \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") "
Jul 28 18:23:27.587333 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587331    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-home\") pod \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\" (UID: \"a7e4ad24-a063-4c62-97ff-b79cae179bf9\") "
Jul 28 18:23:27.587603 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587439    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a7e4ad24-a063-4c62-97ff-b79cae179bf9" (UID: "a7e4ad24-a063-4c62-97ff-b79cae179bf9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:23:27.587603 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587521    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-model-cache" (OuterVolumeSpecName: "model-cache") pod "a7e4ad24-a063-4c62-97ff-b79cae179bf9" (UID: "a7e4ad24-a063-4c62-97ff-b79cae179bf9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:23:27.587696 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587613    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-home" (OuterVolumeSpecName: "home") pod "a7e4ad24-a063-4c62-97ff-b79cae179bf9" (UID: "a7e4ad24-a063-4c62-97ff-b79cae179bf9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:23:27.587696 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587672    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:23:27.587696 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.587691    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:23:27.589440 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.589420    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a7e4ad24-a063-4c62-97ff-b79cae179bf9" (UID: "a7e4ad24-a063-4c62-97ff-b79cae179bf9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:23:27.589534 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.589464    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e4ad24-a063-4c62-97ff-b79cae179bf9-kube-api-access-pckx6" (OuterVolumeSpecName: "kube-api-access-pckx6") pod "a7e4ad24-a063-4c62-97ff-b79cae179bf9" (UID: "a7e4ad24-a063-4c62-97ff-b79cae179bf9"). InnerVolumeSpecName "kube-api-access-pckx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:23:27.589534 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.589516    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-dshm" (OuterVolumeSpecName: "dshm") pod "a7e4ad24-a063-4c62-97ff-b79cae179bf9" (UID: "a7e4ad24-a063-4c62-97ff-b79cae179bf9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:23:27.604693 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.604658    2574 generic.go:356] "Generic (PLEG): container finished" podID="a7e4ad24-a063-4c62-97ff-b79cae179bf9" containerID="0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da" exitCode=0
Jul 28 18:23:27.604850 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.604713    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"
Jul 28 18:23:27.604850 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.604735    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g" event={"ID":"a7e4ad24-a063-4c62-97ff-b79cae179bf9","Type":"ContainerDied","Data":"0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da"}
Jul 28 18:23:27.604850 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.604784    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g" event={"ID":"a7e4ad24-a063-4c62-97ff-b79cae179bf9","Type":"ContainerDied","Data":"05c7116ea0d6cb286b0e875c14078a0249da6d1276a52641e4d7fb374f5799f0"}
Jul 28 18:23:27.604850 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.604806    2574 scope.go:117] "RemoveContainer" containerID="0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da"
Jul 28 18:23:27.614031 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.614005    2574 scope.go:117] "RemoveContainer" containerID="0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da"
Jul 28 18:23:27.614313 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:23:27.614291    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da\": container with ID starting with 0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da not found: ID does not exist" containerID="0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da"
Jul 28 18:23:27.614382 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.614326    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da"} err="failed to get container status \"0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da\": rpc error: code = NotFound desc = could not find container \"0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da\": container with ID starting with 0b8372ce1fa4d3bdc5557baaf4387eedbf4977c89845692e3649c294918f36da not found: ID does not exist"
Jul 28 18:23:27.627663 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.627632    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"]
Jul 28 18:23:27.631645 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.631616    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-keda-deployment-b2150d0b/autoscale-keda-deploy-kserve-77fc6d7cf9-ccq5g"]
Jul 28 18:23:27.688408 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.688323    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:23:27.688408 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.688348    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7e4ad24-a063-4c62-97ff-b79cae179bf9-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:23:27.688408 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.688357    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pckx6\" (UniqueName: \"kubernetes.io/projected/a7e4ad24-a063-4c62-97ff-b79cae179bf9-kube-api-access-pckx6\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:23:27.688408 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:27.688365    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7e4ad24-a063-4c62-97ff-b79cae179bf9-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:23:29.147215 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:29.147176    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e4ad24-a063-4c62-97ff-b79cae179bf9" path="/var/lib/kubelet/pods/a7e4ad24-a063-4c62-97ff-b79cae179bf9/volumes"
Jul 28 18:23:45.724046 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:45.724012    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:23:45.822689 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:23:45.822659    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:24:00.054382 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.054342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:24:00.153456 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.153415    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:24:00.208153 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.208107    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"]
Jul 28 18:24:00.208541 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.208528    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e4ad24-a063-4c62-97ff-b79cae179bf9" containerName="main"
Jul 28 18:24:00.208541 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.208542    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e4ad24-a063-4c62-97ff-b79cae179bf9" containerName="main"
Jul 28 18:24:00.208626 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.208596    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e4ad24-a063-4c62-97ff-b79cae179bf9" containerName="main"
Jul 28 18:24:00.214005 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.213986    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.218625 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.218600    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"autoscale-hpa-lws-kserve-mn-dockercfg-878wk\""
Jul 28 18:24:00.218796 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.218634    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"autoscale-hpa-lws-kserve-self-signed-certs\""
Jul 28 18:24:00.218796 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.218732    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"default-dockercfg-2vkkx\""
Jul 28 18:24:00.218796 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.218738    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"openshift-service-ca.crt\""
Jul 28 18:24:00.218796 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.218786    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2\"/\"kube-root-ca.crt\""
Jul 28 18:24:00.225738 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.225714    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"]
Jul 28 18:24:00.234372 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.234342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:24:00.263727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.263686    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-home\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.263909 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.263823    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbbvz\" (UniqueName: \"kubernetes.io/projected/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-kube-api-access-qbbvz\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.263909 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.263868    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tls-certs\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.263909 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.263891    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-model-cache\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.264037 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.263925    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tmp-dir\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.264037 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.263966    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-dshm\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.365387 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.365277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbbvz\" (UniqueName: \"kubernetes.io/projected/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-kube-api-access-qbbvz\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.365387 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.365335    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tls-certs\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.365387 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.365366    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-model-cache\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.365664 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.365410    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tmp-dir\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.365664 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.365437    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-dshm\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.365664 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.365499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-home\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.365822 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.365759    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-model-cache\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.365822 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.365793    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tmp-dir\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.365934 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.365884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-home\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.367776 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.367747    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-dshm\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.367973 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.367959    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tls-certs\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.377400 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.377375    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbbvz\" (UniqueName: \"kubernetes.io/projected/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-kube-api-access-qbbvz\") pod \"autoscale-hpa-lws-kserve-mn-0\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") " pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.382496 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.382469    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:24:00.526009 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.525974    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:00.666708 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.666677    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"]
Jul 28 18:24:00.668339 ip-10-0-140-52 kubenswrapper[2574]: W0728 18:24:00.668301    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9598bb_97de_42ee_a2e7_4143ed1cdb0b.slice/crio-78cf7e157a2fa3bddecd4509b879c667a3b30ad30a4e8f9646806d68c15d0a74 WatchSource:0}: Error finding container 78cf7e157a2fa3bddecd4509b879c667a3b30ad30a4e8f9646806d68c15d0a74: Status 404 returned error can't find the container with id 78cf7e157a2fa3bddecd4509b879c667a3b30ad30a4e8f9646806d68c15d0a74
Jul 28 18:24:00.791387 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.791350    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0" event={"ID":"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b","Type":"ContainerStarted","Data":"91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f"}
Jul 28 18:24:00.791589 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.791407    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0" event={"ID":"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b","Type":"ContainerStarted","Data":"78cf7e157a2fa3bddecd4509b879c667a3b30ad30a4e8f9646806d68c15d0a74"}
Jul 28 18:24:00.812776 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:00.812726    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0" podStartSLOduration=0.812711203 podStartE2EDuration="812.711203ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:24:00.810700083 +0000 UTC m=+4028.238479323" watchObservedRunningTime="2026-07-28 18:24:00.812711203 +0000 UTC m=+4028.240490442"
Jul 28 18:24:01.527092 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:01.527034    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:04.474931 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:04.474895    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:24:10.527131 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:10.527050    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:10.539556 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:10.539529    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:10.854617 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:10.854524    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:24:27.327646 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:24:27.327546    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:26:53.500768 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:26:53.500736    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:26:53.520241 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:26:53.520217    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:27:49.811744 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:49.811706    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:27:51.432512 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:51.432476    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:27:52.299135 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:52.299091    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:27:52.399593 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:52.399561    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:27:53.017732 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.017696    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"]
Jul 28 18:27:53.021377 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.021354    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:27:53.024407 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.024379    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"openshift-service-ca.crt\""
Jul 28 18:27:53.025596 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.025573    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"kube-root-ca.crt\""
Jul 28 18:27:53.025686 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.025633    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"default-dockercfg-vzspf\""
Jul 28 18:27:53.039863 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.039833    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"]
Jul 28 18:27:53.109573 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.109534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4vmj\" (UniqueName: \"kubernetes.io/projected/bd13edbf-b04d-43e5-9934-2bd8b6812fea-kube-api-access-n4vmj\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") " pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:27:53.136025 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.135989    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:27:53.210224 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.210179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4vmj\" (UniqueName: \"kubernetes.io/projected/bd13edbf-b04d-43e5-9934-2bd8b6812fea-kube-api-access-n4vmj\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") " pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:27:53.221833 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:27:53.221805    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4vmj\" (UniqueName: \"kubernetes.io/projected/bd13edbf-b04d-43e5-9934-2bd8b6812fea-kube-api-access-n4vmj\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") " pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:00.375403 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:00.375360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") " pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:00.382473 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:00.382440    2574 operation_generator.go:1470] "Controller attach succeeded for volume \"pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") device path: \"\"" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:00.476535 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:00.476499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") " pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:00.476725 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:00.476643    2574 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") DevicePath \"\"" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:00.480538 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:00.480517    2574 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") DevicePath \"csi-094f21fd070b9d7ca9b64e7a0981a5b09417ea3ca90bd5a4261e1ef4d5f9bc44\"" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:00.699897 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:00.699868    2574 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/a80a8c5ede8dcfc70075ab4f15cd30d508cac99bea6759721e264a2a2aabee9a/globalmount\"" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:00.715264 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:00.715230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") pod \"e2e-pvc-model-download-gfqg6\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") " pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:00.842442 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:00.842401    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:00.979834 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:00.979805    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"]
Jul 28 18:28:00.981862 ip-10-0-140-52 kubenswrapper[2574]: W0728 18:28:00.981833    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd13edbf_b04d_43e5_9934_2bd8b6812fea.slice/crio-b3c8dc5325b7ae72480f8efa6e56e9562691a9b497c182530e3560d5697df930 WatchSource:0}: Error finding container b3c8dc5325b7ae72480f8efa6e56e9562691a9b497c182530e3560d5697df930: Status 404 returned error can't find the container with id b3c8dc5325b7ae72480f8efa6e56e9562691a9b497c182530e3560d5697df930
Jul 28 18:28:01.078538 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:01.078488    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6" event={"ID":"bd13edbf-b04d-43e5-9934-2bd8b6812fea","Type":"ContainerStarted","Data":"60f48d1171090c0aa2e37f51c986b82909a6d6bbee2e8dc52f620c0561f9162c"}
Jul 28 18:28:01.078538 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:01.078541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6" event={"ID":"bd13edbf-b04d-43e5-9934-2bd8b6812fea","Type":"ContainerStarted","Data":"b3c8dc5325b7ae72480f8efa6e56e9562691a9b497c182530e3560d5697df930"}
Jul 28 18:28:01.095355 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:01.095304    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6" podStartSLOduration=12.095288497 podStartE2EDuration="12.095288497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:28:01.094030283 +0000 UTC m=+4268.521809522" watchObservedRunningTime="2026-07-28 18:28:01.095288497 +0000 UTC m=+4268.523067735"
Jul 28 18:28:12.751696 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:12.751653    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:28:19.298173 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:19.298136    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:28:19.362956 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:19.362923    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:28:30.243839 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:30.243803    2574 generic.go:356] "Generic (PLEG): container finished" podID="bd13edbf-b04d-43e5-9934-2bd8b6812fea" containerID="60f48d1171090c0aa2e37f51c986b82909a6d6bbee2e8dc52f620c0561f9162c" exitCode=0
Jul 28 18:28:30.244465 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:30.243880    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6" event={"ID":"bd13edbf-b04d-43e5-9934-2bd8b6812fea","Type":"ContainerDied","Data":"60f48d1171090c0aa2e37f51c986b82909a6d6bbee2e8dc52f620c0561f9162c"}
Jul 28 18:28:31.416025 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:31.415997    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:31.581574 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:31.581541    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4vmj\" (UniqueName: \"kubernetes.io/projected/bd13edbf-b04d-43e5-9934-2bd8b6812fea-kube-api-access-n4vmj\") pod \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") "
Jul 28 18:28:31.581753 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:31.581707    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-storage\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") pod \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\" (UID: \"bd13edbf-b04d-43e5-9934-2bd8b6812fea\") "
Jul 28 18:28:31.583815 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:31.583785    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd13edbf-b04d-43e5-9934-2bd8b6812fea-kube-api-access-n4vmj" (OuterVolumeSpecName: "kube-api-access-n4vmj") pod "bd13edbf-b04d-43e5-9934-2bd8b6812fea" (UID: "bd13edbf-b04d-43e5-9934-2bd8b6812fea"). InnerVolumeSpecName "kube-api-access-n4vmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:28:31.585610 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:31.585589    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3" (OuterVolumeSpecName: "model-storage") pod "bd13edbf-b04d-43e5-9934-2bd8b6812fea" (UID: "bd13edbf-b04d-43e5-9934-2bd8b6812fea"). InnerVolumeSpecName "pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Jul 28 18:28:31.683146 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:31.683114    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4vmj\" (UniqueName: \"kubernetes.io/projected/bd13edbf-b04d-43e5-9934-2bd8b6812fea-kube-api-access-n4vmj\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:28:31.683309 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:31.683163    2574 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") on node \"ip-10-0-140-52.ec2.internal\" "
Jul 28 18:28:31.795135 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:31.795112    2574 operation_generator.go:896] UnmountDevice succeeded for volume "pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3") on node "ip-10-0-140-52.ec2.internal"
Jul 28 18:28:31.885272 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:31.885183    2574 reconciler_common.go:299] "Volume detached for volume \"pvc-322c2b42-7918-4d3d-a8b0-0cdf0543dfba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0adc5b422695948e3\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"csi-094f21fd070b9d7ca9b64e7a0981a5b09417ea3ca90bd5a4261e1ef4d5f9bc44\""
Jul 28 18:28:32.256361 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:32.256265    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6" event={"ID":"bd13edbf-b04d-43e5-9934-2bd8b6812fea","Type":"ContainerDied","Data":"b3c8dc5325b7ae72480f8efa6e56e9562691a9b497c182530e3560d5697df930"}
Jul 28 18:28:32.256361 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:32.256310    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3c8dc5325b7ae72480f8efa6e56e9562691a9b497c182530e3560d5697df930"
Jul 28 18:28:32.256361 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:32.256285    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"
Jul 28 18:28:46.746683 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:46.746573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:28:46.891328 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:46.891287    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:28:46.995774 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:46.995739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:28:47.011205 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.011179    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"]
Jul 28 18:28:47.011569 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.011556    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd13edbf-b04d-43e5-9934-2bd8b6812fea" containerName="storage-initializer"
Jul 28 18:28:47.011622 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.011570    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd13edbf-b04d-43e5-9934-2bd8b6812fea" containerName="storage-initializer"
Jul 28 18:28:47.011657 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.011634    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd13edbf-b04d-43e5-9934-2bd8b6812fea" containerName="storage-initializer"
Jul 28 18:28:47.015304 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.015283    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.020249 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.020223    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"llmisvc-model-pvc-router-manage-2577e7-b09f84b1-dockercfg-s6n7w\""
Jul 28 18:28:47.020441 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.020223    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs\""
Jul 28 18:28:47.020441 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.020298    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"default-dockercfg-vzspf\""
Jul 28 18:28:47.020441 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.020365    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"openshift-service-ca.crt\""
Jul 28 18:28:47.020441 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.020397    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-7c3633d1\"/\"kube-root-ca.crt\""
Jul 28 18:28:47.086083 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.086035    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"]
Jul 28 18:28:47.123945 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.123909    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22psw\" (UniqueName: \"kubernetes.io/projected/cdca78e3-e033-40d1-8b82-ee3de25d82d4-kube-api-access-22psw\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.124152 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.124017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-model-cache\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.124152 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.124100    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tmp-dir\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.124152 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.124127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-dshm\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.124152 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.124148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.124320 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.124229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-home\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.225296 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.225258    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22psw\" (UniqueName: \"kubernetes.io/projected/cdca78e3-e033-40d1-8b82-ee3de25d82d4-kube-api-access-22psw\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.225490 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.225327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-model-cache\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.225490 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.225370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tmp-dir\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.225490 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.225393    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-dshm\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.225490 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.225412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.225490 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.225452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-home\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.225771 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.225731    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tmp-dir\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.225835 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.225769    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-home\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.225835 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.225812    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-model-cache\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.227810 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.227788    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-dshm\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.228021 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.228004    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.245227 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.245197    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22psw\" (UniqueName: \"kubernetes.io/projected/cdca78e3-e033-40d1-8b82-ee3de25d82d4-kube-api-access-22psw\") pod \"llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") " pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:28:47.363401 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:47.363304    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:28:51.824541 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:51.824506    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:28:51.888169 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:28:51.888123    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:29:11.021617 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:29:11.021571    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:30:42.890635 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:30:42.890600    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:30:42.975744 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:30:42.975706    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:30:50.026903 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:50.026860    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kserve-pvc-source], unattached volumes=[kserve-pvc-source], failed to process volumes=[]: context deadline exceeded" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1" podUID="cdca78e3-e033-40d1-8b82-ee3de25d82d4"
Jul 28 18:30:50.990987 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:30:50.990957    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:30:51.117112 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:51.117048    2574 secret.go:189] Couldn't get secret e2e-test-llm-inference-service-7c3633d1/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs: secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:51.117586 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:51.117175    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs podName:cdca78e3-e033-40d1-8b82-ee3de25d82d4 nodeName:}" failed. No retries permitted until 2026-07-28 18:30:51.617153735 +0000 UTC m=+4439.044932951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs") pod "llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4") : secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:51.623224 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:51.623189    2574 secret.go:189] Couldn't get secret e2e-test-llm-inference-service-7c3633d1/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs: secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:51.623418 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:51.623271    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs podName:cdca78e3-e033-40d1-8b82-ee3de25d82d4 nodeName:}" failed. No retries permitted until 2026-07-28 18:30:52.623255386 +0000 UTC m=+4440.051034602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs") pod "llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4") : secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:52.631088 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:52.631032    2574 secret.go:189] Couldn't get secret e2e-test-llm-inference-service-7c3633d1/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs: secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:52.631506 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:52.631125    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs podName:cdca78e3-e033-40d1-8b82-ee3de25d82d4 nodeName:}" failed. No retries permitted until 2026-07-28 18:30:54.631110127 +0000 UTC m=+4442.058889343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs") pod "llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4") : secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:54.648800 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:54.648757    2574 secret.go:189] Couldn't get secret e2e-test-llm-inference-service-7c3633d1/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs: secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:54.649330 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:54.648850    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs podName:cdca78e3-e033-40d1-8b82-ee3de25d82d4 nodeName:}" failed. No retries permitted until 2026-07-28 18:30:58.648831723 +0000 UTC m=+4446.076610939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs") pod "llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4") : secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:58.676618 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:58.676581    2574 secret.go:189] Couldn't get secret e2e-test-llm-inference-service-7c3633d1/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs: secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:58.677090 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:58.676657    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs podName:cdca78e3-e033-40d1-8b82-ee3de25d82d4 nodeName:}" failed. No retries permitted until 2026-07-28 18:31:06.676642838 +0000 UTC m=+4454.104422057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs") pod "llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4") : secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found
Jul 28 18:30:59.299084 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:30:59.299043    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"]
Jul 28 18:30:59.299384 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:30:59.299361    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kserve-pvc-source], unattached volumes=[kserve-pvc-source], failed to process volumes=[]: context canceled" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1" podUID="cdca78e3-e033-40d1-8b82-ee3de25d82d4"
Jul 28 18:31:00.038086 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.038038    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:31:00.045233 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.045198    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:31:00.086840 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.086798    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs\") pod \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") "
Jul 28 18:31:00.087058 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.086868    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-dshm\") pod \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") "
Jul 28 18:31:00.087058 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.086891    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-home\") pod \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") "
Jul 28 18:31:00.087058 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.086950    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tmp-dir\") pod \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") "
Jul 28 18:31:00.087058 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.086998    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22psw\" (UniqueName: \"kubernetes.io/projected/cdca78e3-e033-40d1-8b82-ee3de25d82d4-kube-api-access-22psw\") pod \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") "
Jul 28 18:31:00.087058 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.087021    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-model-cache\") pod \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\" (UID: \"cdca78e3-e033-40d1-8b82-ee3de25d82d4\") "
Jul 28 18:31:00.087338 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.087175    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-home" (OuterVolumeSpecName: "home") pod "cdca78e3-e033-40d1-8b82-ee3de25d82d4" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:31:00.087338 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.087213    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cdca78e3-e033-40d1-8b82-ee3de25d82d4" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:31:00.087338 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.087283    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-model-cache" (OuterVolumeSpecName: "model-cache") pod "cdca78e3-e033-40d1-8b82-ee3de25d82d4" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:31:00.087500 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.087389    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:31:00.087500 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.087402    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:31:00.087500 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.087411    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:31:00.089167 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.089142    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdca78e3-e033-40d1-8b82-ee3de25d82d4-kube-api-access-22psw" (OuterVolumeSpecName: "kube-api-access-22psw") pod "cdca78e3-e033-40d1-8b82-ee3de25d82d4" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4"). InnerVolumeSpecName "kube-api-access-22psw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:31:00.089167 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.089147    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cdca78e3-e033-40d1-8b82-ee3de25d82d4" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:31:00.089292 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.089207    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-dshm" (OuterVolumeSpecName: "dshm") pod "cdca78e3-e033-40d1-8b82-ee3de25d82d4" (UID: "cdca78e3-e033-40d1-8b82-ee3de25d82d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:31:00.188284 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.188248    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22psw\" (UniqueName: \"kubernetes.io/projected/cdca78e3-e033-40d1-8b82-ee3de25d82d4-kube-api-access-22psw\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:31:00.188284 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.188278    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cdca78e3-e033-40d1-8b82-ee3de25d82d4-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:31:00.188284 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:00.188287    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cdca78e3-e033-40d1-8b82-ee3de25d82d4-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:31:01.043599 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:01.043570    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"
Jul 28 18:31:01.080948 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:01.080914    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"]
Jul 28 18:31:01.091711 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:01.091674    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1"]
Jul 28 18:31:01.149375 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:01.149337    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdca78e3-e033-40d1-8b82-ee3de25d82d4" path="/var/lib/kubelet/pods/cdca78e3-e033-40d1-8b82-ee3de25d82d4/volumes"
Jul 28 18:31:02.093332 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:02.093295    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:02.211383 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:02.207512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:02.307563 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:02.307525    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:04.622631 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:04.622594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:04.723619 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:04.723587    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:04.823727 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:04.823691    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:07.045987 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:07.045944    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"]
Jul 28 18:31:07.052402 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:07.052375    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-7c3633d1/e2e-pvc-model-download-gfqg6"]
Jul 28 18:31:07.147348 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:07.147312    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd13edbf-b04d-43e5-9934-2bd8b6812fea" path="/var/lib/kubelet/pods/bd13edbf-b04d-43e5-9934-2bd8b6812fea/volumes"
Jul 28 18:31:08.815199 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:08.815158    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:08.924941 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:08.924904    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:09.590352 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:09.590318    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:11.294425 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:11.294395    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:11.407991 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:11.407962    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:11.497048 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:11.497019    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:11.879409 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:11.879374    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:11.981931 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:11.981900    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:12.081511 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:12.081472    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:12.179764 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:12.179640    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:14.780350 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:14.780320    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:14.882364 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:14.882330    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:15.966256 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:15.966215    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:16.074096 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:16.074030    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:17.825483 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:17.825450    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:17.926118 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:17.926087    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:21.021286 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:21.021243    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:21.275541 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:21.275433    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:21.373351 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:21.373274    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:23.296142 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:23.296098    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:23.393527 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:23.393497    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:26.219316 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:26.219282    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:26.321437 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:26.321396    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:26.419379 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:26.419343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:27.412024 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:27.411988    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:27.512013 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:27.511981    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:27.613896 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:27.613865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:28.363990 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:28.363956    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:28.473142 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:28.473106    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:28.563957 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:28.563928    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:29.604123 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:29.604088    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:29.707832 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:29.707789    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:29.818236 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:29.818190    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:30.322912 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:30.322883    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:30.431641 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:30.431604    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:30.522296 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:30.522260    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:31.816779 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:31.816746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:31.913999 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:31.913960    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:33.313881 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:33.313849    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:33.412151 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:33.412121    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:34.835627 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:34.835587    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:34.929370 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:34.929343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:36.199909 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:36.199876    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:36.318765 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:36.318729    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:36.807044 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:36.807005    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:36.902710 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:36.902665    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:37.629458 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:37.629409    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:37.731320 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:37.731287    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:38.630486 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:38.630454    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:38.697302 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:38.697270    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:47.888551 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:47.888470    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:48.074317 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:48.074278    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:31:53.536814 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:53.536784    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:31:53.556878 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:31:53.556854    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:32:06.605645 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:32:06.605610    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:32:08.802413 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:32:08.802380    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:32:08.860837 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:32:08.860805    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:32:23.230271 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:32:23.230233    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:33:46.103122 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:33:46.103060    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:34:05.532169 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:34:05.532126    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:34:05.620725 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:34:05.620687    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:34:05.683001 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:34:05.682957    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:34:47.609533 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:34:47.609445    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:34:47.806966 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:34:47.806936    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:34:53.731586 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:34:53.731551    2574 scope.go:117] "RemoveContainer" containerID="60f48d1171090c0aa2e37f51c986b82909a6d6bbee2e8dc52f620c0561f9162c"
Jul 28 18:34:57.134600 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:34:57.134535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:35:55.882558 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:35:55.882522    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:35:55.937575 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:35:55.937545    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:36:53.573819 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:36:53.573704    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:36:53.593534 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:36:53.593506    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:36:59.264697 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:36:59.264655    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:36:59.322352 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:36:59.322311    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:37:16.750419 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:37:16.750369    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:37:16.877270 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:37:16.877235    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:37:16.978454 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:37:16.978409    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:37:23.119307 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:37:23.119267    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:37:29.047982 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:37:29.047952    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:37:29.146573 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:37:29.146531    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:37:31.745034 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:37:31.744994    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:39:13.839626 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:13.839585    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:39:13.899150 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:13.899117    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"]
Jul 28 18:39:13.908354 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:39:13.908321    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 18:39:13.908354 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:39:13.908354 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:39:13.908354 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f" cmd=["/bin/sleep","15"]
Jul 28 18:39:13.908612 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:13.908369    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0" message="" err=<
Jul 28 18:39:13.908612 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:39:13.908612 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:39:13.908612 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 18:39:13.908612 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:39:13.908382    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 18:39:13.908612 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:39:13.908612 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:39:13.908612 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0" podUID="5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" containerName="main" containerID="cri-o://91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f"
Jul 28 18:39:13.908612 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:13.908413    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0" podUID="5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" containerName="main" containerID="cri-o://91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f" gracePeriod=60
Jul 28 18:39:14.264780 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.264753    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:39:14.339419 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.339383    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbbvz\" (UniqueName: \"kubernetes.io/projected/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-kube-api-access-qbbvz\") pod \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") "
Jul 28 18:39:14.339618 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.339426    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-model-cache\") pod \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") "
Jul 28 18:39:14.339618 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.339511    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tls-certs\") pod \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") "
Jul 28 18:39:14.339618 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.339533    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tmp-dir\") pod \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") "
Jul 28 18:39:14.339618 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.339600    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-home\") pod \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") "
Jul 28 18:39:14.339844 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.339635    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-dshm\") pod \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\" (UID: \"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b\") "
Jul 28 18:39:14.339844 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.339748    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" (UID: "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:39:14.339969 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.339948    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:39:14.340147 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.340117    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" (UID: "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:39:14.340240 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.340145    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-home" (OuterVolumeSpecName: "home") pod "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" (UID: "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:39:14.341978 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.341929    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-kube-api-access-qbbvz" (OuterVolumeSpecName: "kube-api-access-qbbvz") pod "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" (UID: "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b"). InnerVolumeSpecName "kube-api-access-qbbvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:39:14.342140 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.342005    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" (UID: "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:39:14.342140 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.342012    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-dshm" (OuterVolumeSpecName: "dshm") pod "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" (UID: "5b9598bb-97de-42ee-a2e7-4143ed1cdb0b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:39:14.440650 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.440566    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:39:14.440650 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.440598    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:39:14.440650 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.440607    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:39:14.440650 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.440614    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:39:14.440650 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.440624    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbbvz\" (UniqueName: \"kubernetes.io/projected/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b-kube-api-access-qbbvz\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:39:14.700610 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.700511    2574 generic.go:356] "Generic (PLEG): container finished" podID="5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" containerID="91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f" exitCode=0
Jul 28 18:39:14.700610 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.700557    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"
Jul 28 18:39:14.700610 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.700568    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0" event={"ID":"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b","Type":"ContainerDied","Data":"91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f"}
Jul 28 18:39:14.700861 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.700622    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0" event={"ID":"5b9598bb-97de-42ee-a2e7-4143ed1cdb0b","Type":"ContainerDied","Data":"78cf7e157a2fa3bddecd4509b879c667a3b30ad30a4e8f9646806d68c15d0a74"}
Jul 28 18:39:14.700861 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.700645    2574 scope.go:117] "RemoveContainer" containerID="91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f"
Jul 28 18:39:14.710686 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.710668    2574 scope.go:117] "RemoveContainer" containerID="91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f"
Jul 28 18:39:14.710909 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:39:14.710891    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f\": container with ID starting with 91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f not found: ID does not exist" containerID="91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f"
Jul 28 18:39:14.710962 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.710916    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f"} err="failed to get container status \"91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f\": rpc error: code = NotFound desc = could not find container \"91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f\": container with ID starting with 91da03eab368fc82c692ad929634e007f21bd5c8204b1bcc425fa120a504b41f not found: ID does not exist"
Jul 28 18:39:14.732512 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.732483    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"]
Jul 28 18:39:14.742813 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.742789    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-hpa-lws-d4cbcfd2/autoscale-hpa-lws-kserve-mn-0"]
Jul 28 18:39:14.966695 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:14.966604    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:39:15.147890 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:15.147857    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" path="/var/lib/kubelet/pods/5b9598bb-97de-42ee-a2e7-4143ed1cdb0b/volumes"
Jul 28 18:39:20.334586 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:20.334550    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:39:28.105972 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:28.103746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:39:32.384554 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:32.384520    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:39:32.477393 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:39:32.477354    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:01.461758 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.461723    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:01.545900 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.545863    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 28 18:40:01.546402 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.546380    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" containerName="main"
Jul 28 18:40:01.546500 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.546404    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" containerName="main"
Jul 28 18:40:01.546563 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.546530    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b9598bb-97de-42ee-a2e7-4143ed1cdb0b" containerName="main"
Jul 28 18:40:01.550798 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.550776    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.553889 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.553858    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"autoscale-keda-lws-kserve-mn-dockercfg-5m9w7\""
Jul 28 18:40:01.554952 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.554933    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"default-dockercfg-6f6mj\""
Jul 28 18:40:01.555084 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.555038    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"autoscale-keda-lws-kserve-self-signed-certs\""
Jul 28 18:40:01.555162 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.555105    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"kube-root-ca.crt\""
Jul 28 18:40:01.555162 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.555139    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-autoscaling-keda-lws-e541a132\"/\"openshift-service-ca.crt\""
Jul 28 18:40:01.561009 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.560977    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:01.562698 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.562677    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 28 18:40:01.641327 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.641294    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-dshm\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.641327 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.641330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe7de2d-b8f1-40af-b382-161799775402-tls-certs\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.641554 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.641353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwd78\" (UniqueName: \"kubernetes.io/projected/0fe7de2d-b8f1-40af-b382-161799775402-kube-api-access-mwd78\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.641554 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.641416    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-tmp-dir\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.641554 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.641486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-home\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.641554 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.641541    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-model-cache\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.742057 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.741973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-tmp-dir\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.742057 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.742025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-home\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.742299 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.742091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-model-cache\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.742299 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.742124    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-dshm\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.742299 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.742144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe7de2d-b8f1-40af-b382-161799775402-tls-certs\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.742299 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.742171    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwd78\" (UniqueName: \"kubernetes.io/projected/0fe7de2d-b8f1-40af-b382-161799775402-kube-api-access-mwd78\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.742503 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.742415    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-tmp-dir\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.742503 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.742429    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-home\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.742503 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.742475    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-model-cache\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.744398 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.744377    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-dshm\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.744604 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.744577    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe7de2d-b8f1-40af-b382-161799775402-tls-certs\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.755136 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.755057    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwd78\" (UniqueName: \"kubernetes.io/projected/0fe7de2d-b8f1-40af-b382-161799775402-kube-api-access-mwd78\") pod \"autoscale-keda-lws-kserve-mn-0\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") " pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:01.841327 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.841295    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:01.863174 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:01.863135    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:02.026303 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:02.026271    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 28 18:40:02.029801 ip-10-0-140-52 kubenswrapper[2574]: W0728 18:40:02.029771    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe7de2d_b8f1_40af_b382_161799775402.slice/crio-2e2ec8f63ebdf5ff969ca84e55faca098ff566a3dd5a2c398013d0f18c631436 WatchSource:0}: Error finding container 2e2ec8f63ebdf5ff969ca84e55faca098ff566a3dd5a2c398013d0f18c631436: Status 404 returned error can't find the container with id 2e2ec8f63ebdf5ff969ca84e55faca098ff566a3dd5a2c398013d0f18c631436
Jul 28 18:40:02.960585 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:02.960550    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" event={"ID":"0fe7de2d-b8f1-40af-b382-161799775402","Type":"ContainerStarted","Data":"1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b"}
Jul 28 18:40:02.960973 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:02.960618    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" event={"ID":"0fe7de2d-b8f1-40af-b382-161799775402","Type":"ContainerStarted","Data":"2e2ec8f63ebdf5ff969ca84e55faca098ff566a3dd5a2c398013d0f18c631436"}
Jul 28 18:40:03.038421 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:03.038350    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" podStartSLOduration=2.038333279 podStartE2EDuration="2.038333279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:40:03.035099535 +0000 UTC m=+4990.462878775" watchObservedRunningTime="2026-07-28 18:40:03.038333279 +0000 UTC m=+4990.466112579"
Jul 28 18:40:03.863554 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:03.863520    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:06.810552 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:06.810519    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:11.864174 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:11.864135    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:11.877346 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:11.877317    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:12.019524 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:12.019493    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:40:26.514547 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:26.514488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:28.680631 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:28.680595    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:28.781757 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:28.781722    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:28.881318 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:28.881277    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:35.210131 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:35.210059    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:35.279807 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:35.279759    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:40:38.352217 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:40:38.352178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:41:34.071547 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:41:34.071502    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:41:53.609047 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:41:53.608931    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:41:53.627932 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:41:53.627907    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:43:09.489454 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:43:09.489418    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:43:26.029269 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:43:26.029206    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:43:26.128701 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:43:26.128670    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:43:26.229199 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:43:26.229157    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:43:32.402876 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:43:32.402836    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:43:32.507016 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:43:32.506979    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:43:35.013126 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:43:35.013059    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:43:35.209906 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:43:35.209869    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:43:37.790234 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:43:37.790202    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:44:01.013095 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:44:01.012998    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:45:42.136666 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:45:42.136565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:45:43.510693 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:45:43.510654    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:46:01.243351 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:01.243312    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:46:01.339721 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:01.339687    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:46:07.688936 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:07.688897    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:46:13.414658 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:13.414627    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:46:13.477243 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:13.477200    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:46:18.349458 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:18.349389    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:46:18.558494 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:18.558458    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:46:33.925426 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:33.925386    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:46:53.643936 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:53.643821    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:46:53.665305 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:46:53.665282    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:48:21.724934 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:21.724846    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:48:21.782350 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:21.782313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:48:39.501141 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:39.501100    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:48:52.976751 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:52.976716    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"]
Jul 28 18:48:52.980237 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:52.980219    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:52.982963 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:52.982939    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"seaweedfs-s3-creds\""
Jul 28 18:48:52.983136 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:52.983120    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"kube-root-ca.crt\""
Jul 28 18:48:52.983220 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:52.983122    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"prestop-hook-test-kserve-self-signed-certs\""
Jul 28 18:48:52.983220 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:52.983195    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"openshift-service-ca.crt\""
Jul 28 18:48:52.983316 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:52.983216    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"default-dockercfg-brxdv\""
Jul 28 18:48:52.991752 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:52.991728    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"]
Jul 28 18:48:53.100625 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.100591    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4892918c-5868-420d-aef1-b4ec5f8904e3-tls-certs\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.100831 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.100634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-tmp-dir\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.100831 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.100662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl7ml\" (UniqueName: \"kubernetes.io/projected/4892918c-5868-420d-aef1-b4ec5f8904e3-kube-api-access-tl7ml\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.100831 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.100724    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-home\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.100831 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.100785    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-model-cache\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.101000 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.100866    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-kserve-provision-location\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.101000 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.100903    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-dshm\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202253 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202219    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-model-cache\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202432 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202283    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-kserve-provision-location\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202432 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202334    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-dshm\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202432 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4892918c-5868-420d-aef1-b4ec5f8904e3-tls-certs\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202561 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-tmp-dir\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202613 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl7ml\" (UniqueName: \"kubernetes.io/projected/4892918c-5868-420d-aef1-b4ec5f8904e3-kube-api-access-tl7ml\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202613 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-home\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202715 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202680    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-model-cache\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202715 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202698    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-kserve-provision-location\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.202973 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202952    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-tmp-dir\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.203030 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.202974    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-home\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.204626 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.204607    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-dshm\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.205465 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.205447    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"prestop-hook-test-kserve-self-signed-certs\""
Jul 28 18:48:53.210810 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.210794    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"kube-root-ca.crt\""
Jul 28 18:48:53.215002 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.214983    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4892918c-5868-420d-aef1-b4ec5f8904e3-tls-certs\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.221271 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.221253    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"openshift-service-ca.crt\""
Jul 28 18:48:53.231800 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.231744    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl7ml\" (UniqueName: \"kubernetes.io/projected/4892918c-5868-420d-aef1-b4ec5f8904e3-kube-api-access-tl7ml\") pod \"prestop-hook-test-kserve-648d46f47f-lznhz\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.294918 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.294888    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"default-dockercfg-brxdv\""
Jul 28 18:48:53.303132 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.303105    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:48:53.451462 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.451436    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"]
Jul 28 18:48:53.452570 ip-10-0-140-52 kubenswrapper[2574]: W0728 18:48:53.452532    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4892918c_5868_420d_aef1_b4ec5f8904e3.slice/crio-afec3ee63a87744701bcbbd20356566957625b3ff49ff5ec5829cb178cca09eb WatchSource:0}: Error finding container afec3ee63a87744701bcbbd20356566957625b3ff49ff5ec5829cb178cca09eb: Status 404 returned error can't find the container with id afec3ee63a87744701bcbbd20356566957625b3ff49ff5ec5829cb178cca09eb
Jul 28 18:48:53.456924 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.456904    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"seaweedfs-s3-creds\""
Jul 28 18:48:53.838808 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.838773    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" event={"ID":"4892918c-5868-420d-aef1-b4ec5f8904e3","Type":"ContainerStarted","Data":"9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873"}
Jul 28 18:48:53.839016 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:48:53.838828    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" event={"ID":"4892918c-5868-420d-aef1-b4ec5f8904e3","Type":"ContainerStarted","Data":"afec3ee63a87744701bcbbd20356566957625b3ff49ff5ec5829cb178cca09eb"}
Jul 28 18:49:03.937909 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:03.937867    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:49:11.942765 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:11.942725    2574 generic.go:356] "Generic (PLEG): container finished" podID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerID="9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873" exitCode=0
Jul 28 18:49:11.943212 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:11.942760    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" event={"ID":"4892918c-5868-420d-aef1-b4ec5f8904e3","Type":"ContainerDied","Data":"9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873"}
Jul 28 18:49:12.951449 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:12.951414    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" event={"ID":"4892918c-5868-420d-aef1-b4ec5f8904e3","Type":"ContainerStarted","Data":"e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced"}
Jul 28 18:49:12.976849 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:12.976791    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" podStartSLOduration=2.655150146 podStartE2EDuration="20.976773535s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.321623389s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:48:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:49:12.973689987 +0000 UTC m=+5540.401469229" watchObservedRunningTime="2026-07-28 18:49:12.976773535 +0000 UTC m=+5540.404552773"
Jul 28 18:49:13.303593 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:13.303558    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:49:13.303793 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:13.303622    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:49:13.305096 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:13.305048    2574 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 28 18:49:23.304394 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:23.304347    2574 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 28 18:49:33.304457 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:33.304414    2574 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 28 18:49:43.303584 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:43.303529    2574 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": dial tcp 10.133.0.60:8000: connect: connection refused"
Jul 28 18:49:50.504903 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:50.504790    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:49:50.518334 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:50.518297    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"]
Jul 28 18:49:50.574090 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:49:50.574034    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:50:05.544114 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:05.544059    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="main" containerID="cri-o://e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced" gracePeriod=45
Jul 28 18:50:07.498012 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.497988    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-prestop-hook-22727e61_prestop-hook-test-kserve-648d46f47f-lznhz_4892918c-5868-420d-aef1-b4ec5f8904e3/main/0.log"
Jul 28 18:50:07.499615 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.499598    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:50:07.617135 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617044    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tl7ml\" (UniqueName: \"kubernetes.io/projected/4892918c-5868-420d-aef1-b4ec5f8904e3-kube-api-access-tl7ml\") pod \"4892918c-5868-420d-aef1-b4ec5f8904e3\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") "
Jul 28 18:50:07.617293 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617140    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-tmp-dir\") pod \"4892918c-5868-420d-aef1-b4ec5f8904e3\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") "
Jul 28 18:50:07.617293 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617175    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-dshm\") pod \"4892918c-5868-420d-aef1-b4ec5f8904e3\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") "
Jul 28 18:50:07.617293 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617205    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-model-cache\") pod \"4892918c-5868-420d-aef1-b4ec5f8904e3\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") "
Jul 28 18:50:07.617441 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617293    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-kserve-provision-location\") pod \"4892918c-5868-420d-aef1-b4ec5f8904e3\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") "
Jul 28 18:50:07.617441 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617332    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4892918c-5868-420d-aef1-b4ec5f8904e3-tls-certs\") pod \"4892918c-5868-420d-aef1-b4ec5f8904e3\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") "
Jul 28 18:50:07.617441 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617360    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-home\") pod \"4892918c-5868-420d-aef1-b4ec5f8904e3\" (UID: \"4892918c-5868-420d-aef1-b4ec5f8904e3\") "
Jul 28 18:50:07.617598 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4892918c-5868-420d-aef1-b4ec5f8904e3" (UID: "4892918c-5868-420d-aef1-b4ec5f8904e3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:50:07.617651 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617589    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-model-cache" (OuterVolumeSpecName: "model-cache") pod "4892918c-5868-420d-aef1-b4ec5f8904e3" (UID: "4892918c-5868-420d-aef1-b4ec5f8904e3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:50:07.617755 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617734    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-home" (OuterVolumeSpecName: "home") pod "4892918c-5868-420d-aef1-b4ec5f8904e3" (UID: "4892918c-5868-420d-aef1-b4ec5f8904e3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:50:07.617814 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617753    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:50:07.617814 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.617774    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:50:07.619475 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.619446    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-dshm" (OuterVolumeSpecName: "dshm") pod "4892918c-5868-420d-aef1-b4ec5f8904e3" (UID: "4892918c-5868-420d-aef1-b4ec5f8904e3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:50:07.619775 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.619755    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4892918c-5868-420d-aef1-b4ec5f8904e3-kube-api-access-tl7ml" (OuterVolumeSpecName: "kube-api-access-tl7ml") pod "4892918c-5868-420d-aef1-b4ec5f8904e3" (UID: "4892918c-5868-420d-aef1-b4ec5f8904e3"). InnerVolumeSpecName "kube-api-access-tl7ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:50:07.619775 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.619761    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4892918c-5868-420d-aef1-b4ec5f8904e3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4892918c-5868-420d-aef1-b4ec5f8904e3" (UID: "4892918c-5868-420d-aef1-b4ec5f8904e3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:50:07.676477 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.676413    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "4892918c-5868-420d-aef1-b4ec5f8904e3" (UID: "4892918c-5868-420d-aef1-b4ec5f8904e3"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:50:07.718443 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.718404    2574 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-kserve-provision-location\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:50:07.718443 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.718437    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4892918c-5868-420d-aef1-b4ec5f8904e3-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:50:07.718443 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.718450    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:50:07.718696 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.718460    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl7ml\" (UniqueName: \"kubernetes.io/projected/4892918c-5868-420d-aef1-b4ec5f8904e3-kube-api-access-tl7ml\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:50:07.718696 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:07.718468    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4892918c-5868-420d-aef1-b4ec5f8904e3-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:50:08.268712 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.268683    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-test-prestop-hook-22727e61_prestop-hook-test-kserve-648d46f47f-lznhz_4892918c-5868-420d-aef1-b4ec5f8904e3/main/0.log"
Jul 28 18:50:08.269142 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.269118    2574 generic.go:356] "Generic (PLEG): container finished" podID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerID="e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced" exitCode=130
Jul 28 18:50:08.269251 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.269165    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"
Jul 28 18:50:08.269251 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.269210    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" event={"ID":"4892918c-5868-420d-aef1-b4ec5f8904e3","Type":"ContainerDied","Data":"e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced"}
Jul 28 18:50:08.269358 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.269262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz" event={"ID":"4892918c-5868-420d-aef1-b4ec5f8904e3","Type":"ContainerDied","Data":"afec3ee63a87744701bcbbd20356566957625b3ff49ff5ec5829cb178cca09eb"}
Jul 28 18:50:08.269358 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.269285    2574 scope.go:117] "RemoveContainer" containerID="e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced"
Jul 28 18:50:08.278890 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.278870    2574 scope.go:117] "RemoveContainer" containerID="9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873"
Jul 28 18:50:08.287405 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.287387    2574 scope.go:117] "RemoveContainer" containerID="e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced"
Jul 28 18:50:08.287702 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:50:08.287682    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced\": container with ID starting with e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced not found: ID does not exist" containerID="e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced"
Jul 28 18:50:08.287748 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.287710    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced"} err="failed to get container status \"e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced\": rpc error: code = NotFound desc = could not find container \"e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced\": container with ID starting with e0a174a6b574581db2d4dbc0c52d2031e43ee1b7c78666b450b451047a677ced not found: ID does not exist"
Jul 28 18:50:08.287748 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.287729    2574 scope.go:117] "RemoveContainer" containerID="9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873"
Jul 28 18:50:08.287992 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:50:08.287972    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873\": container with ID starting with 9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873 not found: ID does not exist" containerID="9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873"
Jul 28 18:50:08.288057 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.287997    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873"} err="failed to get container status \"9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873\": rpc error: code = NotFound desc = could not find container \"9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873\": container with ID starting with 9b607411583bf4e2f71b8b07bab724df05f732159e75fcc4394da208e66b1873 not found: ID does not exist"
Jul 28 18:50:08.293109 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.293083    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"]
Jul 28 18:50:08.296867 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:08.296845    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-648d46f47f-lznhz"]
Jul 28 18:50:09.147610 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:09.147576    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" path="/var/lib/kubelet/pods/4892918c-5868-420d-aef1-b4ec5f8904e3/volumes"
Jul 28 18:50:11.695808 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:11.695765    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:50:11.792334 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:11.792299    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:50:18.000079 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:18.000024    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:50:24.121041 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:24.121002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:50:24.236079 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:24.236032    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:50:26.711026 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.710884    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"]
Jul 28 18:50:26.711820 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.711794    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="main"
Jul 28 18:50:26.711925 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.711823    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="main"
Jul 28 18:50:26.711925 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.711856    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="storage-initializer"
Jul 28 18:50:26.711925 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.711866    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="storage-initializer"
Jul 28 18:50:26.712176 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.712046    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4892918c-5868-420d-aef1-b4ec5f8904e3" containerName="main"
Jul 28 18:50:26.715884 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.715860    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.720386 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.720360    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"kube-root-ca.crt\""
Jul 28 18:50:26.720561 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.720460    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"default-dockercfg-xwwh4\""
Jul 28 18:50:26.720561 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.720459    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"rolling-upgrade-test-kserve-self-signed-certs\""
Jul 28 18:50:26.720694 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.720593    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-rolling-upgrade-coordination-a9229638\"/\"openshift-service-ca.crt\""
Jul 28 18:50:26.724857 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.724832    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"]
Jul 28 18:50:26.739445 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.739412    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:50:26.788648 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.788607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-model-cache\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.788648 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.788656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tls-certs\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.788864 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.788707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tmp-dir\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.788864 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.788763    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-dshm\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.788864 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.788812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq4xm\" (UniqueName: \"kubernetes.io/projected/eb554f7a-52da-40a9-8cff-d29b894c6e3f-kube-api-access-mq4xm\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.788864 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.788840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-home\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.889294 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.889258    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tls-certs\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.889512 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.889302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tmp-dir\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.889512 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.889347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-dshm\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.889512 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.889405    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq4xm\" (UniqueName: \"kubernetes.io/projected/eb554f7a-52da-40a9-8cff-d29b894c6e3f-kube-api-access-mq4xm\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.889512 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.889440    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-home\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.889512 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.889483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-model-cache\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.889849 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.889828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tmp-dir\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.889965 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.889943    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-model-cache\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.890045 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.890016    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-home\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.891795 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.891769    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-dshm\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.892245 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.892224    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tls-certs\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.898186 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.898163    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq4xm\" (UniqueName: \"kubernetes.io/projected/eb554f7a-52da-40a9-8cff-d29b894c6e3f-kube-api-access-mq4xm\") pod \"rolling-upgrade-test-kserve-74b79d7f77-w9l27\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") " pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:26.952905 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:26.952873    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:50:27.027435 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:27.027399    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:27.178543 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:27.178515    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"]
Jul 28 18:50:27.179596 ip-10-0-140-52 kubenswrapper[2574]: W0728 18:50:27.179574    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb554f7a_52da_40a9_8cff_d29b894c6e3f.slice/crio-3b99b72de1c0d34724f17bc13c2b1ea81f8aceea42ebd4f4b59b0a06258dcb05 WatchSource:0}: Error finding container 3b99b72de1c0d34724f17bc13c2b1ea81f8aceea42ebd4f4b59b0a06258dcb05: Status 404 returned error can't find the container with id 3b99b72de1c0d34724f17bc13c2b1ea81f8aceea42ebd4f4b59b0a06258dcb05
Jul 28 18:50:27.372193 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:27.372098    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27" event={"ID":"eb554f7a-52da-40a9-8cff-d29b894c6e3f","Type":"ContainerStarted","Data":"8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039"}
Jul 28 18:50:27.372193 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:27.372166    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27" event={"ID":"eb554f7a-52da-40a9-8cff-d29b894c6e3f","Type":"ContainerStarted","Data":"3b99b72de1c0d34724f17bc13c2b1ea81f8aceea42ebd4f4b59b0a06258dcb05"}
Jul 28 18:50:27.390946 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:27.390893    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27" podStartSLOduration=1.390879089 podStartE2EDuration="1.390879089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:50:27.389621345 +0000 UTC m=+5614.817400595" watchObservedRunningTime="2026-07-28 18:50:27.390879089 +0000 UTC m=+5614.818658326"
Jul 28 18:50:28.028107 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:28.028054    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:37.028307 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:37.028267    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:37.041348 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:37.041314    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:50:37.435897 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:50:37.435813    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:51:01.855564 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:01.855521    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:07.890574 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:07.890536    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:23.821414 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:23.821320    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"]
Jul 28 18:51:23.830003 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:23.829972    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:23.831636 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:51:23.831599    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 18:51:23.831636 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:51:23.831636 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:51:23.831636 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039" cmd=["/bin/sleep","15"]
Jul 28 18:51:23.831914 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:23.831658    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27" message="" err=<
Jul 28 18:51:23.831914 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:51:23.831914 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:51:23.831914 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 18:51:23.831914 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:51:23.831673    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 18:51:23.831914 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:51:23.831914 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:51:23.831914 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27" podUID="eb554f7a-52da-40a9-8cff-d29b894c6e3f" containerName="main" containerID="cri-o://8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039"
Jul 28 18:51:23.831914 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:23.831727    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27" podUID="eb554f7a-52da-40a9-8cff-d29b894c6e3f" containerName="main" containerID="cri-o://8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039" gracePeriod=60
Jul 28 18:51:23.888666 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:23.888626    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:24.186216 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.186187    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:51:24.205391 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.205357    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tmp-dir\") pod \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") "
Jul 28 18:51:24.205634 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.205411    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-model-cache\") pod \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") "
Jul 28 18:51:24.205634 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.205441    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq4xm\" (UniqueName: \"kubernetes.io/projected/eb554f7a-52da-40a9-8cff-d29b894c6e3f-kube-api-access-mq4xm\") pod \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") "
Jul 28 18:51:24.205634 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.205520    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-dshm\") pod \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") "
Jul 28 18:51:24.205634 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.205556    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-home\") pod \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") "
Jul 28 18:51:24.205983 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.205645    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tls-certs\") pod \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\" (UID: \"eb554f7a-52da-40a9-8cff-d29b894c6e3f\") "
Jul 28 18:51:24.205983 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.205853    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eb554f7a-52da-40a9-8cff-d29b894c6e3f" (UID: "eb554f7a-52da-40a9-8cff-d29b894c6e3f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:51:24.206140 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.206023    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-model-cache" (OuterVolumeSpecName: "model-cache") pod "eb554f7a-52da-40a9-8cff-d29b894c6e3f" (UID: "eb554f7a-52da-40a9-8cff-d29b894c6e3f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:51:24.206140 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.206091    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-home" (OuterVolumeSpecName: "home") pod "eb554f7a-52da-40a9-8cff-d29b894c6e3f" (UID: "eb554f7a-52da-40a9-8cff-d29b894c6e3f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:51:24.206612 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.206553    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:51:24.206612 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.206577    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:51:24.206612 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.206590    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:51:24.208471 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.208431    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-dshm" (OuterVolumeSpecName: "dshm") pod "eb554f7a-52da-40a9-8cff-d29b894c6e3f" (UID: "eb554f7a-52da-40a9-8cff-d29b894c6e3f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:51:24.208591 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.208512    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eb554f7a-52da-40a9-8cff-d29b894c6e3f" (UID: "eb554f7a-52da-40a9-8cff-d29b894c6e3f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:51:24.208694 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.208670    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb554f7a-52da-40a9-8cff-d29b894c6e3f-kube-api-access-mq4xm" (OuterVolumeSpecName: "kube-api-access-mq4xm") pod "eb554f7a-52da-40a9-8cff-d29b894c6e3f" (UID: "eb554f7a-52da-40a9-8cff-d29b894c6e3f"). InnerVolumeSpecName "kube-api-access-mq4xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:51:24.308008 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.307970    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb554f7a-52da-40a9-8cff-d29b894c6e3f-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:51:24.308008 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.308001    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq4xm\" (UniqueName: \"kubernetes.io/projected/eb554f7a-52da-40a9-8cff-d29b894c6e3f-kube-api-access-mq4xm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:51:24.308008 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.308012    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb554f7a-52da-40a9-8cff-d29b894c6e3f-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:51:24.687392 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.687355    2574 generic.go:356] "Generic (PLEG): container finished" podID="eb554f7a-52da-40a9-8cff-d29b894c6e3f" containerID="8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039" exitCode=0
Jul 28 18:51:24.687599 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.687399    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27" event={"ID":"eb554f7a-52da-40a9-8cff-d29b894c6e3f","Type":"ContainerDied","Data":"8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039"}
Jul 28 18:51:24.687599 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.687438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27" event={"ID":"eb554f7a-52da-40a9-8cff-d29b894c6e3f","Type":"ContainerDied","Data":"3b99b72de1c0d34724f17bc13c2b1ea81f8aceea42ebd4f4b59b0a06258dcb05"}
Jul 28 18:51:24.687599 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.687465    2574 scope.go:117] "RemoveContainer" containerID="8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039"
Jul 28 18:51:24.687599 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.687400    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"
Jul 28 18:51:24.697222 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.697203    2574 scope.go:117] "RemoveContainer" containerID="8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039"
Jul 28 18:51:24.697508 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:51:24.697486    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039\": container with ID starting with 8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039 not found: ID does not exist" containerID="8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039"
Jul 28 18:51:24.697573 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.697520    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039"} err="failed to get container status \"8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039\": rpc error: code = NotFound desc = could not find container \"8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039\": container with ID starting with 8851a72bf2a5e2cf06686b642a5940625e36f32398e74785ba7da03dbbeaf039 not found: ID does not exist"
Jul 28 18:51:24.712198 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.712166    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"]
Jul 28 18:51:24.714465 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:24.714435    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-rolling-upgrade-coordination-a9229638/rolling-upgrade-test-kserve-74b79d7f77-w9l27"]
Jul 28 18:51:25.147456 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:25.147424    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb554f7a-52da-40a9-8cff-d29b894c6e3f" path="/var/lib/kubelet/pods/eb554f7a-52da-40a9-8cff-d29b894c6e3f/volumes"
Jul 28 18:51:40.563652 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:40.563608    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:40.664812 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:40.664783    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:40.766405 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:40.766367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:43.754322 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.754277    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-658796f68b-tpds6"]
Jul 28 18:51:43.754941 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.754918    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb554f7a-52da-40a9-8cff-d29b894c6e3f" containerName="main"
Jul 28 18:51:43.755028 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.754943    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb554f7a-52da-40a9-8cff-d29b894c6e3f" containerName="main"
Jul 28 18:51:43.755116 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.755040    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb554f7a-52da-40a9-8cff-d29b894c6e3f" containerName="main"
Jul 28 18:51:43.759313 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.759289    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:51:43.768870 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.768846    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-658796f68b-tpds6"]
Jul 28 18:51:43.883917 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.883884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5883e9b-5fc9-4a26-b16c-b158902c5f94-cert\") pod \"llmisvc-controller-manager-658796f68b-tpds6\" (UID: \"a5883e9b-5fc9-4a26-b16c-b158902c5f94\") " pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:51:43.884160 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.883923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5w6x\" (UniqueName: \"kubernetes.io/projected/a5883e9b-5fc9-4a26-b16c-b158902c5f94-kube-api-access-h5w6x\") pod \"llmisvc-controller-manager-658796f68b-tpds6\" (UID: \"a5883e9b-5fc9-4a26-b16c-b158902c5f94\") " pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:51:43.985333 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.985287    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5883e9b-5fc9-4a26-b16c-b158902c5f94-cert\") pod \"llmisvc-controller-manager-658796f68b-tpds6\" (UID: \"a5883e9b-5fc9-4a26-b16c-b158902c5f94\") " pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:51:43.985333 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.985337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5w6x\" (UniqueName: \"kubernetes.io/projected/a5883e9b-5fc9-4a26-b16c-b158902c5f94-kube-api-access-h5w6x\") pod \"llmisvc-controller-manager-658796f68b-tpds6\" (UID: \"a5883e9b-5fc9-4a26-b16c-b158902c5f94\") " pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:51:43.987719 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.987689    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5883e9b-5fc9-4a26-b16c-b158902c5f94-cert\") pod \"llmisvc-controller-manager-658796f68b-tpds6\" (UID: \"a5883e9b-5fc9-4a26-b16c-b158902c5f94\") " pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:51:43.994084 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:43.994046    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5w6x\" (UniqueName: \"kubernetes.io/projected/a5883e9b-5fc9-4a26-b16c-b158902c5f94-kube-api-access-h5w6x\") pod \"llmisvc-controller-manager-658796f68b-tpds6\" (UID: \"a5883e9b-5fc9-4a26-b16c-b158902c5f94\") " pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:51:44.068958 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:44.068926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:51:44.205546 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:44.205519    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-658796f68b-tpds6"]
Jul 28 18:51:44.208283 ip-10-0-140-52 kubenswrapper[2574]: W0728 18:51:44.208254    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda5883e9b_5fc9_4a26_b16c_b158902c5f94.slice/crio-24da8ccc7d71f306b44a3008016eccac8935133e4b36b02dd3b69a72220c9b25 WatchSource:0}: Error finding container 24da8ccc7d71f306b44a3008016eccac8935133e4b36b02dd3b69a72220c9b25: Status 404 returned error can't find the container with id 24da8ccc7d71f306b44a3008016eccac8935133e4b36b02dd3b69a72220c9b25
Jul 28 18:51:44.209932 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:44.209915    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 18:51:44.797200 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:44.797166    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-658796f68b-tpds6" event={"ID":"a5883e9b-5fc9-4a26-b16c-b158902c5f94","Type":"ContainerStarted","Data":"24da8ccc7d71f306b44a3008016eccac8935133e4b36b02dd3b69a72220c9b25"}
Jul 28 18:51:45.803760 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:45.803722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-658796f68b-tpds6" event={"ID":"a5883e9b-5fc9-4a26-b16c-b158902c5f94","Type":"ContainerStarted","Data":"f0fca2c17084aa3692c281efd999efef169e9e2b246280748ddbb20d42a9514a"}
Jul 28 18:51:45.804286 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:45.803889    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:51:45.822927 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:45.822870    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-658796f68b-tpds6" podStartSLOduration=2.200099566 podStartE2EDuration="2.822850288s" totalImagesPullingTime="622.750722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:51:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:51:45.822611268 +0000 UTC m=+5693.250390506" watchObservedRunningTime="2026-07-28 18:51:45.822850288 +0000 UTC m=+5693.250629527"
Jul 28 18:51:46.694358 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:46.694317    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:52.460704 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:52.460670    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:52.519002 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:52.518967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:51:53.680749 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:53.680638    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:51:53.701165 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:51:53.701137    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:52:16.810831 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:16.810798    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-658796f68b-tpds6"
Jul 28 18:52:16.861124 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:16.861089    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-84d9876847-shpsd"]
Jul 28 18:52:16.861340 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:16.861312    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd" podUID="095075a6-a32d-4ec2-981c-217283596ccc" containerName="manager" containerID="cri-o://f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796" gracePeriod=30
Jul 28 18:52:17.714954 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.714929    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 18:52:17.799793 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.799757    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm59v\" (UniqueName: \"kubernetes.io/projected/095075a6-a32d-4ec2-981c-217283596ccc-kube-api-access-vm59v\") pod \"095075a6-a32d-4ec2-981c-217283596ccc\" (UID: \"095075a6-a32d-4ec2-981c-217283596ccc\") "
Jul 28 18:52:17.799978 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.799812    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/095075a6-a32d-4ec2-981c-217283596ccc-cert\") pod \"095075a6-a32d-4ec2-981c-217283596ccc\" (UID: \"095075a6-a32d-4ec2-981c-217283596ccc\") "
Jul 28 18:52:17.802106 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.802059    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/095075a6-a32d-4ec2-981c-217283596ccc-cert" (OuterVolumeSpecName: "cert") pod "095075a6-a32d-4ec2-981c-217283596ccc" (UID: "095075a6-a32d-4ec2-981c-217283596ccc"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:52:17.802235 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.802131    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/095075a6-a32d-4ec2-981c-217283596ccc-kube-api-access-vm59v" (OuterVolumeSpecName: "kube-api-access-vm59v") pod "095075a6-a32d-4ec2-981c-217283596ccc" (UID: "095075a6-a32d-4ec2-981c-217283596ccc"). InnerVolumeSpecName "kube-api-access-vm59v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:52:17.901581 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.901498    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm59v\" (UniqueName: \"kubernetes.io/projected/095075a6-a32d-4ec2-981c-217283596ccc-kube-api-access-vm59v\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:52:17.901581 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.901524    2574 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/095075a6-a32d-4ec2-981c-217283596ccc-cert\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:52:17.981130 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.981097    2574 generic.go:356] "Generic (PLEG): container finished" podID="095075a6-a32d-4ec2-981c-217283596ccc" containerID="f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796" exitCode=0
Jul 28 18:52:17.981130 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.981131    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd"
Jul 28 18:52:17.981371 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.981172    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd" event={"ID":"095075a6-a32d-4ec2-981c-217283596ccc","Type":"ContainerDied","Data":"f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796"}
Jul 28 18:52:17.981371 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.981221    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-84d9876847-shpsd" event={"ID":"095075a6-a32d-4ec2-981c-217283596ccc","Type":"ContainerDied","Data":"0bdf7b99314827ad1080823102c4aae77f553d79b7f9d2bf35f30cdfef81ee99"}
Jul 28 18:52:17.981371 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.981243    2574 scope.go:117] "RemoveContainer" containerID="f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796"
Jul 28 18:52:17.993976 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.993956    2574 scope.go:117] "RemoveContainer" containerID="f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796"
Jul 28 18:52:17.994252 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:52:17.994231    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796\": container with ID starting with f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796 not found: ID does not exist" containerID="f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796"
Jul 28 18:52:17.994307 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:17.994265    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796"} err="failed to get container status \"f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796\": rpc error: code = NotFound desc = could not find container \"f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796\": container with ID starting with f8a7aa5c9a2887c68b074f73d30f36295c6ea1d8ad7a3bb3b939f119056bc796 not found: ID does not exist"
Jul 28 18:52:18.002703 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:18.002679    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-84d9876847-shpsd"]
Jul 28 18:52:18.006616 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:18.006579    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/llmisvc-controller-manager-84d9876847-shpsd"]
Jul 28 18:52:19.147690 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:52:19.147655    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="095075a6-a32d-4ec2-981c-217283596ccc" path="/var/lib/kubelet/pods/095075a6-a32d-4ec2-981c-217283596ccc/volumes"
Jul 28 18:53:00.593133 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:53:00.593094    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:53:06.813336 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:53:06.813299    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:53:06.877150 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:53:06.877114    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:53:45.348381 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:53:45.348345    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:54:33.502401 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:33.502278    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:54:37.036272 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.036231    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:54:37.053886 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.053855    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 28 18:54:37.063554 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:54:37.063518    2574 log.go:32] "ExecSync cmd from runtime service failed" err=<
Jul 28 18:54:37.063554 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:54:37.063554 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:54:37.063554 ip-10-0-140-52 kubenswrapper[2574]:  > containerID="1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b" cmd=["/bin/sleep","15"]
Jul 28 18:54:37.063827 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.063572    2574 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" message="" err=<
Jul 28 18:54:37.063827 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:54:37.063827 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:54:37.063827 ip-10-0-140-52 kubenswrapper[2574]:  >
Jul 28 18:54:37.063827 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:54:37.063588    2574 kuberuntime_container.go:755] "PreStop hook failed" err=<
Jul 28 18:54:37.063827 ip-10-0-140-52 kubenswrapper[2574]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Jul 28 18:54:37.063827 ip-10-0-140-52 kubenswrapper[2574]:         , stdout: , stderr: , exit code -1
Jul 28 18:54:37.063827 ip-10-0-140-52 kubenswrapper[2574]:  > pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" podUID="0fe7de2d-b8f1-40af-b382-161799775402" containerName="main" containerID="cri-o://1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b"
Jul 28 18:54:37.063827 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.063642    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" podUID="0fe7de2d-b8f1-40af-b382-161799775402" containerName="main" containerID="cri-o://1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b" gracePeriod=60
Jul 28 18:54:37.096510 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.096473    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:54:37.420168 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.420140    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:54:37.461445 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.461409    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-home\") pod \"0fe7de2d-b8f1-40af-b382-161799775402\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") "
Jul 28 18:54:37.461445 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.461450    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe7de2d-b8f1-40af-b382-161799775402-tls-certs\") pod \"0fe7de2d-b8f1-40af-b382-161799775402\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") "
Jul 28 18:54:37.461689 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.461474    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-model-cache\") pod \"0fe7de2d-b8f1-40af-b382-161799775402\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") "
Jul 28 18:54:37.461689 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.461503    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-dshm\") pod \"0fe7de2d-b8f1-40af-b382-161799775402\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") "
Jul 28 18:54:37.461689 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.461606    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-tmp-dir\") pod \"0fe7de2d-b8f1-40af-b382-161799775402\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") "
Jul 28 18:54:37.461689 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.461654    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwd78\" (UniqueName: \"kubernetes.io/projected/0fe7de2d-b8f1-40af-b382-161799775402-kube-api-access-mwd78\") pod \"0fe7de2d-b8f1-40af-b382-161799775402\" (UID: \"0fe7de2d-b8f1-40af-b382-161799775402\") "
Jul 28 18:54:37.461909 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.461709    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-home" (OuterVolumeSpecName: "home") pod "0fe7de2d-b8f1-40af-b382-161799775402" (UID: "0fe7de2d-b8f1-40af-b382-161799775402"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:54:37.461909 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.461847    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0fe7de2d-b8f1-40af-b382-161799775402" (UID: "0fe7de2d-b8f1-40af-b382-161799775402"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:54:37.462015 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.461917    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-model-cache" (OuterVolumeSpecName: "model-cache") pod "0fe7de2d-b8f1-40af-b382-161799775402" (UID: "0fe7de2d-b8f1-40af-b382-161799775402"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:54:37.462015 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.462003    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-home\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:54:37.462154 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.462021    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-model-cache\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:54:37.462154 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.462035    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-tmp-dir\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:54:37.463722 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.463700    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-dshm" (OuterVolumeSpecName: "dshm") pod "0fe7de2d-b8f1-40af-b382-161799775402" (UID: "0fe7de2d-b8f1-40af-b382-161799775402"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:54:37.463861 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.463803    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fe7de2d-b8f1-40af-b382-161799775402-kube-api-access-mwd78" (OuterVolumeSpecName: "kube-api-access-mwd78") pod "0fe7de2d-b8f1-40af-b382-161799775402" (UID: "0fe7de2d-b8f1-40af-b382-161799775402"). InnerVolumeSpecName "kube-api-access-mwd78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:54:37.463942 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.463861    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fe7de2d-b8f1-40af-b382-161799775402-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0fe7de2d-b8f1-40af-b382-161799775402" (UID: "0fe7de2d-b8f1-40af-b382-161799775402"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 18:54:37.563252 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.563218    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fe7de2d-b8f1-40af-b382-161799775402-tls-certs\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:54:37.563252 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.563247    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0fe7de2d-b8f1-40af-b382-161799775402-dshm\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:54:37.563252 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.563256    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwd78\" (UniqueName: \"kubernetes.io/projected/0fe7de2d-b8f1-40af-b382-161799775402-kube-api-access-mwd78\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:54:37.726675 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.726576    2574 generic.go:356] "Generic (PLEG): container finished" podID="0fe7de2d-b8f1-40af-b382-161799775402" containerID="1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b" exitCode=0
Jul 28 18:54:37.726675 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.726631    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"
Jul 28 18:54:37.726904 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.726669    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" event={"ID":"0fe7de2d-b8f1-40af-b382-161799775402","Type":"ContainerDied","Data":"1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b"}
Jul 28 18:54:37.726904 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.726721    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0" event={"ID":"0fe7de2d-b8f1-40af-b382-161799775402","Type":"ContainerDied","Data":"2e2ec8f63ebdf5ff969ca84e55faca098ff566a3dd5a2c398013d0f18c631436"}
Jul 28 18:54:37.726904 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.726744    2574 scope.go:117] "RemoveContainer" containerID="1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b"
Jul 28 18:54:37.737021 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.737001    2574 scope.go:117] "RemoveContainer" containerID="1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b"
Jul 28 18:54:37.737337 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:54:37.737317    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b\": container with ID starting with 1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b not found: ID does not exist" containerID="1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b"
Jul 28 18:54:37.737420 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.737351    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b"} err="failed to get container status \"1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b\": rpc error: code = NotFound desc = could not find container \"1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b\": container with ID starting with 1cfd19648ea77d2680f54fe854f24697bacb360ea123a87132254fb1aaf0183b not found: ID does not exist"
Jul 28 18:54:37.751603 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.751574    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 28 18:54:37.755567 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:37.755537    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-autoscaling-keda-lws-e541a132/autoscale-keda-lws-kserve-mn-0"]
Jul 28 18:54:39.148158 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:39.148118    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fe7de2d-b8f1-40af-b382-161799775402" path="/var/lib/kubelet/pods/0fe7de2d-b8f1-40af-b382-161799775402/volumes"
Jul 28 18:54:54.801414 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:54.801372    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:54:59.675115 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.675062    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tpd97/must-gather-k4ppp"]
Jul 28 18:54:59.675676 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.675653    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fe7de2d-b8f1-40af-b382-161799775402" containerName="main"
Jul 28 18:54:59.675676 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.675677    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fe7de2d-b8f1-40af-b382-161799775402" containerName="main"
Jul 28 18:54:59.675814 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.675697    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="095075a6-a32d-4ec2-981c-217283596ccc" containerName="manager"
Jul 28 18:54:59.675814 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.675704    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="095075a6-a32d-4ec2-981c-217283596ccc" containerName="manager"
Jul 28 18:54:59.675814 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.675768    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="095075a6-a32d-4ec2-981c-217283596ccc" containerName="manager"
Jul 28 18:54:59.675814 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.675779    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fe7de2d-b8f1-40af-b382-161799775402" containerName="main"
Jul 28 18:54:59.679987 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.679971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:54:59.683318 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.683295    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tpd97\"/\"kube-root-ca.crt\""
Jul 28 18:54:59.683318 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.683295    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tpd97\"/\"openshift-service-ca.crt\""
Jul 28 18:54:59.684598 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.684576    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tpd97\"/\"default-dockercfg-8nhgk\""
Jul 28 18:54:59.687236 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.687183    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:54:59.689584 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.689554    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tpd97/must-gather-k4ppp"]
Jul 28 18:54:59.745164 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.745127    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:54:59.761450 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.761420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgjmx\" (UniqueName: \"kubernetes.io/projected/19403249-a476-46ae-93d9-04c7381251ee-kube-api-access-lgjmx\") pod \"must-gather-k4ppp\" (UID: \"19403249-a476-46ae-93d9-04c7381251ee\") " pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:54:59.761588 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.761478    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/19403249-a476-46ae-93d9-04c7381251ee-must-gather-output\") pod \"must-gather-k4ppp\" (UID: \"19403249-a476-46ae-93d9-04c7381251ee\") " pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:54:59.862777 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.862739    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/19403249-a476-46ae-93d9-04c7381251ee-must-gather-output\") pod \"must-gather-k4ppp\" (UID: \"19403249-a476-46ae-93d9-04c7381251ee\") " pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:54:59.862962 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.862827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgjmx\" (UniqueName: \"kubernetes.io/projected/19403249-a476-46ae-93d9-04c7381251ee-kube-api-access-lgjmx\") pod \"must-gather-k4ppp\" (UID: \"19403249-a476-46ae-93d9-04c7381251ee\") " pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:54:59.863137 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.863103    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/19403249-a476-46ae-93d9-04c7381251ee-must-gather-output\") pod \"must-gather-k4ppp\" (UID: \"19403249-a476-46ae-93d9-04c7381251ee\") " pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:54:59.871544 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.871513    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgjmx\" (UniqueName: \"kubernetes.io/projected/19403249-a476-46ae-93d9-04c7381251ee-kube-api-access-lgjmx\") pod \"must-gather-k4ppp\" (UID: \"19403249-a476-46ae-93d9-04c7381251ee\") " pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:54:59.999803 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:54:59.999709    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:55:00.143513 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:00.143490    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tpd97/must-gather-k4ppp"]
Jul 28 18:55:00.145609 ip-10-0-140-52 kubenswrapper[2574]: W0728 18:55:00.145572    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19403249_a476_46ae_93d9_04c7381251ee.slice/crio-66730b8397e56c489f9c874f53e434d1da2400132bbbc7bc7816b2ff63314a67 WatchSource:0}: Error finding container 66730b8397e56c489f9c874f53e434d1da2400132bbbc7bc7816b2ff63314a67: Status 404 returned error can't find the container with id 66730b8397e56c489f9c874f53e434d1da2400132bbbc7bc7816b2ff63314a67
Jul 28 18:55:00.854974 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:00.854930    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tpd97/must-gather-k4ppp" event={"ID":"19403249-a476-46ae-93d9-04c7381251ee","Type":"ContainerStarted","Data":"66730b8397e56c489f9c874f53e434d1da2400132bbbc7bc7816b2ff63314a67"}
Jul 28 18:55:06.891184 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:06.891098    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tpd97/must-gather-k4ppp" event={"ID":"19403249-a476-46ae-93d9-04c7381251ee","Type":"ContainerStarted","Data":"9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034"}
Jul 28 18:55:06.891184 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:06.891155    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tpd97/must-gather-k4ppp" event={"ID":"19403249-a476-46ae-93d9-04c7381251ee","Type":"ContainerStarted","Data":"d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27"}
Jul 28 18:55:06.910366 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:06.910312    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tpd97/must-gather-k4ppp" podStartSLOduration=1.741591234 podStartE2EDuration="7.910296034s" totalImagesPullingTime="6.1687048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:55:06.909733365 +0000 UTC m=+5894.337512603" watchObservedRunningTime="2026-07-28 18:55:06.910296034 +0000 UTC m=+5894.338075273"
Jul 28 18:55:23.174944 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:23.174907    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bv8fm_92b31cc8-c6f2-4d4f-bfc3-b6562120f883/discovery/0.log"
Jul 28 18:55:24.546254 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:24.546210    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bv8fm_92b31cc8-c6f2-4d4f-bfc3-b6562120f883/discovery/0.log"
Jul 28 18:55:26.116401 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:26.116345    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bv8fm_92b31cc8-c6f2-4d4f-bfc3-b6562120f883/discovery/0.log"
Jul 28 18:55:27.588445 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:27.588409    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bv8fm_92b31cc8-c6f2-4d4f-bfc3-b6562120f883/discovery/0.log"
Jul 28 18:55:28.602807 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:28.602775    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:28.614832 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:28.614802    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:28.796249 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:28.796216    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:28.816361 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:28.816323    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:29.786198 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:29.780450    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:29.799538 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:29.799508    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:29.979567 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:29.979536    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:29.999643 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:29.999606    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:30.965782 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:30.965748    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:30.981770 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:30.981731    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:31.156214 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:31.156181    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:31.173555 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:31.173522    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:32.113739 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:32.113707    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:32.126958 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:32.126929    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:32.297946 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:32.297910    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:32.315797 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:32.315766    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:33.258352 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:33.258321    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:33.270305 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:33.270280    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:33.452269 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:33.452238    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:33.467937 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:33.467904    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:34.411022 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:34.410983    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:34.426549 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:34.426489    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:34.601246 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:34.601216    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:34.616746 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:34.616714    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:35.564501 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:35.564467    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:35.579164 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:35.579127    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:35.746343 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:35.746311    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:35.762596 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:35.762568    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:36.727383 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:36.727352    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:36.767014 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:36.766981    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:36.943797 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:36.943770    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:36.960137 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:36.960101    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:37.904051 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:37.904020    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:37.918814 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:37.918784    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:38.099197 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:38.099164    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:38.116968 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:38.116937    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:39.074311 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:39.074282    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:39.088517 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:39.088492    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:39.259185 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:39.259152    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:39.274147 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:39.274113    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:40.283216 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:40.283166    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:40.294524 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:40.294499    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:40.457991 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:40.457960    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:40.473736 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:40.473683    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:41.426798 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:41.426760    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:41.443279 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:41.438034    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:41.614104 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:41.614054    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:41.631215 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:41.631177    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:42.587320 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:42.587285    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:42.602510 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:42.602481    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:42.771917 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:42.771882    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:42.790608 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:42.790578    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:43.748423 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:43.748393    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:43.763293 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:43.763263    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:43.938737 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:43.938709    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:43.958607 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:43.958576    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:44.904267 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:44.904187    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:44.918864 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:44.918834    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:45.091215 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:45.091179    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:45.108823 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:45.108788    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:46.063201 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:46.063171    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:46.077552 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:46.077510    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:46.247171 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:46.247147    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:46.263683 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:46.263657    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:47.215159 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:47.215128    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:47.227740 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:47.227714    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:47.398670 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:47.398639    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:47.414311 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:47.414272    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:48.347328 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:48.347291    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:48.359361 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:48.359331    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:48.523275 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:48.523246    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:48.538267 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:48.538217    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:49.470845 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:49.470813    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:49.483664 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:49.483640    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:49.661259 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:49.661224    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:49.684210 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:49.684181    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:50.711552 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:50.711520    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:50.725057 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:50.725031    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:50.896244 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:50.896216    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:50.911550 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:50.911521    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:51.860629 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:51.860595    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:51.877135 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:51.877105    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:52.044027 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:52.044001    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:52.063877 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:52.063843    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:53.017417 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:53.017385    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:53.030984 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:53.030939    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:53.208093 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:53.208046    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:53.223114 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:53.223086    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:54.158471 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:54.158437    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:54.171781 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:54.171751    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:54.348107 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:54.348060    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:54.364103 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:54.364059    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:55.322978 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:55.322950    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:55.336810 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:55.336780    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:55.508519 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:55.508485    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:55.524402 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:55.524366    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:56.466271 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:56.466238    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:56.478447 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:56.478411    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:56.643579 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:56.643552    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:56.660938 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:56.660908    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:57.600007 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:57.599967    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:57.612081 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:57.612040    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:57.779307 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:57.779270    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:57.796004 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:57.795944    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:58.738013 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:58.737984    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:58.750292 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:58.750259    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:55:58.915325 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:58.915294    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:55:58.931871 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:58.931838    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:55:59.868362 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:59.868333    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:55:59.882988 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:55:59.882955    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:00.077026 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:00.076998    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:00.097723 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:00.097693    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:01.082321 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:01.082274    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:01.097632 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:01.097601    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:01.269909 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:01.269882    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:01.287041 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:01.287008    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:02.236399 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:02.236372    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:02.250004 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:02.249959    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:02.418232 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:02.418196    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:02.432763 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:02.432734    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:03.377959 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:03.377928    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:03.391483 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:03.391449    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:03.575616 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:03.575582    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:03.591754 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:03.591722    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:04.542299 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:04.542269    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:04.556435 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:04.556410    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:04.719546 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:04.719516    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:04.736754 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:04.736720    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:05.727880 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:05.727845    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:05.740577 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:05.740539    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:05.920827 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:05.920796    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:05.937761 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:05.937727    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:06.882492 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:06.882453    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:06.897080 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:06.897034    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:07.062803 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:07.062771    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:07.079232 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:07.079193    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:08.014600 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:08.014566    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:08.026422 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:08.026397    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:08.196391 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:08.196365    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:08.210441 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:08.210410    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:09.141882 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:09.141849    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:09.154842 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:09.154814    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:09.322132 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:09.322104    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:09.338841 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:09.338807    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:10.274391 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:10.274353    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:10.286724 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:10.286692    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:10.454431 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:10.454403    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:10.471461 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:10.471432    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:11.299449 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:11.299417    2574 generic.go:356] "Generic (PLEG): container finished" podID="19403249-a476-46ae-93d9-04c7381251ee" containerID="d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27" exitCode=0
Jul 28 18:56:11.300013 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:11.299489    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tpd97/must-gather-k4ppp" event={"ID":"19403249-a476-46ae-93d9-04c7381251ee","Type":"ContainerDied","Data":"d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27"}
Jul 28 18:56:11.300013 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:11.299908    2574 scope.go:117] "RemoveContainer" containerID="d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27"
Jul 28 18:56:12.017043 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.017013    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-tpd97_must-gather-k4ppp_19403249-a476-46ae-93d9-04c7381251ee/gather/0.log"
Jul 28 18:56:12.486466 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.486382    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:56:12.656816 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.656780    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ct488/must-gather-wlhgr"]
Jul 28 18:56:12.661488 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.661464    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ct488/must-gather-wlhgr"
Jul 28 18:56:12.664625 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.664605    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ct488\"/\"openshift-service-ca.crt\""
Jul 28 18:56:12.664743 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.664712    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ct488\"/\"kube-root-ca.crt\""
Jul 28 18:56:12.665786 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.665771    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ct488\"/\"default-dockercfg-gl4lk\""
Jul 28 18:56:12.671252 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.671228    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ct488/must-gather-wlhgr"]
Jul 28 18:56:12.766759 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.766723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c-must-gather-output\") pod \"must-gather-wlhgr\" (UID: \"e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c\") " pod="openshift-must-gather-ct488/must-gather-wlhgr"
Jul 28 18:56:12.766759 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.766770    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtshq\" (UniqueName: \"kubernetes.io/projected/e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c-kube-api-access-qtshq\") pod \"must-gather-wlhgr\" (UID: \"e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c\") " pod="openshift-must-gather-ct488/must-gather-wlhgr"
Jul 28 18:56:12.867294 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.867255    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtshq\" (UniqueName: \"kubernetes.io/projected/e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c-kube-api-access-qtshq\") pod \"must-gather-wlhgr\" (UID: \"e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c\") " pod="openshift-must-gather-ct488/must-gather-wlhgr"
Jul 28 18:56:12.867454 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.867400    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c-must-gather-output\") pod \"must-gather-wlhgr\" (UID: \"e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c\") " pod="openshift-must-gather-ct488/must-gather-wlhgr"
Jul 28 18:56:12.867764 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.867745    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c-must-gather-output\") pod \"must-gather-wlhgr\" (UID: \"e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c\") " pod="openshift-must-gather-ct488/must-gather-wlhgr"
Jul 28 18:56:12.876741 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.876722    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtshq\" (UniqueName: \"kubernetes.io/projected/e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c-kube-api-access-qtshq\") pod \"must-gather-wlhgr\" (UID: \"e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c\") " pod="openshift-must-gather-ct488/must-gather-wlhgr"
Jul 28 18:56:12.970942 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:12.970898    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ct488/must-gather-wlhgr"
Jul 28 18:56:13.111637 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:13.111608    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ct488/must-gather-wlhgr"]
Jul 28 18:56:13.113438 ip-10-0-140-52 kubenswrapper[2574]: W0728 18:56:13.113410    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode334ebc0_2fb7_47ad_8e5d_28dfa0c2c94c.slice/crio-5d4aefae77b5e1d97adca1b1d1c720f372f21431bfc7c87d678789bf2a0781eb WatchSource:0}: Error finding container 5d4aefae77b5e1d97adca1b1d1c720f372f21431bfc7c87d678789bf2a0781eb: Status 404 returned error can't find the container with id 5d4aefae77b5e1d97adca1b1d1c720f372f21431bfc7c87d678789bf2a0781eb
Jul 28 18:56:13.311618 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:13.311530    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct488/must-gather-wlhgr" event={"ID":"e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c","Type":"ContainerStarted","Data":"5d4aefae77b5e1d97adca1b1d1c720f372f21431bfc7c87d678789bf2a0781eb"}
Jul 28 18:56:13.810945 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:13.810909    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:56:14.320343 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:14.320299    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct488/must-gather-wlhgr" event={"ID":"e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c","Type":"ContainerStarted","Data":"d8daad316fe35ec9e71aeb4981be70aa6ebd43cbb90fc3f5779874080f4466e8"}
Jul 28 18:56:14.320544 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:14.320358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct488/must-gather-wlhgr" event={"ID":"e334ebc0-2fb7-47ad-8e5d-28dfa0c2c94c","Type":"ContainerStarted","Data":"3ab892db4769794ee11ee65adfa1541ed54333823e687dbc31abf6ef8e444e56"}
Jul 28 18:56:15.566758 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:15.566724    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9l299_aad70f3d-c86b-45f4-abdf-4d86bdecdf0b/global-pull-secret-syncer/0.log"
Jul 28 18:56:15.644425 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:15.644383    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log"
Jul 28 18:56:15.829957 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:15.829871    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-52.ec2.internal_2a7be853eabb2e477d6252d8cbc46b72/haproxy/0.log"
Jul 28 18:56:17.476342 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.476270    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ct488/must-gather-wlhgr" podStartSLOduration=4.647047637 podStartE2EDuration="5.476247779s" totalImagesPullingTime="829.200142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:56:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:56:14.336940765 +0000 UTC m=+5961.764720017" watchObservedRunningTime="2026-07-28 18:56:17.476247779 +0000 UTC m=+5964.904027018"
Jul 28 18:56:17.477179 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.477145    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-tpd97/must-gather-k4ppp"]
Jul 28 18:56:17.477417 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.477385    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-tpd97/must-gather-k4ppp" podUID="19403249-a476-46ae-93d9-04c7381251ee" containerName="copy" containerID="cri-o://9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034" gracePeriod=2
Jul 28 18:56:17.480524 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:56:17.480183    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k4ppp\" is forbidden: User \"system:node:ip-10-0-140-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-tpd97\": no relationship found between node 'ip-10-0-140-52.ec2.internal' and this object" podUID="19403249-a476-46ae-93d9-04c7381251ee" pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:56:17.484281 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.484254    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-tpd97/must-gather-k4ppp"]
Jul 28 18:56:17.858570 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.858261    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-tpd97_must-gather-k4ppp_19403249-a476-46ae-93d9-04c7381251ee/copy/0.log"
Jul 28 18:56:17.866263 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.866222    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:56:17.870251 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:56:17.870093    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k4ppp\" is forbidden: User \"system:node:ip-10-0-140-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-tpd97\": no relationship found between node 'ip-10-0-140-52.ec2.internal' and this object" podUID="19403249-a476-46ae-93d9-04c7381251ee" pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:56:17.921465 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.921425    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgjmx\" (UniqueName: \"kubernetes.io/projected/19403249-a476-46ae-93d9-04c7381251ee-kube-api-access-lgjmx\") pod \"19403249-a476-46ae-93d9-04c7381251ee\" (UID: \"19403249-a476-46ae-93d9-04c7381251ee\") "
Jul 28 18:56:17.921663 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.921478    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/19403249-a476-46ae-93d9-04c7381251ee-must-gather-output\") pod \"19403249-a476-46ae-93d9-04c7381251ee\" (UID: \"19403249-a476-46ae-93d9-04c7381251ee\") "
Jul 28 18:56:17.928279 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.927757    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19403249-a476-46ae-93d9-04c7381251ee-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "19403249-a476-46ae-93d9-04c7381251ee" (UID: "19403249-a476-46ae-93d9-04c7381251ee"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:56:17.947428 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:17.947378    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19403249-a476-46ae-93d9-04c7381251ee-kube-api-access-lgjmx" (OuterVolumeSpecName: "kube-api-access-lgjmx") pod "19403249-a476-46ae-93d9-04c7381251ee" (UID: "19403249-a476-46ae-93d9-04c7381251ee"). InnerVolumeSpecName "kube-api-access-lgjmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:56:18.022599 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.022562    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgjmx\" (UniqueName: \"kubernetes.io/projected/19403249-a476-46ae-93d9-04c7381251ee-kube-api-access-lgjmx\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:56:18.022599 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.022600    2574 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/19403249-a476-46ae-93d9-04c7381251ee-must-gather-output\") on node \"ip-10-0-140-52.ec2.internal\" DevicePath \"\""
Jul 28 18:56:18.354856 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.354823    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-tpd97_must-gather-k4ppp_19403249-a476-46ae-93d9-04c7381251ee/copy/0.log"
Jul 28 18:56:18.355481 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.355457    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:56:18.363026 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:56:18.362984    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k4ppp\" is forbidden: User \"system:node:ip-10-0-140-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-tpd97\": no relationship found between node 'ip-10-0-140-52.ec2.internal' and this object" podUID="19403249-a476-46ae-93d9-04c7381251ee" pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:56:18.368745 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.368621    2574 generic.go:356] "Generic (PLEG): container finished" podID="19403249-a476-46ae-93d9-04c7381251ee" containerID="9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034" exitCode=143
Jul 28 18:56:18.368745 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.368689    2574 scope.go:117] "RemoveContainer" containerID="9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034"
Jul 28 18:56:18.376875 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:56:18.376830    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k4ppp\" is forbidden: User \"system:node:ip-10-0-140-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-tpd97\": no relationship found between node 'ip-10-0-140-52.ec2.internal' and this object" podUID="19403249-a476-46ae-93d9-04c7381251ee" pod="openshift-must-gather-tpd97/must-gather-k4ppp"
Jul 28 18:56:18.394932 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.394799    2574 scope.go:117] "RemoveContainer" containerID="d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27"
Jul 28 18:56:18.425887 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.425528    2574 scope.go:117] "RemoveContainer" containerID="9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034"
Jul 28 18:56:18.426670 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:56:18.426493    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034\": container with ID starting with 9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034 not found: ID does not exist" containerID="9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034"
Jul 28 18:56:18.426670 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.426533    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034"} err="failed to get container status \"9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034\": rpc error: code = NotFound desc = could not find container \"9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034\": container with ID starting with 9dcabf7f3cec945c9cea41dc5a0ad2b37fa51f8da944e12c4c7133949eda0034 not found: ID does not exist"
Jul 28 18:56:18.426670 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.426565    2574 scope.go:117] "RemoveContainer" containerID="d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27"
Jul 28 18:56:18.426927 ip-10-0-140-52 kubenswrapper[2574]: E0728 18:56:18.426867    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27\": container with ID starting with d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27 not found: ID does not exist" containerID="d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27"
Jul 28 18:56:18.426927 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.426894    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27"} err="failed to get container status \"d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27\": rpc error: code = NotFound desc = could not find container \"d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27\": container with ID starting with d7a0cc5419479347b94585884c691f750e7a0a497fb042d290a43a03f12cdc27 not found: ID does not exist"
Jul 28 18:56:18.971194 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:18.971134    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:56:19.028524 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:19.028483    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b74hg_aa38da5b-d785-47e5-b319-87b782aad3e4/konnectivity-agent/0.log" limit=1024
Jul 28 18:56:19.154118 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:19.154058    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19403249-a476-46ae-93d9-04c7381251ee" path="/var/lib/kubelet/pods/19403249-a476-46ae-93d9-04c7381251ee/volumes"
Jul 28 18:56:20.044823 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:20.044792    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-56fb6f6856-2kw2j_4f986299-6e67-4498-a1d4-e68a33f877ff/manager/0.log"
Jul 28 18:56:20.077021 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:20.076992    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ccbdf686-qq2zk_99ad4cfb-67b1-462c-b0f3-69adf799fb84/manager/0.log"
Jul 28 18:56:20.328990 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:20.328908    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5xp74_855336d4-cccc-4ef1-9452-37086fb23276/limitador/0.log"
Jul 28 18:56:20.359843 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:20.359797    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-774d94476f-xhtkz_17489ec7-bb33-417f-91cf-e47595c89aa9/manager/0.log"
Jul 28 18:56:21.948578 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:21.948540    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc2a7663-7e5f-4136-a655-4d1a79ea1398/alertmanager/0.log"
Jul 28 18:56:21.970649 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:21.970619    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc2a7663-7e5f-4136-a655-4d1a79ea1398/config-reloader/0.log"
Jul 28 18:56:21.993650 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:21.993623    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc2a7663-7e5f-4136-a655-4d1a79ea1398/kube-rbac-proxy-web/0.log"
Jul 28 18:56:22.013646 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.013559    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc2a7663-7e5f-4136-a655-4d1a79ea1398/kube-rbac-proxy/0.log"
Jul 28 18:56:22.034001 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.033960    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc2a7663-7e5f-4136-a655-4d1a79ea1398/kube-rbac-proxy-metric/0.log"
Jul 28 18:56:22.060354 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.060324    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc2a7663-7e5f-4136-a655-4d1a79ea1398/prom-label-proxy/0.log"
Jul 28 18:56:22.083492 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.083451    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fc2a7663-7e5f-4136-a655-4d1a79ea1398/init-config-reloader/0.log"
Jul 28 18:56:22.238301 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.238220    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64446b66cb-mc49d_f73e1f52-2e96-44f5-ba28-746845519c60/metrics-server/0.log"
Jul 28 18:56:22.265823 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.265548    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-llwkt_86551e1c-409e-42ae-ae0a-d05d35e53a97/monitoring-plugin/0.log"
Jul 28 18:56:22.449228 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.449196    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qjjlj_570a24e6-69f5-4f45-a9ec-eee669919228/node-exporter/0.log"
Jul 28 18:56:22.474984 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.474949    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qjjlj_570a24e6-69f5-4f45-a9ec-eee669919228/kube-rbac-proxy/0.log"
Jul 28 18:56:22.504251 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.504176    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qjjlj_570a24e6-69f5-4f45-a9ec-eee669919228/init-textfile/0.log"
Jul 28 18:56:22.872032 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.871976    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f6697f644-mbplm_785f75a4-01fb-404d-8225-797865e0fe45/telemeter-client/0.log"
Jul 28 18:56:22.896689 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.896661    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f6697f644-mbplm_785f75a4-01fb-404d-8225-797865e0fe45/reload/0.log"
Jul 28 18:56:22.919671 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.919638    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f6697f644-mbplm_785f75a4-01fb-404d-8225-797865e0fe45/kube-rbac-proxy/0.log"
Jul 28 18:56:22.953061 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.953026    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75fc5bc9cc-clmpl_55fd9971-3831-4962-80bf-f2a668791e70/thanos-query/0.log"
Jul 28 18:56:22.977253 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:22.977220    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75fc5bc9cc-clmpl_55fd9971-3831-4962-80bf-f2a668791e70/kube-rbac-proxy-web/0.log"
Jul 28 18:56:23.018735 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:23.017810    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75fc5bc9cc-clmpl_55fd9971-3831-4962-80bf-f2a668791e70/kube-rbac-proxy/0.log"
Jul 28 18:56:23.039741 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:23.038785    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75fc5bc9cc-clmpl_55fd9971-3831-4962-80bf-f2a668791e70/prom-label-proxy/0.log"
Jul 28 18:56:23.062957 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:23.062920    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75fc5bc9cc-clmpl_55fd9971-3831-4962-80bf-f2a668791e70/kube-rbac-proxy-rules/0.log"
Jul 28 18:56:23.089708 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:23.089671    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75fc5bc9cc-clmpl_55fd9971-3831-4962-80bf-f2a668791e70/kube-rbac-proxy-metrics/0.log"
Jul 28 18:56:24.614578 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:24.614543    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-795tw_8a3edc0a-9137-48df-b36b-16cb0b75f28b/networking-console-plugin/0.log"
Jul 28 18:56:25.749482 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:25.749447    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-2vcxq_568e5fb7-6017-4c0c-b0cd-04915993d621/download-server/0.log"
Jul 28 18:56:26.102012 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.101970    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"]
Jul 28 18:56:26.102813 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.102789    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19403249-a476-46ae-93d9-04c7381251ee" containerName="gather"
Jul 28 18:56:26.102954 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.102943    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19403249-a476-46ae-93d9-04c7381251ee" containerName="gather"
Jul 28 18:56:26.103086 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.103057    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19403249-a476-46ae-93d9-04c7381251ee" containerName="copy"
Jul 28 18:56:26.103086 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.103087    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19403249-a476-46ae-93d9-04c7381251ee" containerName="copy"
Jul 28 18:56:26.103342 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.103211    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19403249-a476-46ae-93d9-04c7381251ee" containerName="copy"
Jul 28 18:56:26.103342 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.103224    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19403249-a476-46ae-93d9-04c7381251ee" containerName="gather"
Jul 28 18:56:26.109978 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.109897    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.116431 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.116403    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"]
Jul 28 18:56:26.211435 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.211393    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-podres\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.211773 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.211751    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-sys\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.212259 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.212235    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-lib-modules\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.212447 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.212425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-proc\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.212733 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.212713    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djc42\" (UniqueName: \"kubernetes.io/projected/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-kube-api-access-djc42\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.313692 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.313655    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djc42\" (UniqueName: \"kubernetes.io/projected/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-kube-api-access-djc42\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.313692 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.313699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-podres\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.313956 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.313746    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-sys\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.313956 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.313777    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-lib-modules\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.313956 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.313806    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-proc\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.313956 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.313869    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-sys\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.313956 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.313899    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-podres\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.313956 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.313910    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-lib-modules\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.314205 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.313960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-proc\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.325030 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.324993    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djc42\" (UniqueName: \"kubernetes.io/projected/e40c74c1-732b-46e8-b5cc-c83ef7f080e7-kube-api-access-djc42\") pod \"perf-node-gather-daemonset-dwlkr\" (UID: \"e40c74c1-732b-46e8-b5cc-c83ef7f080e7\") " pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.426491 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.426398    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:26.599481 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:26.599434    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"]
Jul 28 18:56:27.441758 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:27.441709    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr" event={"ID":"e40c74c1-732b-46e8-b5cc-c83ef7f080e7","Type":"ContainerStarted","Data":"42772a13c0cff4315d93f5fb525664fd8df4f76e8936a337aaf50aaeee076890"}
Jul 28 18:56:27.442284 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:27.441788    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr" event={"ID":"e40c74c1-732b-46e8-b5cc-c83ef7f080e7","Type":"ContainerStarted","Data":"c356393ad6af7a6e085c1a4adfad898c6790288b3482812065670d1b17c5a624"}
Jul 28 18:56:27.442284 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:27.441818    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:27.464328 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:27.464270    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr" podStartSLOduration=1.464255195 podStartE2EDuration="1.464255195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:56:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:56:27.461102388 +0000 UTC m=+5974.888881626" watchObservedRunningTime="2026-07-28 18:56:27.464255195 +0000 UTC m=+5974.892034434"
Jul 28 18:56:27.551724 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:27.551695    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f96fd_53122cc2-26c7-43aa-b161-fccf61696643/dns/0.log"
Jul 28 18:56:27.582202 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:27.582166    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f96fd_53122cc2-26c7-43aa-b161-fccf61696643/kube-rbac-proxy/0.log"
Jul 28 18:56:27.616225 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:27.616179    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7qqxm_f6e7925a-b3c4-4064-925d-cdc5e31e48f1/dns-node-resolver/0.log"
Jul 28 18:56:28.287296 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:28.287265    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56565fd7f7-2x2n8_e4b12af9-1fcf-46bc-8b4f-e8db258f4af7/registry/0.log"
Jul 28 18:56:28.388394 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:28.388359    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z7pbf_9001436c-49c2-49d6-967a-2debaf26b00b/node-ca/0.log"
Jul 28 18:56:29.865363 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:29.865328    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bv8fm_92b31cc8-c6f2-4d4f-bfc3-b6562120f883/discovery/0.log"
Jul 28 18:56:30.501464 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:30.501417    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bbsrj_e0d6b4e4-3979-47bd-8780-27bfd715d592/serve-healthcheck-canary/0.log"
Jul 28 18:56:31.078228 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:31.078195    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gct9w_cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5/kube-rbac-proxy/0.log"
Jul 28 18:56:31.098017 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:31.097986    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gct9w_cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5/exporter/0.log"
Jul 28 18:56:31.118915 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:31.118889    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gct9w_cf4dcd02-b711-43a6-abdd-2fe8b45d9dc5/extractor/0.log"
Jul 28 18:56:33.461625 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:33.461593    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ct488/perf-node-gather-daemonset-dwlkr"
Jul 28 18:56:34.880675 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:34.880640    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-658796f68b-tpds6_a5883e9b-5fc9-4a26-b16c-b158902c5f94/manager/0.log"
Jul 28 18:56:36.084431 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:36.084404    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bv8fm_92b31cc8-c6f2-4d4f-bfc3-b6562120f883/discovery/0.log"
Jul 28 18:56:37.790430 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:37.790396    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-bv8fm_92b31cc8-c6f2-4d4f-bfc3-b6562120f883/discovery/0.log"
Jul 28 18:56:42.515381 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:42.515350    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpb4n_f0714666-577a-4238-828b-d307712d99a6/kube-multus-additional-cni-plugins/0.log"
Jul 28 18:56:42.537044 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:42.537015    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpb4n_f0714666-577a-4238-828b-d307712d99a6/egress-router-binary-copy/0.log"
Jul 28 18:56:42.560210 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:42.560181    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpb4n_f0714666-577a-4238-828b-d307712d99a6/cni-plugins/0.log"
Jul 28 18:56:42.583326 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:42.583295    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpb4n_f0714666-577a-4238-828b-d307712d99a6/bond-cni-plugin/0.log"
Jul 28 18:56:42.614639 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:42.614611    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpb4n_f0714666-577a-4238-828b-d307712d99a6/routeoverride-cni/0.log"
Jul 28 18:56:42.640218 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:42.640192    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpb4n_f0714666-577a-4238-828b-d307712d99a6/whereabouts-cni-bincopy/0.log"
Jul 28 18:56:42.683999 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:42.683967    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lpb4n_f0714666-577a-4238-828b-d307712d99a6/whereabouts-cni/0.log"
Jul 28 18:56:43.056005 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:43.055971    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lr8ct_4de10f76-be20-4f9f-b9b9-e5035874d200/kube-multus/0.log"
Jul 28 18:56:43.079915 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:43.079887    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-77rmg_93a8f35e-919b-4c2b-ab51-54cce84896bf/network-metrics-daemon/0.log"
Jul 28 18:56:43.097681 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:43.097652    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-77rmg_93a8f35e-919b-4c2b-ab51-54cce84896bf/kube-rbac-proxy/0.log"
Jul 28 18:56:44.490324 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:44.490257    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-controller/0.log"
Jul 28 18:56:44.509116 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:44.509086    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/0.log"
Jul 28 18:56:44.509301 ip-10-0-140-52 kubenswrapper[2574]: I0728 18:56:44.509122    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qbd6q_307dbf09-689f-436e-9019-bfa20d6944c3/ovn-acl-logging/1.log"