Sep 17 15:38:41.101763 ip-10-0-139-98 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 15:38:41.508693 ip-10-0-139-98 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 15:38:41.508693 ip-10-0-139-98 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 15:38:41.508693 ip-10-0-139-98 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 15:38:41.508693 ip-10-0-139-98 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 15:38:41.508693 ip-10-0-139-98 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 15:38:41.509388 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.508755    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 15:38:41.513171 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513154    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:41.513171 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513170    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513174    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513178    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513181    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513184    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513187    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513190    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513192    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513195    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513198    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513200    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513203    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513206    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513208    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513211    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513215    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513218    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513221    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513224    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513227    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:41.513234 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513229    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513232    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513234    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513237    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513240    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513243    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513245    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513248    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513251    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513254    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513256    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513259    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513261    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513264    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513267    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513270    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513272    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513276    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513280    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:41.513735 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513284    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513287    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513290    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513292    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513296    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513299    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513301    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513304    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513308    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513311    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513314    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513317    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513320    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513323    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513325    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513329    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513332    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513334    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513337    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:41.514204 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513340    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513343    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513346    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513348    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513351    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513354    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513356    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513359    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513363    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513367    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513370    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513372    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513375    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513378    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513380    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513383    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513386    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513389    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513391    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513394    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:41.514768 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513396    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513399    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513401    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513404    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513406    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513409    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513412    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513414    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513419    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513423    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513425    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513428    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513431    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513434    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513437    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513439    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513442    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513445    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513447    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.513450    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:41.515272 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514154    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514160    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514163    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514166    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514169    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514171    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514175    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514177    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514181    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514183    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514186    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514189    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514192    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514195    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514198    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514200    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514203    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514206    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514209    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:41.515775 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514213    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514216    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514219    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514222    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514226    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514230    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514233    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514236    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514239    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514242    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514245    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514250    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514253    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514256    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514259    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514262    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514265    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514267    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514270    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:41.516238 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514272    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514275    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514278    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514280    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514283    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514285    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514288    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514290    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514292    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514295    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514297    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514300    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514302    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514305    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514308    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514311    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514313    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514316    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514318    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:41.516714 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514321    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514323    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514326    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514329    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514331    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514334    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514336    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514339    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514341    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514343    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514346    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514349    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514351    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514354    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514357    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514360    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514362    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514365    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514367    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514370    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:41.517180 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514373    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514376    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514378    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514381    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514383    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514386    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514389    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514391    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514394    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514397    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514400    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514403    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514406    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514409    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514411    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514413    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514416    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514418    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514421    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514424    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:41.517681 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514426    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514429    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514812    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514816    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514819    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514823    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514825    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514829    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514831    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514834    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514836    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514840    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514842    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514847    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514850    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514854    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514857    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514860    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514863    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:41.518164 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514865    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514868    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514872    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514876    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514879    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514882    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514886    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514889    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514891    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514894    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514897    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514900    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514902    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514905    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514907    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514910    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514912    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514914    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514917    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:41.518674 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514919    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514922    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514925    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514928    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514930    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514933    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514936    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514938    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514942    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514945    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514947    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514950    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514952    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514954    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514957    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514960    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514962    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514965    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514967    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:41.519138 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514970    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514972    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514975    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514978    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514980    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514983    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514985    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514988    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514990    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514992    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514995    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.514997    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515000    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515003    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515005    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515007    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515010    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515013    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515016    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515018    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:41.519688 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515021    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515025    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515028    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515030    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515033    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515035    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515038    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515041    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515043    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515046    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515048    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515050    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515053    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515055    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515058    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515061    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515063    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515066    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515068    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515070    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:41.520206 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515073    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515075    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515078    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515081    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515145    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515177    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515193    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515198    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515208    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515213    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515217    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515222    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515226    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515230    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515234    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515238    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515241    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515244    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515247    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515250    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515253    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515256    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515260    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515263    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 15:38:41.520709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515266    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515269    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515273    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515277    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515281    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515284    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515287    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515290    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515293    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515296    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515300    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515303    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515307    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515310    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515313    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515316    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515319    2582 flags.go:64] FLAG: --enable-server="true"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515322    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515328    2582 flags.go:64] FLAG: --event-burst="100"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515331    2582 flags.go:64] FLAG: --event-qps="50"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515335    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515339    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515343    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515347    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 15:38:41.521281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515350    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515353    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515356    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515359    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515362    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515365    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515368    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515371    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515374    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515377    2582 flags.go:64] FLAG: --feature-gates=""
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515381    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515383    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515387    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515390    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515393    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515396    2582 flags.go:64] FLAG: --help="false"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515399    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515402    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515405    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515408    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515411    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515415    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515417    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 15:38:41.521984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515420    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515423    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515426    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515431    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515434    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515437    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515441    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515444    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515447    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515450    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515453    2582 flags.go:64] FLAG: --lock-file=""
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515456    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515459    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515462    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515467    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515471    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515474    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515477    2582 flags.go:64] FLAG: --logging-format="text"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515480    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515483    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515486    2582 flags.go:64] FLAG: --manifest-url=""
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515489    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515493    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515509    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515513    2582 flags.go:64] FLAG: --max-pods="110"
Sep 17 15:38:41.522574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515517    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515524    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515527    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515531    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515535    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515537    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515540    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515547    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515550    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515553    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515557    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515560    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515566    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515570    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515574    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515578    2582 flags.go:64] FLAG: --port="10250"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515581    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515584    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06e137b628cce6a34"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515587    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515590    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515593    2582 flags.go:64] FLAG: --register-node="true"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515596    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515600    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515603    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 17 15:38:41.523220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515606    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515609    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515612    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515615    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515618    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515621    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515624    2582 flags.go:64] FLAG: --runonce="false"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515627    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515630    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515633    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515636    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515639    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515642    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515645    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515648    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515651    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515654    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515657    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515661    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515664    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515667    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515671    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515677    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515680    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515683    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 15:38:41.524105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515687    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515690    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515693    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515696    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515699    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515702    2582 flags.go:64] FLAG: --v="2"
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515706    2582 flags.go:64] FLAG: --version="false"
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515710    2582 flags.go:64] FLAG: --vmodule=""
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515714    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.515717    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515831    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515835    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515838    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515841    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515843    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515846    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515848    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515851    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515854    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515856    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515859    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515861    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:41.524848 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515864    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515867    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515869    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515873    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515876    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515878    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515881    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515885    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515888    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515890    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515893    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515895    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515898    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515901    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515903    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515906    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515908    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515911    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515913    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515916    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:41.525393 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515919    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515921    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515924    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515926    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515929    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515932    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515934    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515936    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515939    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515941    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515944    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515946    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515949    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515951    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515954    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515958    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515961    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515963    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515966    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515969    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:41.525933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515973    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515976    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515978    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515981    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515983    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515986    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515989    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515991    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515994    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515996    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.515999    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516003    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516007    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516010    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516013    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516016    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516018    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516021    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516024    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:41.526417 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516034    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516038    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516040    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516043    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516046    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516050    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516053    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516056    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516060    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516062    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516066    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516071    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516074    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516077    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516081    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516084    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516087    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516090    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516093    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:41.526895 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516096    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516098    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516101    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516104    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516106    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516109    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516111    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516114    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.516117    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.516122    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.523212    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.523234    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.524622    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.524679    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525006    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:41.527373 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525016    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525019    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525023    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525026    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525029    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525033    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525036    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525038    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525041    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525046    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525051    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525054    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525058    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525061    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525063    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525066    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525068    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525071    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525073    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:41.527767 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525076    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525079    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525082    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525086    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525089    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525092    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525095    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525098    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525100    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525104    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525107    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525109    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525112    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525115    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525118    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525121    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525124    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525127    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525129    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525132    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:41.528236 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525134    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525137    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525139    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525142    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525144    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525147    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525149    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525152    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525155    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525157    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525159    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525162    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525165    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525167    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525170    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525172    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525175    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525177    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525180    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525182    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:41.528765 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525185    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525188    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525190    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525193    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525196    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525199    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525202    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525205    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525207    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525210    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525212    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525215    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525217    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525220    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525222    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525225    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525229    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525233    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525236    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:41.529280 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525239    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525242    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525245    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525260    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525264    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525268    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525271    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525273    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525276    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525279    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525282    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525284    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525287    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525290    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525293    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525295    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525298    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525301    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525303    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:41.529759 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525306    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.525312    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525428    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525433    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525436    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525440    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525443    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525446    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525449    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525452    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525454    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525457    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525460    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525462    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525466    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 15:38:41.530211 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525468    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525471    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525474    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525476    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525479    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525483    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525487    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525490    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525494    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525511    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525515    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525517    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525520    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525523    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525525    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525528    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525531    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525534    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525537    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 15:38:41.530600 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525540    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525543    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525546    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525549    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525553    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525557    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525559    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525562    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525565    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525567    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525570    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525573    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525575    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525580    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525582    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525585    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525588    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525590    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525593    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 15:38:41.531049 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525596    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525599    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525603    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525606    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525609    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525612    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525615    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525617    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525620    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525623    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525626    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525629    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525632    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525634    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525637    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525640    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525642    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525645    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525647    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525650    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 15:38:41.531508 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525653    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525655    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525658    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525660    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525663    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525665    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525668    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525672    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525674    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525677    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525680    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525682    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525685    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525687    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525690    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525692    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525694    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525697    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525700    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525703    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 15:38:41.531987 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525705    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525708    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525711    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525714    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525716    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525719    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525721    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:41.525724    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.525729    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.525840    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.528671    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.529574    2582 server.go:1019] "Starting client certificate rotation"
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.529672    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 15:38:41.532464 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.529706    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 15:38:41.532810 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.532059    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 15:38:41.534112 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.534094    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 15:38:41.547460 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.547441    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 17 15:38:41.551529 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.551512    2582 log.go:25] "Validated CRI v1 image API"
Sep 17 15:38:41.552379 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.552360    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 15:38:41.555524 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.555481    2582 fs.go:135] Filesystem UUIDs: map[456c1e4f-ee33-469f-8f99-6bbd7744a5f4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bfc185c1-6f6c-4656-a1f9-8e2347aaecac:/dev/nvme0n1p4]
Sep 17 15:38:41.555610 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.555521    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 15:38:41.559494 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.559470    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 15:38:41.560404 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.560292    2582 manager.go:216] Machine: {Timestamp:2026-09-17 15:38:41.559827247 +0000 UTC m=+0.341514574 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100474 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22d01d6e8d82690cd15fd543009b95 SystemUUID:ec22d01d-6e8d-8269-0cd1-5fd543009b95 BootID:1ce6c54e-0ade-413e-ad2e-15efded6c578 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d2:d1:a7:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d2:d1:a7:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:83:2f:75:f9:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 15:38:41.560404 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.560403    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 15:38:41.560522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.560477    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 15:38:41.562624 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.562599    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 15:38:41.562760 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.562625    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-98.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 15:38:41.563344 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.563333    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 15:38:41.563375 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.563345    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 15:38:41.563375 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.563353    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 15:38:41.563859 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.563848    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 15:38:41.564586 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.564576    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 15:38:41.566847 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.566837    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 15:38:41.566973 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.566964    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 15:38:41.567008 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.566994    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 15:38:41.567039 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.567017    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 15:38:41.567039 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.567035    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 15:38:41.567093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.567066    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 17 15:38:41.567093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.567091    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 15:38:41.567654 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.567632    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 15:38:41.567754 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.567663    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 15:38:41.570844 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.570824    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 15:38:41.572728 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.572714    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 15:38:41.572799 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.572744    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 15:38:41.574406 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574387    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 15:38:41.574406 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574410    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574417    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574423    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574431    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574436    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574448    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574453    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574460    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574466    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574474    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 15:38:41.574534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.574480    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 15:38:41.575388 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.575378    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 15:38:41.575388 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.575387    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 15:38:41.576234 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.576209    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 15:38:41.576298 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.576209    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 15:38:41.578900 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.578882    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mzrj8"
Sep 17 15:38:41.579117 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.579106    2582 server.go:1268] "Started kubelet"
Sep 17 15:38:41.579254 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.579227    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 15:38:41.579313 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.579275    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 15:38:41.579740 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.579701    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 15:38:41.580053 ip-10-0-139-98 systemd[1]: Started Kubernetes Kubelet.
Sep 17 15:38:41.580418 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.580403    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 15:38:41.581966 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.581952    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 15:38:41.583666 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.583641    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 15:38:41.584788 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.584389    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 15:38:41.584845 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.584406    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 15:38:41.584996 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.584977    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:41.585100 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.585081    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 15:38:41.585166 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.585107    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 15:38:41.585229 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.585195    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 15:38:41.585314 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.585300    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 15:38:41.585376 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.585313    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 15:38:41.585910 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.585894    2582 factory.go:55] Registering systemd factory
Sep 17 15:38:41.585910 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.585912    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 17 15:38:41.586196 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.586176    2582 factory.go:153] Registering CRI-O factory
Sep 17 15:38:41.586196 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.586196    2582 factory.go:223] Registration of the crio container factory successfully
Sep 17 15:38:41.586323 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.586265    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 15:38:41.586323 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.586286    2582 factory.go:103] Registering Raw factory
Sep 17 15:38:41.586323 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.586303    2582 manager.go:1196] Started watching for new ooms in manager
Sep 17 15:38:41.586620 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.586590    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mzrj8"
Sep 17 15:38:41.586789 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.586773    2582 manager.go:349] Starting recovery of all containers
Sep 17 15:38:41.588696 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.588664    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 15:38:41.588820 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.588721    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 15:38:41.589805 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.588821    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18d625da549dd6e2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-09-17 15:38:41.579079394 +0000 UTC m=+0.360766721,LastTimestamp:2026-09-17 15:38:41.579079394 +0000 UTC m=+0.360766721,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}"
Sep 17 15:38:41.589898 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.589853    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-98.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 15:38:41.598673 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.598655    2582 manager.go:354] Recovery completed
Sep 17 15:38:41.603112 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.603100    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:41.604980 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.604961    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:41.605056 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.604993    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:41.605056 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.605006    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:41.605656 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.605641    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 15:38:41.605656 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.605655    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 15:38:41.605786 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.605673    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 15:38:41.605833 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.605673    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:41.606574 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.606557    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:41.606662 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.606577    2582 policy_none.go:49] "None policy: Start"
Sep 17 15:38:41.606662 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.606590    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:41.606662 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.606594    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 15:38:41.606662 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.606613    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:41.606828 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.606613    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 15:38:41.607369 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.607307    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-98.ec2.internal.18d625da562903aa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-98.ec2.internal,UID:ip-10-0-139-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-98.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-98.ec2.internal,},FirstTimestamp:2026-09-17 15:38:41.604977578 +0000 UTC m=+0.386664905,LastTimestamp:2026-09-17 15:38:41.604977578 +0000 UTC m=+0.386664905,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-98.ec2.internal,}"
Sep 17 15:38:41.607620 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.607603    2582 policy_none.go:47] "Start"
Sep 17 15:38:41.639151 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.639135    2582 manager.go:337] "Starting Device Plugin manager"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.639171    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.639189    2582 server.go:87] "Starting device plugin registration server"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.639543    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.639558    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.639658    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.639739    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.639748    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.640362    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.640425    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.643813    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.644969    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.645012    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.645035    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.645076    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 15:38:41.651062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.647603    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:41.740573 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.740539    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:41.741594 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.741576    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:41.741671 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.741608    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:41.741671 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.741619    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:41.741671 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.741641    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.745704 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.745676    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal"]
Sep 17 15:38:41.745765 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.745751    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:41.746576 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.746561    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:41.746691 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.746590    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:41.746691 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.746605    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:41.747618 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.747603    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.747663 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.747625    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-98.ec2.internal\": node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:41.748955 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.748943    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:41.749073 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.749061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.749110 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.749095    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:41.749701 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.749686    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:41.749761 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.749694    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:41.749761 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.749732    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:41.749761 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.749749    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:41.749850 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.749709    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:41.749850 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.749780    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:41.752011 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.751994    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.752011 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.752022    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 15:38:41.752683 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.752669    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 15:38:41.752754 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.752688    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 15:38:41.752754 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.752698    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeHasSufficientPID"
Sep 17 15:38:41.762429 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.762364    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:41.785323 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.785304    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-98.ec2.internal\" not found" node="ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.787224 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.787201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8faf76819e5b56f67e57f9b2de319c7e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"8faf76819e5b56f67e57f9b2de319c7e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.787324 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.787236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2394f2888c8dc0f48381d6308cf0747-config\") pod \"kube-apiserver-proxy-ip-10-0-139-98.ec2.internal\" (UID: \"c2394f2888c8dc0f48381d6308cf0747\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.787324 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.787262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8faf76819e5b56f67e57f9b2de319c7e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"8faf76819e5b56f67e57f9b2de319c7e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.790024 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.790004    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-98.ec2.internal\" not found" node="ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.863266 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.863235    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:41.887394 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.887368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8faf76819e5b56f67e57f9b2de319c7e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"8faf76819e5b56f67e57f9b2de319c7e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.887561 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.887400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8faf76819e5b56f67e57f9b2de319c7e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"8faf76819e5b56f67e57f9b2de319c7e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.887561 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.887417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2394f2888c8dc0f48381d6308cf0747-config\") pod \"kube-apiserver-proxy-ip-10-0-139-98.ec2.internal\" (UID: \"c2394f2888c8dc0f48381d6308cf0747\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.887561 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.887444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c2394f2888c8dc0f48381d6308cf0747-config\") pod \"kube-apiserver-proxy-ip-10-0-139-98.ec2.internal\" (UID: \"c2394f2888c8dc0f48381d6308cf0747\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.887561 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.887462    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8faf76819e5b56f67e57f9b2de319c7e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"8faf76819e5b56f67e57f9b2de319c7e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.887561 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:41.887482    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8faf76819e5b56f67e57f9b2de319c7e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal\" (UID: \"8faf76819e5b56f67e57f9b2de319c7e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:41.963611 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:41.963577    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:42.064283 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:42.064190    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:42.087663 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.087638    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:42.097484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.097463    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:42.164397 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:42.164345    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:42.264874 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:42.264828    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:42.369977 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:42.369886    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:42.418237 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.418213    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:42.473850 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:42.473817    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:42.529819 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.529781    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 15:38:42.530325 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.529953    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 15:38:42.530325 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.529979    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 15:38:42.574639 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:42.574605    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-98.ec2.internal\" not found"
Sep 17 15:38:42.590863 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.590817    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 15:33:42 +0000 UTC" deadline="2028-05-01 20:55:51.819752115 +0000 UTC"
Sep 17 15:38:42.590863 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.590857    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14213h17m9.22890058s"
Sep 17 15:38:42.670498 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.670422    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:42.683764 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.683735    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:42.685885 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.685864    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:42.697114 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.697090    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 15:38:42.698313 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.698292    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal"
Sep 17 15:38:42.711964 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.711938    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 15:38:42.791212 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:42.791168    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2394f2888c8dc0f48381d6308cf0747.slice/crio-991330cc29974f4ba03cb8a55787d245d6f15249c33defcabdb7ac357415dde3 WatchSource:0}: Error finding container 991330cc29974f4ba03cb8a55787d245d6f15249c33defcabdb7ac357415dde3: Status 404 returned error can't find the container with id 991330cc29974f4ba03cb8a55787d245d6f15249c33defcabdb7ac357415dde3
Sep 17 15:38:42.796777 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:42.796753    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 15:38:42.802871 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:42.802844    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8faf76819e5b56f67e57f9b2de319c7e.slice/crio-aafacd51f7acf1ebb5f8cad44eaffe55a373c3153f494fb1ef57a006d293fe1b WatchSource:0}: Error finding container aafacd51f7acf1ebb5f8cad44eaffe55a373c3153f494fb1ef57a006d293fe1b: Status 404 returned error can't find the container with id aafacd51f7acf1ebb5f8cad44eaffe55a373c3153f494fb1ef57a006d293fe1b
Sep 17 15:38:43.395468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.395434    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:43.570895 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.570859    2582 apiserver.go:52] "Watching apiserver"
Sep 17 15:38:43.583182 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.583153    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 15:38:43.583775 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.583741    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-tpr4v","kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal","openshift-cluster-node-tuning-operator/tuned-rm4mw","openshift-dns/node-resolver-cpc7l","openshift-image-registry/node-ca-45g96","openshift-multus/multus-additional-cni-plugins-v7p8b","openshift-ovn-kubernetes/ovnkube-node-m7j49","kube-system/global-pull-secret-syncer-gr2d7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal","openshift-multus/multus-jr596","openshift-multus/network-metrics-daemon-z9gzw","openshift-network-diagnostics/network-check-target-hlpnw","openshift-network-operator/iptables-alerter-4lg7p"]
Sep 17 15:38:43.585861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.585838    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 15:38:43.586656 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.586636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.589050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.589013    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:43.589154 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.589125    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:38:43.589234 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.589216    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 15:38:43.589484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.589464    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 15:38:43.589570 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.589549    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 15:38:43.589654 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.589592    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m8hjl\""
Sep 17 15:38:43.589709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.589480    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 15:38:43.589766 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.589719    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 15:38:43.590772 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.590752    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 15:38:43.591384 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.591358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.593902 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.593880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.594597 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.594387    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 15:38:43.594597 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.594414    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:38:43.594597 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.594392    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bdc4r\""
Sep 17 15:38:43.596405 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.596351    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-brk72\""
Sep 17 15:38:43.596855 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.596764    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 15:38:43.596855 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.596838    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 15:38:43.597089 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597041    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597089 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f85eac81-76d9-4095-a1d7-10570b3a9910-ovnkube-script-lib\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597224 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-run-netns\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597224 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597138    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f85eac81-76d9-4095-a1d7-10570b3a9910-ovnkube-config\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597224 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-slash\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597224 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-run-systemd\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597224 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-run-openvswitch\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-run-ovn-kubernetes\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597253    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-cni-bin\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf65l\" (UniqueName: \"kubernetes.io/projected/f85eac81-76d9-4095-a1d7-10570b3a9910-kube-api-access-xf65l\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-etc-openvswitch\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597347    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-run-ovn\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597371    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-log-socket\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f85eac81-76d9-4095-a1d7-10570b3a9910-env-overrides\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f85eac81-76d9-4095-a1d7-10570b3a9910-ovn-node-metrics-cert\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-kubelet\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597995 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-systemd-units\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597995 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597551    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-var-lib-openvswitch\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597995 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-node-log\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.597995 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.597620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-cni-netd\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.599370 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.599084    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 15:38:43.599658 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.599616    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 15:38:43.600180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.599859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.600180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.600069    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 15:38:43.600333 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.600228    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-74mqt\""
Sep 17 15:38:43.600985 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.600725    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 15:38:43.604448 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.602303    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.604448 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.602910    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 15:38:43.604448 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.602939    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 15:38:43.604448 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.603166    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 15:38:43.604448 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.603176    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v2ldn\""
Sep 17 15:38:43.604448 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.603409    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 15:38:43.604448 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.603591    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 15:38:43.605519 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.605497    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:38:43.606165 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.606143    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 15:38:43.606253 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.606193    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qt7tp\""
Sep 17 15:38:43.606418 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.606398    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 15:38:43.606483 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.606472    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 15:38:43.608237 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.608216    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lv52q\""
Sep 17 15:38:43.608442 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.608425    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 15:38:43.608799 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.608781    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 15:38:43.610319 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.610293    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.613293 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.613101    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 15:38:43.613468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.613446    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-69wmc\""
Sep 17 15:38:43.613637 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.613617    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:43.613723 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.613682    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 15:38:43.613723 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.613692    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:38:43.613885 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.613862    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:38:43.617283 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.617250    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.620563 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.620118    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 15:38:43.620734 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.620713    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wt2hf\""
Sep 17 15:38:43.620877 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.620860    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:43.621006 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.620957    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:38:43.628251 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.627125    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v7dzg"
Sep 17 15:38:43.634866 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.634843    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v7dzg"
Sep 17 15:38:43.652464 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.652399    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" event={"ID":"c2394f2888c8dc0f48381d6308cf0747","Type":"ContainerStarted","Data":"991330cc29974f4ba03cb8a55787d245d6f15249c33defcabdb7ac357415dde3"}
Sep 17 15:38:43.654923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.654891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" event={"ID":"8faf76819e5b56f67e57f9b2de319c7e","Type":"ContainerStarted","Data":"aafacd51f7acf1ebb5f8cad44eaffe55a373c3153f494fb1ef57a006d293fe1b"}
Sep 17 15:38:43.687534 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.687324    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 15:38:43.698047 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-run-ovn\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698202 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698059    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chpd8\" (UniqueName: \"kubernetes.io/projected/1c2c3550-1ef1-47e3-a106-b211bcb731ec-kube-api-access-chpd8\") pod \"node-ca-45g96\" (UID: \"1c2c3550-1ef1-47e3-a106-b211bcb731ec\") " pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.698202 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77bf9c98-b78e-40a0-b0fe-13ed68e9a31c-tmp-dir\") pod \"node-resolver-cpc7l\" (UID: \"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c\") " pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.698202 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698111    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-run-netns\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.698202 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698125    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-run-ovn\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698202 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a294d88-cd41-499d-af1b-bd0aa0a546d9-tmp\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.698202 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-kubelet\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-node-log\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-cni-netd\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698259    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-kubelet\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-var-lib-cni-bin\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-cni-netd\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-lib-modules\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698361    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-node-log\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c2c3550-1ef1-47e3-a106-b211bcb731ec-serviceca\") pod \"node-ca-45g96\" (UID: \"1c2c3550-1ef1-47e3-a106-b211bcb731ec\") " pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-dbus\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77bf9c98-b78e-40a0-b0fe-13ed68e9a31c-hosts-file\") pod \"node-resolver-cpc7l\" (UID: \"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c\") " pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.698522 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsgw5\" (UniqueName: \"kubernetes.io/projected/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-kube-api-access-zsgw5\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698546    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-socket-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-var-lib-kubelet\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-run-ovn-kubernetes\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf65l\" (UniqueName: \"kubernetes.io/projected/f85eac81-76d9-4095-a1d7-10570b3a9910-kube-api-access-xf65l\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/003573b1-53df-4aaa-af7d-b9a29faa710e-agent-certs\") pod \"konnectivity-agent-tpr4v\" (UID: \"003573b1-53df-4aaa-af7d-b9a29faa710e\") " pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-socket-dir-parent\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-var-lib-cni-multus\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f85eac81-76d9-4095-a1d7-10570b3a9910-ovn-node-metrics-cert\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698904    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-run-k8s-cni-cncf-io\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-modprobe-d\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-var-lib-kubelet\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.698983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-system-cni-dir\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.699307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699039    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-sysctl-d\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggzfv\" (UniqueName: \"kubernetes.io/projected/3e9cbd72-5eac-406e-9742-59abcad1fd00-kube-api-access-ggzfv\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699066    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-run-ovn-kubernetes\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95zht\" (UniqueName: \"kubernetes.io/projected/7f396977-5956-4a96-b783-1b3ad28f9150-kube-api-access-95zht\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/003573b1-53df-4aaa-af7d-b9a29faa710e-konnectivity-ca\") pod \"konnectivity-agent-tpr4v\" (UID: \"003573b1-53df-4aaa-af7d-b9a29faa710e\") " pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-cnibin\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699433    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-sys\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nhnc\" (UniqueName: \"kubernetes.io/projected/4a294d88-cd41-499d-af1b-bd0aa0a546d9-kube-api-access-7nhnc\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-run-systemd\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-cni-bin\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-cnibin\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-etc-openvswitch\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-log-socket\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699736    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f85eac81-76d9-4095-a1d7-10570b3a9910-env-overrides\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-etc-openvswitch\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.700156 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfrxj\" (UniqueName: \"kubernetes.io/projected/77bf9c98-b78e-40a0-b0fe-13ed68e9a31c-kube-api-access-xfrxj\") pod \"node-resolver-cpc7l\" (UID: \"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c\") " pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699822    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-run-systemd\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-device-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699863    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-cni-bin\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699893    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699951    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-log-socket\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.699903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-cni-dir\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-run\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-systemd-units\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-var-lib-openvswitch\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a01a258-e67e-46a0-90e7-48ff65dde4ce-host-slash\") pod \"iptables-alerter-4lg7p\" (UID: \"0a01a258-e67e-46a0-90e7-48ff65dde4ce\") " pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-systemd-units\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700355    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f85eac81-76d9-4095-a1d7-10570b3a9910-env-overrides\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-system-cni-dir\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-etc-kubernetes\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700431    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-var-lib-openvswitch\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701059 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-kubernetes\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-tuned\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-run-netns\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqsdl\" (UniqueName: \"kubernetes.io/projected/0a01a258-e67e-46a0-90e7-48ff65dde4ce-kube-api-access-cqsdl\") pod \"iptables-alerter-4lg7p\" (UID: \"0a01a258-e67e-46a0-90e7-48ff65dde4ce\") " pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700561    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-run-netns\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-daemon-config\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzpnv\" (UniqueName: \"kubernetes.io/projected/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-kube-api-access-zzpnv\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-sysconfig\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-sysctl-conf\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-slash\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700720    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-host-slash\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a01a258-e67e-46a0-90e7-48ff65dde4ce-iptables-alerter-script\") pod \"iptables-alerter-4lg7p\" (UID: \"0a01a258-e67e-46a0-90e7-48ff65dde4ce\") " pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-registration-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-sys-fs\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-systemd\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.701923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f85eac81-76d9-4095-a1d7-10570b3a9910-ovnkube-script-lib\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-kubelet-config\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f85eac81-76d9-4095-a1d7-10570b3a9910-ovnkube-config\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-cni-binary-copy\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-host\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.700988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-run-openvswitch\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.701011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c2c3550-1ef1-47e3-a106-b211bcb731ec-host\") pod \"node-ca-45g96\" (UID: \"1c2c3550-1ef1-47e3-a106-b211bcb731ec\") " pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.701036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.701061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-hostroot\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.701086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-conf-dir\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.701113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-run-multus-certs\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.701714    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f85eac81-76d9-4095-a1d7-10570b3a9910-ovnkube-script-lib\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.701780    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f85eac81-76d9-4095-a1d7-10570b3a9910-run-openvswitch\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.702809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.702748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f85eac81-76d9-4095-a1d7-10570b3a9910-ovnkube-config\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.706147 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.706121    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f85eac81-76d9-4095-a1d7-10570b3a9910-ovn-node-metrics-cert\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.710425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.710401    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf65l\" (UniqueName: \"kubernetes.io/projected/f85eac81-76d9-4095-a1d7-10570b3a9910-kube-api-access-xf65l\") pod \"ovnkube-node-m7j49\" (UID: \"f85eac81-76d9-4095-a1d7-10570b3a9910\") " pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.801559 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-var-lib-cni-bin\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.801559 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-lib-modules\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c2c3550-1ef1-47e3-a106-b211bcb731ec-serviceca\") pod \"node-ca-45g96\" (UID: \"1c2c3550-1ef1-47e3-a106-b211bcb731ec\") " pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-dbus\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77bf9c98-b78e-40a0-b0fe-13ed68e9a31c-hosts-file\") pod \"node-resolver-cpc7l\" (UID: \"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c\") " pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsgw5\" (UniqueName: \"kubernetes.io/projected/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-kube-api-access-zsgw5\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-socket-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-var-lib-kubelet\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801733    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/003573b1-53df-4aaa-af7d-b9a29faa710e-agent-certs\") pod \"konnectivity-agent-tpr4v\" (UID: \"003573b1-53df-4aaa-af7d-b9a29faa710e\") " pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-socket-dir-parent\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-var-lib-cni-multus\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.801882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801872    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-run-k8s-cni-cncf-io\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-modprobe-d\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-var-lib-kubelet\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.801993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-system-cni-dir\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-sysctl-d\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802081    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggzfv\" (UniqueName: \"kubernetes.io/projected/3e9cbd72-5eac-406e-9742-59abcad1fd00-kube-api-access-ggzfv\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95zht\" (UniqueName: \"kubernetes.io/projected/7f396977-5956-4a96-b783-1b3ad28f9150-kube-api-access-95zht\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802164    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/003573b1-53df-4aaa-af7d-b9a29faa710e-konnectivity-ca\") pod \"konnectivity-agent-tpr4v\" (UID: \"003573b1-53df-4aaa-af7d-b9a29faa710e\") " pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-cnibin\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-sys\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802249    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhnc\" (UniqueName: \"kubernetes.io/projected/4a294d88-cd41-499d-af1b-bd0aa0a546d9-kube-api-access-7nhnc\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-cnibin\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfrxj\" (UniqueName: \"kubernetes.io/projected/77bf9c98-b78e-40a0-b0fe-13ed68e9a31c-kube-api-access-xfrxj\") pod \"node-resolver-cpc7l\" (UID: \"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c\") " pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-device-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.802516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-cni-dir\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-run\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a01a258-e67e-46a0-90e7-48ff65dde4ce-host-slash\") pod \"iptables-alerter-4lg7p\" (UID: \"0a01a258-e67e-46a0-90e7-48ff65dde4ce\") " pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-system-cni-dir\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-etc-kubernetes\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-kubernetes\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802640    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-tuned\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqsdl\" (UniqueName: \"kubernetes.io/projected/0a01a258-e67e-46a0-90e7-48ff65dde4ce-kube-api-access-cqsdl\") pod \"iptables-alerter-4lg7p\" (UID: \"0a01a258-e67e-46a0-90e7-48ff65dde4ce\") " pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-daemon-config\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzpnv\" (UniqueName: \"kubernetes.io/projected/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-kube-api-access-zzpnv\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-sysconfig\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-sysctl-conf\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a01a258-e67e-46a0-90e7-48ff65dde4ce-iptables-alerter-script\") pod \"iptables-alerter-4lg7p\" (UID: \"0a01a258-e67e-46a0-90e7-48ff65dde4ce\") " pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-registration-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-sys-fs\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.803425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802972    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-systemd\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.802998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-kubelet-config\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-cni-binary-copy\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-host\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c2c3550-1ef1-47e3-a106-b211bcb731ec-host\") pod \"node-ca-45g96\" (UID: \"1c2c3550-1ef1-47e3-a106-b211bcb731ec\") " pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-hostroot\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-conf-dir\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-run-multus-certs\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803271    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chpd8\" (UniqueName: \"kubernetes.io/projected/1c2c3550-1ef1-47e3-a106-b211bcb731ec-kube-api-access-chpd8\") pod \"node-ca-45g96\" (UID: \"1c2c3550-1ef1-47e3-a106-b211bcb731ec\") " pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77bf9c98-b78e-40a0-b0fe-13ed68e9a31c-tmp-dir\") pod \"node-resolver-cpc7l\" (UID: \"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c\") " pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-run-netns\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a294d88-cd41-499d-af1b-bd0aa0a546d9-tmp\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.803984    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-device-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.804066    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-var-lib-cni-bin\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.804303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.804185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-lib-modules\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.805093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.804673    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c2c3550-1ef1-47e3-a106-b211bcb731ec-serviceca\") pod \"node-ca-45g96\" (UID: \"1c2c3550-1ef1-47e3-a106-b211bcb731ec\") " pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.805093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.804825    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-dbus\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:43.805093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.804882    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77bf9c98-b78e-40a0-b0fe-13ed68e9a31c-hosts-file\") pod \"node-resolver-cpc7l\" (UID: \"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c\") " pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.805265 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.805238    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-socket-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.805327 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.805303    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-var-lib-kubelet\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.805748 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.805716    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.806244 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.806200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-sysctl-d\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.806340 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.806279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-socket-dir-parent\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.806401 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.806333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-cnibin\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.806401 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.806388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-run-k8s-cni-cncf-io\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.806538 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.806457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-modprobe-d\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.806538 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.806518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-var-lib-kubelet\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.806658 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.806602    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-system-cni-dir\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.806709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.806657    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.807861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.807342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.807861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.807484    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c2c3550-1ef1-47e3-a106-b211bcb731ec-host\") pod \"node-ca-45g96\" (UID: \"1c2c3550-1ef1-47e3-a106-b211bcb731ec\") " pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.807861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.807523    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/003573b1-53df-4aaa-af7d-b9a29faa710e-konnectivity-ca\") pod \"konnectivity-agent-tpr4v\" (UID: \"003573b1-53df-4aaa-af7d-b9a29faa710e\") " pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:38:43.807861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.807549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-registration-dir\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.807861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.806335    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-var-lib-cni-multus\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.807861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.807645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-sys-fs\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.807861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.807694    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-systemd\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.807861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.807765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-kubelet-config\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.808598    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.808702    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret podName:c3d650b9-e1ae-4f43-9f9e-47febc1e2384 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:44.308669453 +0000 UTC m=+3.090356792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret") pod "global-pull-secret-syncer-gr2d7" (UID: "c3d650b9-e1ae-4f43-9f9e-47febc1e2384") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.808698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-sys\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.808897    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a01a258-e67e-46a0-90e7-48ff65dde4ce-iptables-alerter-script\") pod \"iptables-alerter-4lg7p\" (UID: \"0a01a258-e67e-46a0-90e7-48ff65dde4ce\") " pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.809471    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-daemon-config\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.809482    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.809815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-cni-binary-copy\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.809833    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-cnibin\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.809922    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a01a258-e67e-46a0-90e7-48ff65dde4ce-host-slash\") pod \"iptables-alerter-4lg7p\" (UID: \"0a01a258-e67e-46a0-90e7-48ff65dde4ce\") " pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.809975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-host\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810116    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-cni-dir\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-sysconfig\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810227    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-system-cni-dir\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810290    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-run\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810331    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-sysctl-conf\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810351    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-run-multus-certs\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-hostroot\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.812832 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810458    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7f396977-5956-4a96-b783-1b3ad28f9150-etc-selinux\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-kubernetes\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-multus-conf-dir\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.810679    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.810740    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs podName:3e9cbd72-5eac-406e-9742-59abcad1fd00 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:44.310720969 +0000 UTC m=+3.092408289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs") pod "network-metrics-daemon-z9gzw" (UID: "3e9cbd72-5eac-406e-9742-59abcad1fd00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810789    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77bf9c98-b78e-40a0-b0fe-13ed68e9a31c-tmp-dir\") pod \"node-resolver-cpc7l\" (UID: \"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c\") " pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.810967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a294d88-cd41-499d-af1b-bd0aa0a546d9-tmp\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.811033    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-etc-kubernetes\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.811316    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-host-run-netns\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.811346    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/003573b1-53df-4aaa-af7d-b9a29faa710e-agent-certs\") pod \"konnectivity-agent-tpr4v\" (UID: \"003573b1-53df-4aaa-af7d-b9a29faa710e\") " pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.813044    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.813070    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.813085    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2vj26 for pod openshift-network-diagnostics/network-check-target-hlpnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:43.813871 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:43.813221    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26 podName:fc77d824-d1cc-4e6b-8d7a-63fd80151cbc nodeName:}" failed. No retries permitted until 2026-09-17 15:38:44.31320273 +0000 UTC m=+3.094890065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj26" (UniqueName: "kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26") pod "network-check-target-hlpnw" (UID: "fc77d824-d1cc-4e6b-8d7a-63fd80151cbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:43.819009 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.818746    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsgw5\" (UniqueName: \"kubernetes.io/projected/c0b5d87a-b617-46d3-919a-3b2a250c4cb4-kube-api-access-zsgw5\") pod \"multus-additional-cni-plugins-v7p8b\" (UID: \"c0b5d87a-b617-46d3-919a-3b2a250c4cb4\") " pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.825448 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.825388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95zht\" (UniqueName: \"kubernetes.io/projected/7f396977-5956-4a96-b783-1b3ad28f9150-kube-api-access-95zht\") pod \"aws-ebs-csi-driver-node-m5jmd\" (UID: \"7f396977-5956-4a96-b783-1b3ad28f9150\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.826118 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.826047    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhnc\" (UniqueName: \"kubernetes.io/projected/4a294d88-cd41-499d-af1b-bd0aa0a546d9-kube-api-access-7nhnc\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.826118 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.826109    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzpnv\" (UniqueName: \"kubernetes.io/projected/af9136a0-bd8b-43ae-b3d7-dd2138aeb348-kube-api-access-zzpnv\") pod \"multus-jr596\" (UID: \"af9136a0-bd8b-43ae-b3d7-dd2138aeb348\") " pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.826730 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.826705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a294d88-cd41-499d-af1b-bd0aa0a546d9-etc-tuned\") pod \"tuned-rm4mw\" (UID: \"4a294d88-cd41-499d-af1b-bd0aa0a546d9\") " pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.827341 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.827269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggzfv\" (UniqueName: \"kubernetes.io/projected/3e9cbd72-5eac-406e-9742-59abcad1fd00-kube-api-access-ggzfv\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:43.827341 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.827297    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chpd8\" (UniqueName: \"kubernetes.io/projected/1c2c3550-1ef1-47e3-a106-b211bcb731ec-kube-api-access-chpd8\") pod \"node-ca-45g96\" (UID: \"1c2c3550-1ef1-47e3-a106-b211bcb731ec\") " pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.828006 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.827984    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqsdl\" (UniqueName: \"kubernetes.io/projected/0a01a258-e67e-46a0-90e7-48ff65dde4ce-kube-api-access-cqsdl\") pod \"iptables-alerter-4lg7p\" (UID: \"0a01a258-e67e-46a0-90e7-48ff65dde4ce\") " pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.829404 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.829257    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfrxj\" (UniqueName: \"kubernetes.io/projected/77bf9c98-b78e-40a0-b0fe-13ed68e9a31c-kube-api-access-xfrxj\") pod \"node-resolver-cpc7l\" (UID: \"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c\") " pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.902288 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.902146    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:38:43.909857 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.909827    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rm4mw"
Sep 17 15:38:43.918823 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:43.918768    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85eac81_76d9_4095_a1d7_10570b3a9910.slice/crio-8a5ba4916b048949d5845b0e3883df25937278b3e193f0139d4ec9ff3a59df57 WatchSource:0}: Error finding container 8a5ba4916b048949d5845b0e3883df25937278b3e193f0139d4ec9ff3a59df57: Status 404 returned error can't find the container with id 8a5ba4916b048949d5845b0e3883df25937278b3e193f0139d4ec9ff3a59df57
Sep 17 15:38:43.923081 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.923006    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cpc7l"
Sep 17 15:38:43.933304 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.933281    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-45g96"
Sep 17 15:38:43.939439 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:43.939409    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bf9c98_b78e_40a0_b0fe_13ed68e9a31c.slice/crio-4f719bf87a7b74ba63a93486b4a80895d78936d81ff4d199ea488d8b5244fc01 WatchSource:0}: Error finding container 4f719bf87a7b74ba63a93486b4a80895d78936d81ff4d199ea488d8b5244fc01: Status 404 returned error can't find the container with id 4f719bf87a7b74ba63a93486b4a80895d78936d81ff4d199ea488d8b5244fc01
Sep 17 15:38:43.944770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.944745    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v7p8b"
Sep 17 15:38:43.947927 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:43.947890    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2c3550_1ef1_47e3_a106_b211bcb731ec.slice/crio-a30b4b337f344ce58b4eae2c0aaf334d85348cc8a396ab795eaa4ee0b52767ab WatchSource:0}: Error finding container a30b4b337f344ce58b4eae2c0aaf334d85348cc8a396ab795eaa4ee0b52767ab: Status 404 returned error can't find the container with id a30b4b337f344ce58b4eae2c0aaf334d85348cc8a396ab795eaa4ee0b52767ab
Sep 17 15:38:43.952008 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.951986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd"
Sep 17 15:38:43.962043 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.962014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:38:43.965217 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:43.965186    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b5d87a_b617_46d3_919a_3b2a250c4cb4.slice/crio-f80cb29fb76608ed105210827481569824b5cf94fcb4e7ca78910cb6720642f5 WatchSource:0}: Error finding container f80cb29fb76608ed105210827481569824b5cf94fcb4e7ca78910cb6720642f5: Status 404 returned error can't find the container with id f80cb29fb76608ed105210827481569824b5cf94fcb4e7ca78910cb6720642f5
Sep 17 15:38:43.966380 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:43.966349    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f396977_5956_4a96_b783_1b3ad28f9150.slice/crio-dc1c600544d9e8decb43e9fc6abc2dc45b324897f5c8c1bf195f64ee4d457baa WatchSource:0}: Error finding container dc1c600544d9e8decb43e9fc6abc2dc45b324897f5c8c1bf195f64ee4d457baa: Status 404 returned error can't find the container with id dc1c600544d9e8decb43e9fc6abc2dc45b324897f5c8c1bf195f64ee4d457baa
Sep 17 15:38:43.970220 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.970183    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4lg7p"
Sep 17 15:38:43.974724 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:43.974691    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003573b1_53df_4aaa_af7d_b9a29faa710e.slice/crio-7a404e521fc2aa46ccc1567d437383f57c85c64e649ce534d2c8c34c4e8bf0da WatchSource:0}: Error finding container 7a404e521fc2aa46ccc1567d437383f57c85c64e649ce534d2c8c34c4e8bf0da: Status 404 returned error can't find the container with id 7a404e521fc2aa46ccc1567d437383f57c85c64e649ce534d2c8c34c4e8bf0da
Sep 17 15:38:43.977345 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:43.977108    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jr596"
Sep 17 15:38:43.983319 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:43.983292    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a01a258_e67e_46a0_90e7_48ff65dde4ce.slice/crio-5f8bbf1b673c774b9c67ca50243f49f21c31742ff754f7988c5f9bebf4ef64e1 WatchSource:0}: Error finding container 5f8bbf1b673c774b9c67ca50243f49f21c31742ff754f7988c5f9bebf4ef64e1: Status 404 returned error can't find the container with id 5f8bbf1b673c774b9c67ca50243f49f21c31742ff754f7988c5f9bebf4ef64e1
Sep 17 15:38:43.990661 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:38:43.990625    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9136a0_bd8b_43ae_b3d7_dd2138aeb348.slice/crio-871d7928b60b409c28fec1c6cae950cdb79f8cf8e8166816f6d5332addda1ab2 WatchSource:0}: Error finding container 871d7928b60b409c28fec1c6cae950cdb79f8cf8e8166816f6d5332addda1ab2: Status 404 returned error can't find the container with id 871d7928b60b409c28fec1c6cae950cdb79f8cf8e8166816f6d5332addda1ab2
Sep 17 15:38:44.407840 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.407802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:44.408031 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.407861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:44.408031 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.407909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:44.408146 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:44.408036    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:44.408146 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:44.408066    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:44.408146 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:44.408087    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:44.408146 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:44.408101    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2vj26 for pod openshift-network-diagnostics/network-check-target-hlpnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:44.408146 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:44.408119    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs podName:3e9cbd72-5eac-406e-9742-59abcad1fd00 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:45.408097586 +0000 UTC m=+4.189784918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs") pod "network-metrics-daemon-z9gzw" (UID: "3e9cbd72-5eac-406e-9742-59abcad1fd00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:44.408146 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:44.408036    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:44.408381 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:44.408155    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26 podName:fc77d824-d1cc-4e6b-8d7a-63fd80151cbc nodeName:}" failed. No retries permitted until 2026-09-17 15:38:45.408138127 +0000 UTC m=+4.189825465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj26" (UniqueName: "kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26") pod "network-check-target-hlpnw" (UID: "fc77d824-d1cc-4e6b-8d7a-63fd80151cbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:44.408381 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:44.408201    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret podName:c3d650b9-e1ae-4f43-9f9e-47febc1e2384 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:45.408182966 +0000 UTC m=+4.189870299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret") pod "global-pull-secret-syncer-gr2d7" (UID: "c3d650b9-e1ae-4f43-9f9e-47febc1e2384") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:44.638620 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.638573    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 15:33:44 +0000 UTC" deadline="2028-06-16 18:04:57.87939649 +0000 UTC"
Sep 17 15:38:44.638620 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.638618    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15314h26m13.240786393s"
Sep 17 15:38:44.659460 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.659351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tpr4v" event={"ID":"003573b1-53df-4aaa-af7d-b9a29faa710e","Type":"ContainerStarted","Data":"7a404e521fc2aa46ccc1567d437383f57c85c64e649ce534d2c8c34c4e8bf0da"}
Sep 17 15:38:44.661087 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.661021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd" event={"ID":"7f396977-5956-4a96-b783-1b3ad28f9150","Type":"ContainerStarted","Data":"dc1c600544d9e8decb43e9fc6abc2dc45b324897f5c8c1bf195f64ee4d457baa"}
Sep 17 15:38:44.664039 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.663971    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cpc7l" event={"ID":"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c","Type":"ContainerStarted","Data":"4f719bf87a7b74ba63a93486b4a80895d78936d81ff4d199ea488d8b5244fc01"}
Sep 17 15:38:44.665740 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.665640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" event={"ID":"f85eac81-76d9-4095-a1d7-10570b3a9910","Type":"ContainerStarted","Data":"8a5ba4916b048949d5845b0e3883df25937278b3e193f0139d4ec9ff3a59df57"}
Sep 17 15:38:44.667759 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.667696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4lg7p" event={"ID":"0a01a258-e67e-46a0-90e7-48ff65dde4ce","Type":"ContainerStarted","Data":"5f8bbf1b673c774b9c67ca50243f49f21c31742ff754f7988c5f9bebf4ef64e1"}
Sep 17 15:38:44.669627 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.669549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7p8b" event={"ID":"c0b5d87a-b617-46d3-919a-3b2a250c4cb4","Type":"ContainerStarted","Data":"f80cb29fb76608ed105210827481569824b5cf94fcb4e7ca78910cb6720642f5"}
Sep 17 15:38:44.671547 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.671471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-45g96" event={"ID":"1c2c3550-1ef1-47e3-a106-b211bcb731ec","Type":"ContainerStarted","Data":"a30b4b337f344ce58b4eae2c0aaf334d85348cc8a396ab795eaa4ee0b52767ab"}
Sep 17 15:38:44.673366 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.673339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rm4mw" event={"ID":"4a294d88-cd41-499d-af1b-bd0aa0a546d9","Type":"ContainerStarted","Data":"1ed316b962638e455ec79b17713b09f4d523ed9ebc1f9b052dc5741a207d2d62"}
Sep 17 15:38:44.675250 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.675224    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jr596" event={"ID":"af9136a0-bd8b-43ae-b3d7-dd2138aeb348","Type":"ContainerStarted","Data":"871d7928b60b409c28fec1c6cae950cdb79f8cf8e8166816f6d5332addda1ab2"}
Sep 17 15:38:44.961679 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:44.961368    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:45.419154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:45.419229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:45.419305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.419433    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.419497    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret podName:c3d650b9-e1ae-4f43-9f9e-47febc1e2384 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:47.419478022 +0000 UTC m=+6.201165356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret") pod "global-pull-secret-syncer-gr2d7" (UID: "c3d650b9-e1ae-4f43-9f9e-47febc1e2384") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.419944    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.419998    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs podName:3e9cbd72-5eac-406e-9742-59abcad1fd00 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:47.41998113 +0000 UTC m=+6.201668462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs") pod "network-metrics-daemon-z9gzw" (UID: "3e9cbd72-5eac-406e-9742-59abcad1fd00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.420084    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.420099    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.420115    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2vj26 for pod openshift-network-diagnostics/network-check-target-hlpnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:45.420277 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.420170    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26 podName:fc77d824-d1cc-4e6b-8d7a-63fd80151cbc nodeName:}" failed. No retries permitted until 2026-09-17 15:38:47.420155932 +0000 UTC m=+6.201843264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj26" (UniqueName: "kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26") pod "network-check-target-hlpnw" (UID: "fc77d824-d1cc-4e6b-8d7a-63fd80151cbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:45.639812 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:45.639691    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 15:33:44 +0000 UTC" deadline="2028-02-23 18:49:57.954683865 +0000 UTC"
Sep 17 15:38:45.639812 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:45.639742    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12579h11m12.314946543s"
Sep 17 15:38:45.648785 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:45.647862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:45.648785 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.647982    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:38:45.648785 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:45.648403    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:45.648785 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.648509    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:38:45.648785 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:45.648610    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:45.648785 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:45.648699    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:38:46.724670 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:46.723608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" event={"ID":"c2394f2888c8dc0f48381d6308cf0747","Type":"ContainerStarted","Data":"e9f760d97b4d46fb106260df0f43a59449a860be094d68ac802ca274507f0f84"}
Sep 17 15:38:47.440684 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:47.440637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:47.440905 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:47.440703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:47.440905 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:47.440744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:47.441025 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.440913    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:47.441025 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.440934    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:47.441025 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.440948    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2vj26 for pod openshift-network-diagnostics/network-check-target-hlpnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:47.441025 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.441014    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26 podName:fc77d824-d1cc-4e6b-8d7a-63fd80151cbc nodeName:}" failed. No retries permitted until 2026-09-17 15:38:51.440992914 +0000 UTC m=+10.222680256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj26" (UniqueName: "kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26") pod "network-check-target-hlpnw" (UID: "fc77d824-d1cc-4e6b-8d7a-63fd80151cbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:47.441465 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.441447    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:47.441546 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.441502    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret podName:c3d650b9-e1ae-4f43-9f9e-47febc1e2384 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:51.441486657 +0000 UTC m=+10.223173978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret") pod "global-pull-secret-syncer-gr2d7" (UID: "c3d650b9-e1ae-4f43-9f9e-47febc1e2384") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:47.441638 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.441573    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:47.441638 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.441629    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs podName:3e9cbd72-5eac-406e-9742-59abcad1fd00 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:51.441616011 +0000 UTC m=+10.223303333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs") pod "network-metrics-daemon-z9gzw" (UID: "3e9cbd72-5eac-406e-9742-59abcad1fd00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:47.648370 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:47.648334    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:47.648594 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.648470    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:38:47.648903 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:47.648883    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:47.649027 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.648992    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:38:47.649110 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:47.649069    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:47.649203 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:47.649164    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:38:47.729066 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:47.728547    2582 generic.go:356] "Generic (PLEG): container finished" podID="8faf76819e5b56f67e57f9b2de319c7e" containerID="c740ccbfee1443c7d2c22b3d5a00adb1f9ac8552f2fbe55255b5b6a89a4aa845" exitCode=0
Sep 17 15:38:47.729595 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:47.729548    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" event={"ID":"8faf76819e5b56f67e57f9b2de319c7e","Type":"ContainerDied","Data":"c740ccbfee1443c7d2c22b3d5a00adb1f9ac8552f2fbe55255b5b6a89a4aa845"}
Sep 17 15:38:47.750353 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:47.749101    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-98.ec2.internal" podStartSLOduration=4.749077499 podStartE2EDuration="4.749077499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:38:46.743799404 +0000 UTC m=+5.525486744" watchObservedRunningTime="2026-09-17 15:38:47.749077499 +0000 UTC m=+6.530764842"
Sep 17 15:38:49.646664 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:49.646457    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:49.646664 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:49.646612    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:49.646664 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:49.646616    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:38:49.647414 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:49.646696    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:38:49.647414 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:49.647107    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:49.647414 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:49.647220    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:38:51.478570 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:51.478500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:51.479066 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:51.478581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:51.479066 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:51.478624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:51.479066 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.478816    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:51.479066 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.478840    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:51.479066 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.478854    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2vj26 for pod openshift-network-diagnostics/network-check-target-hlpnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:51.479066 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.478917    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26 podName:fc77d824-d1cc-4e6b-8d7a-63fd80151cbc nodeName:}" failed. No retries permitted until 2026-09-17 15:38:59.478897451 +0000 UTC m=+18.260584784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj26" (UniqueName: "kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26") pod "network-check-target-hlpnw" (UID: "fc77d824-d1cc-4e6b-8d7a-63fd80151cbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:51.479066 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.478989    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:51.479066 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.479024    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret podName:c3d650b9-e1ae-4f43-9f9e-47febc1e2384 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:59.479012273 +0000 UTC m=+18.260699597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret") pod "global-pull-secret-syncer-gr2d7" (UID: "c3d650b9-e1ae-4f43-9f9e-47febc1e2384") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:51.479492 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.479083    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:51.479492 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.479116    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs podName:3e9cbd72-5eac-406e-9742-59abcad1fd00 nodeName:}" failed. No retries permitted until 2026-09-17 15:38:59.479104516 +0000 UTC m=+18.260791850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs") pod "network-metrics-daemon-z9gzw" (UID: "3e9cbd72-5eac-406e-9742-59abcad1fd00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:51.646794 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:51.646298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:51.646794 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:51.646411    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:51.646794 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.646425    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:38:51.646794 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.646557    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:38:51.646794 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:51.646617    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:51.646794 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:51.646685    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:38:53.646312 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:53.646275    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:53.646312 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:53.646308    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:53.646852 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:53.646275    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:53.646852 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:53.646421    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:38:53.646852 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:53.646463    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:38:53.646852 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:53.646610    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:38:55.646255 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:55.646221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:55.646742 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:55.646223    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:55.646742 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:55.646345    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:55.646742 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:55.646339    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:38:55.646742 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:55.646441    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:38:55.646742 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:55.646558    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:38:57.646331 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:57.646297    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:57.646331 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:57.646312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:57.646835 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:57.646434    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:38:57.646835 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:57.646460    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:57.646835 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:57.646578    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:38:57.646835 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:57.646639    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:38:59.541474 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:59.541430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:59.541486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:59.541535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.541605    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.541666    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.541679    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.541695    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.541707    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2vj26 for pod openshift-network-diagnostics/network-check-target-hlpnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.541675    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret podName:c3d650b9-e1ae-4f43-9f9e-47febc1e2384 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:15.541658736 +0000 UTC m=+34.323346055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret") pod "global-pull-secret-syncer-gr2d7" (UID: "c3d650b9-e1ae-4f43-9f9e-47febc1e2384") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.541738    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs podName:3e9cbd72-5eac-406e-9742-59abcad1fd00 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:15.541719095 +0000 UTC m=+34.323406414 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs") pod "network-metrics-daemon-z9gzw" (UID: "3e9cbd72-5eac-406e-9742-59abcad1fd00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:38:59.541953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.541754    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26 podName:fc77d824-d1cc-4e6b-8d7a-63fd80151cbc nodeName:}" failed. No retries permitted until 2026-09-17 15:39:15.541744479 +0000 UTC m=+34.323431797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj26" (UniqueName: "kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26") pod "network-check-target-hlpnw" (UID: "fc77d824-d1cc-4e6b-8d7a-63fd80151cbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:38:59.646428 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:59.646314    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:38:59.646428 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:59.646371    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:38:59.646428 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:38:59.646322    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:38:59.646714 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.646448    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:38:59.646714 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.646539    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:38:59.646714 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:38:59.646631    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:39:01.646387 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:01.646360    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:01.646841 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:01.646444    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:39:01.646841 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:01.646535    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:01.646841 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:01.646644    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:39:01.646841 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:01.646692    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:01.647121 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:01.647096    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:39:02.773208 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:02.773130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" event={"ID":"8faf76819e5b56f67e57f9b2de319c7e","Type":"ContainerStarted","Data":"7b907a857b994b1f15aa7e787ba0120b1a1d26cf28c0732a25c7cd398e7e48e3"}
Sep 17 15:39:02.789229 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:02.783742    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tpr4v" event={"ID":"003573b1-53df-4aaa-af7d-b9a29faa710e","Type":"ContainerStarted","Data":"ed262ff534b18b85d10d8ad6c1e88f8a9fe7ccdddfc75a38fa672b2e76ec4db9"}
Sep 17 15:39:02.805300 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:02.804819    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-98.ec2.internal" podStartSLOduration=19.804797698 podStartE2EDuration="19.804797698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:02.80072453 +0000 UTC m=+21.582411867" watchObservedRunningTime="2026-09-17 15:39:02.804797698 +0000 UTC m=+21.586485037"
Sep 17 15:39:03.645883 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.645587    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:03.646051 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.645587    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:03.646051 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:03.645986    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:39:03.646051 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.645626    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:03.646202 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:03.646077    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:39:03.646202 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:03.646117    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:39:03.670214 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.670194    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 15:39:03.787135 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.787101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jr596" event={"ID":"af9136a0-bd8b-43ae-b3d7-dd2138aeb348","Type":"ContainerStarted","Data":"602dc6c37444260040390deefe3cfc2f3d89d8dbb98b6900c36bcb2e84be62da"}
Sep 17 15:39:03.789067 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.789042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd" event={"ID":"7f396977-5956-4a96-b783-1b3ad28f9150","Type":"ContainerStarted","Data":"551e817144d4d579f12b454a02caf78d2104e2ba0b48c4851be64c1c3113dcb0"}
Sep 17 15:39:03.789172 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.789093    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd" event={"ID":"7f396977-5956-4a96-b783-1b3ad28f9150","Type":"ContainerStarted","Data":"21fbe09ceab2f82dbb5d30bb435764cedde76f865b10c3c69b976e9c7d834523"}
Sep 17 15:39:03.790481 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.790457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cpc7l" event={"ID":"77bf9c98-b78e-40a0-b0fe-13ed68e9a31c","Type":"ContainerStarted","Data":"11bdffbaa35aba6c939b88349c4e4b8dc99a90649d722651a6fc0af1a0aa3580"}
Sep 17 15:39:03.793614 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.793591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" event={"ID":"f85eac81-76d9-4095-a1d7-10570b3a9910","Type":"ContainerStarted","Data":"69018c58eaa4d911acee780897104245be76a36b7a62c6fefb14698f251adfb6"}
Sep 17 15:39:03.793762 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.793652    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" event={"ID":"f85eac81-76d9-4095-a1d7-10570b3a9910","Type":"ContainerStarted","Data":"ddc0ca41de910d4a38e96efc3aa78e562191f7d6ca5fa5ed7737cdcc38b3ad32"}
Sep 17 15:39:03.793762 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.793683    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" event={"ID":"f85eac81-76d9-4095-a1d7-10570b3a9910","Type":"ContainerStarted","Data":"fa9727a47683749c70d0f4906fbdf2919742ba4fb8d4d3a836fca50753e34049"}
Sep 17 15:39:03.793762 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.793723    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" event={"ID":"f85eac81-76d9-4095-a1d7-10570b3a9910","Type":"ContainerStarted","Data":"6ef0d2e1068afbf2743ed824ada4804135af45c4147aceb65aab521dad8b24cf"}
Sep 17 15:39:03.793762 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.793753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" event={"ID":"f85eac81-76d9-4095-a1d7-10570b3a9910","Type":"ContainerStarted","Data":"0596881d67157be2e936f1db26735b7d9ff2d9c0d43dc18ae11367de3b97dc65"}
Sep 17 15:39:03.793914 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.793778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" event={"ID":"f85eac81-76d9-4095-a1d7-10570b3a9910","Type":"ContainerStarted","Data":"fbf97fba9308fb9793525bdec82015446418e6320973347a0231405a8daf3bf2"}
Sep 17 15:39:03.794982 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.794963    2582 generic.go:356] "Generic (PLEG): container finished" podID="c0b5d87a-b617-46d3-919a-3b2a250c4cb4" containerID="c410a42ee73777444cf21d334cdd7ecf832bfe20c10bbc232ec409f7c89bde16" exitCode=0
Sep 17 15:39:03.795083 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.795021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7p8b" event={"ID":"c0b5d87a-b617-46d3-919a-3b2a250c4cb4","Type":"ContainerDied","Data":"c410a42ee73777444cf21d334cdd7ecf832bfe20c10bbc232ec409f7c89bde16"}
Sep 17 15:39:03.796474 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.796424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-45g96" event={"ID":"1c2c3550-1ef1-47e3-a106-b211bcb731ec","Type":"ContainerStarted","Data":"d6e16890e7a550210252fa46449b1e7f10783eb478d78646ca157b94bb4ff35d"}
Sep 17 15:39:03.797952 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.797930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rm4mw" event={"ID":"4a294d88-cd41-499d-af1b-bd0aa0a546d9","Type":"ContainerStarted","Data":"31d18ccbeef1ec73d66df4f0838ff27be38fdbc1ebcecc507aded0f7816908c1"}
Sep 17 15:39:03.807685 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.807644    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jr596" podStartSLOduration=3.014476976 podStartE2EDuration="21.807630316s" totalImagesPullingTime="18.79315334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:03.807241187 +0000 UTC m=+22.588928524" watchObservedRunningTime="2026-09-17 15:39:03.807630316 +0000 UTC m=+22.589317653"
Sep 17 15:39:03.807900 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.807868    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tpr4v" podStartSLOduration=7.275504818 podStartE2EDuration="21.807861661s" totalImagesPullingTime="14.532356843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:02.829077068 +0000 UTC m=+21.610764406" watchObservedRunningTime="2026-09-17 15:39:03.807861661 +0000 UTC m=+22.589548998"
Sep 17 15:39:03.826205 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.826103    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rm4mw" podStartSLOduration=3.166874001 podStartE2EDuration="21.826087699s" totalImagesPullingTime="18.659213698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:03.825841768 +0000 UTC m=+22.607529104" watchObservedRunningTime="2026-09-17 15:39:03.826087699 +0000 UTC m=+22.607775033"
Sep 17 15:39:03.842864 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.842813    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-45g96" podStartSLOduration=3.209586498 podStartE2EDuration="21.842797821s" totalImagesPullingTime="18.633211323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:03.842604421 +0000 UTC m=+22.624291758" watchObservedRunningTime="2026-09-17 15:39:03.842797821 +0000 UTC m=+22.624485159"
Sep 17 15:39:03.887273 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:03.887220    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cpc7l" podStartSLOduration=3.259384927 podStartE2EDuration="21.887203504s" totalImagesPullingTime="18.627818577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:03.886719104 +0000 UTC m=+22.668406440" watchObservedRunningTime="2026-09-17 15:39:03.887203504 +0000 UTC m=+22.668890840"
Sep 17 15:39:04.657869 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:04.657760    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T15:39:03.670210108Z","UUID":"6658ae90-cbaf-4a3e-8b13-edac7be6df4a","Handler":null,"Name":"","Endpoint":""}
Sep 17 15:39:04.659460 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:04.659434    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 15:39:04.659685 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:04.659473    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 15:39:04.802076 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:04.801981    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4lg7p" event={"ID":"0a01a258-e67e-46a0-90e7-48ff65dde4ce","Type":"ContainerStarted","Data":"837cd70155bab944a5bc463b6222da22a105d101d35df888db271f537e8e3a73"}
Sep 17 15:39:04.804784 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:04.804746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd" event={"ID":"7f396977-5956-4a96-b783-1b3ad28f9150","Type":"ContainerStarted","Data":"ba373ebd1d591607084533a5bcbeedb7593f2a672c40b81215b4622dc9922338"}
Sep 17 15:39:04.818854 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:04.818799    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4lg7p" podStartSLOduration=8.296095979 podStartE2EDuration="22.81878045s" totalImagesPullingTime="14.522684471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:04.818537565 +0000 UTC m=+23.600224903" watchObservedRunningTime="2026-09-17 15:39:04.81878045 +0000 UTC m=+23.600467788"
Sep 17 15:39:04.836981 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:04.836921    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m5jmd" podStartSLOduration=2.648695311 podStartE2EDuration="22.836897417s" totalImagesPullingTime="20.188202106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:04.836224959 +0000 UTC m=+23.617912287" watchObservedRunningTime="2026-09-17 15:39:04.836897417 +0000 UTC m=+23.618584756"
Sep 17 15:39:04.950904 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:04.950871    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:39:04.951480 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:04.951462    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:39:05.645386 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:05.645358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:05.645589 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:05.645358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:05.645589 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:05.645489    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:39:05.645589 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:05.645358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:05.645589 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:05.645577    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:39:05.645749 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:05.645635    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:39:05.810402 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:05.810357    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" event={"ID":"f85eac81-76d9-4095-a1d7-10570b3a9910","Type":"ContainerStarted","Data":"e708a2ce040a0014fe71b864e7ecd508d8fee4a3f85a1a266a087790a551697a"}
Sep 17 15:39:05.810872 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:05.810851    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:39:05.811417 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:05.811400    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tpr4v"
Sep 17 15:39:07.645950 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:07.645877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:07.645950 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:07.645901    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:07.645950 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:07.645911    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:07.646446 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:07.645986    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:39:07.646446 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:07.646111    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:39:07.646446 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:07.646257    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:39:08.821254 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:08.821174    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" event={"ID":"f85eac81-76d9-4095-a1d7-10570b3a9910","Type":"ContainerStarted","Data":"4f6bad91da5384d349be94104c91f616c68d9371c8341dc5302f4cde34aead37"}
Sep 17 15:39:08.822126 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:08.821413    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:39:08.822126 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:08.821467    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:39:08.823122 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:08.823101    2582 generic.go:356] "Generic (PLEG): container finished" podID="c0b5d87a-b617-46d3-919a-3b2a250c4cb4" containerID="59f0a8af923e70d195a8309bf8ac32baa2403076ab0e1267f7cf728f4186747b" exitCode=0
Sep 17 15:39:08.823214 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:08.823140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7p8b" event={"ID":"c0b5d87a-b617-46d3-919a-3b2a250c4cb4","Type":"ContainerDied","Data":"59f0a8af923e70d195a8309bf8ac32baa2403076ab0e1267f7cf728f4186747b"}
Sep 17 15:39:08.837312 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:08.837289    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:39:08.856561 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:08.856522    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49" podStartSLOduration=8.156899587 podStartE2EDuration="26.856493225s" totalImagesPullingTime="18.699593638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:08.856363224 +0000 UTC m=+27.638050560" watchObservedRunningTime="2026-09-17 15:39:08.856493225 +0000 UTC m=+27.638180575"
Sep 17 15:39:09.649199 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:09.648978    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:09.649344 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:09.648978    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:09.649344 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:09.649304    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:39:09.649344 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:09.648978    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:09.649495 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:09.649371    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:39:09.649495 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:09.649422    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:39:09.828289 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:09.828184    2582 generic.go:356] "Generic (PLEG): container finished" podID="c0b5d87a-b617-46d3-919a-3b2a250c4cb4" containerID="d17e711f89bea26ea1d3d0a9376a127707ff5fd8291017fb98621b5603532a30" exitCode=0
Sep 17 15:39:09.828289 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:09.828267    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7p8b" event={"ID":"c0b5d87a-b617-46d3-919a-3b2a250c4cb4","Type":"ContainerDied","Data":"d17e711f89bea26ea1d3d0a9376a127707ff5fd8291017fb98621b5603532a30"}
Sep 17 15:39:09.828826 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:09.828706    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:39:09.844094 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:09.844071    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:39:10.214815 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:10.214768    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gr2d7"]
Sep 17 15:39:10.214970 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:10.214948    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:10.215088 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:10.215060    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:39:10.218304 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:10.218280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hlpnw"]
Sep 17 15:39:10.218530 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:10.218396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:10.218616 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:10.218533    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:39:10.219561 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:10.219482    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z9gzw"]
Sep 17 15:39:10.219666 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:10.219600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:10.219724 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:10.219704    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:39:10.833068 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:10.832979    2582 generic.go:356] "Generic (PLEG): container finished" podID="c0b5d87a-b617-46d3-919a-3b2a250c4cb4" containerID="ffe782038541002187ed0b6712270c81846710417147521520afd3560a0808f8" exitCode=0
Sep 17 15:39:10.833519 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:10.833062    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7p8b" event={"ID":"c0b5d87a-b617-46d3-919a-3b2a250c4cb4","Type":"ContainerDied","Data":"ffe782038541002187ed0b6712270c81846710417147521520afd3560a0808f8"}
Sep 17 15:39:11.648981 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:11.648908    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:11.648981 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:11.648942    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:11.649213 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:11.649009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:11.649213 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:11.649024    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:39:11.649213 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:11.649107    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:39:11.649413 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:11.649213    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:39:13.645514 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:13.645256    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:13.645965 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:13.645307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:13.645965 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:13.645635    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr2d7" podUID="c3d650b9-e1ae-4f43-9f9e-47febc1e2384"
Sep 17 15:39:13.645965 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:13.645742    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z9gzw" podUID="3e9cbd72-5eac-406e-9742-59abcad1fd00"
Sep 17 15:39:13.645965 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:13.645349    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:13.645965 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:13.645806    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hlpnw" podUID="fc77d824-d1cc-4e6b-8d7a-63fd80151cbc"
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.550103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.550181    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.550185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.550254    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs podName:3e9cbd72-5eac-406e-9742-59abcad1fd00 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:47.550234966 +0000 UTC m=+66.331922298 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs") pod "network-metrics-daemon-z9gzw" (UID: "3e9cbd72-5eac-406e-9742-59abcad1fd00") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.550291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.550330    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.550344    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.550357    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2vj26 for pod openshift-network-diagnostics/network-check-target-hlpnw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.550436    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.550546    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret podName:c3d650b9-e1ae-4f43-9f9e-47febc1e2384 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:47.550517902 +0000 UTC m=+66.332205230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret") pod "global-pull-secret-syncer-gr2d7" (UID: "c3d650b9-e1ae-4f43-9f9e-47febc1e2384") : object "kube-system"/"original-pull-secret" not registered
Sep 17 15:39:15.552462 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.550693    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26 podName:fc77d824-d1cc-4e6b-8d7a-63fd80151cbc nodeName:}" failed. No retries permitted until 2026-09-17 15:39:47.550679881 +0000 UTC m=+66.332367209 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vj26" (UniqueName: "kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26") pod "network-check-target-hlpnw" (UID: "fc77d824-d1cc-4e6b-8d7a-63fd80151cbc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 15:39:15.567033 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.567011    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-98.ec2.internal" event="NodeReady"
Sep 17 15:39:15.567134 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.567113    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 15:39:15.614636 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.614603    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j8lsq"]
Sep 17 15:39:15.632688 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.632657    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6j8lj"]
Sep 17 15:39:15.632837 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.632765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.635773 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.635755    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9xnvp\""
Sep 17 15:39:15.636008 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.635979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 15:39:15.636113 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.636081    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 15:39:15.650969 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.650947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6j8lj"
Sep 17 15:39:15.654310 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.654291    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8lsq"]
Sep 17 15:39:15.654425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.654320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6j8lj"]
Sep 17 15:39:15.654425 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.654418    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:15.654581 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.654457    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:15.654581 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.654462    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 15:39:15.654581 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.654565    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lggbn\""
Sep 17 15:39:15.654737 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.654604    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 15:39:15.654737 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.654621    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:15.654846 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.654833    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 15:39:15.657105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.657040    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 15:39:15.657400 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.657282    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xkd6d\""
Sep 17 15:39:15.657400 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.657314    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 15:39:15.657551 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.657425    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 15:39:15.658103 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.658084    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 15:39:15.658193 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.658165    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5497\""
Sep 17 15:39:15.751979 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.751884    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-config-volume\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.751979 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.751944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d6b81c3-e9ce-4806-be6a-4baed8d7b876-cert\") pod \"ingress-canary-6j8lj\" (UID: \"4d6b81c3-e9ce-4806-be6a-4baed8d7b876\") " pod="openshift-ingress-canary/ingress-canary-6j8lj"
Sep 17 15:39:15.752209 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.752040    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.752209 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.752078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb5ww\" (UniqueName: \"kubernetes.io/projected/4d6b81c3-e9ce-4806-be6a-4baed8d7b876-kube-api-access-cb5ww\") pod \"ingress-canary-6j8lj\" (UID: \"4d6b81c3-e9ce-4806-be6a-4baed8d7b876\") " pod="openshift-ingress-canary/ingress-canary-6j8lj"
Sep 17 15:39:15.752209 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.752119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-tmp-dir\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.752209 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.752160    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6668\" (UniqueName: \"kubernetes.io/projected/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-kube-api-access-f6668\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.846773 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.846738    2582 generic.go:356] "Generic (PLEG): container finished" podID="c0b5d87a-b617-46d3-919a-3b2a250c4cb4" containerID="cf4e2e257047f76c4b5c73a5799a42f4001ff6205acc7d56c21b222e5c95fa2f" exitCode=0
Sep 17 15:39:15.846951 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.846786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7p8b" event={"ID":"c0b5d87a-b617-46d3-919a-3b2a250c4cb4","Type":"ContainerDied","Data":"cf4e2e257047f76c4b5c73a5799a42f4001ff6205acc7d56c21b222e5c95fa2f"}
Sep 17 15:39:15.852680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.852658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.852800 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.852689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb5ww\" (UniqueName: \"kubernetes.io/projected/4d6b81c3-e9ce-4806-be6a-4baed8d7b876-kube-api-access-cb5ww\") pod \"ingress-canary-6j8lj\" (UID: \"4d6b81c3-e9ce-4806-be6a-4baed8d7b876\") " pod="openshift-ingress-canary/ingress-canary-6j8lj"
Sep 17 15:39:15.852800 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.852716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-tmp-dir\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.852800 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.852746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6668\" (UniqueName: \"kubernetes.io/projected/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-kube-api-access-f6668\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.852960 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.852796    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:15.852960 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.852820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-config-volume\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.852960 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:15.852857    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls podName:d4f9338a-7afd-40ed-a0f1-9590c3dd9922 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:16.35283787 +0000 UTC m=+35.134525205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls") pod "dns-default-j8lsq" (UID: "d4f9338a-7afd-40ed-a0f1-9590c3dd9922") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:15.852960 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.852889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d6b81c3-e9ce-4806-be6a-4baed8d7b876-cert\") pod \"ingress-canary-6j8lj\" (UID: \"4d6b81c3-e9ce-4806-be6a-4baed8d7b876\") " pod="openshift-ingress-canary/ingress-canary-6j8lj"
Sep 17 15:39:15.853094 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.853024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-tmp-dir\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.853256 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.853240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-config-volume\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.856957 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.856938    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d6b81c3-e9ce-4806-be6a-4baed8d7b876-cert\") pod \"ingress-canary-6j8lj\" (UID: \"4d6b81c3-e9ce-4806-be6a-4baed8d7b876\") " pod="openshift-ingress-canary/ingress-canary-6j8lj"
Sep 17 15:39:15.860820 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.860802    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6668\" (UniqueName: \"kubernetes.io/projected/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-kube-api-access-f6668\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:15.862406 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.862389    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb5ww\" (UniqueName: \"kubernetes.io/projected/4d6b81c3-e9ce-4806-be6a-4baed8d7b876-kube-api-access-cb5ww\") pod \"ingress-canary-6j8lj\" (UID: \"4d6b81c3-e9ce-4806-be6a-4baed8d7b876\") " pod="openshift-ingress-canary/ingress-canary-6j8lj"
Sep 17 15:39:15.960124 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:15.960103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6j8lj"
Sep 17 15:39:16.269171 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:16.269042    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6j8lj"]
Sep 17 15:39:16.272997 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:39:16.272961    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6b81c3_e9ce_4806_be6a_4baed8d7b876.slice/crio-efc33aeae7100f2739aa5c39c192ed0808f38aa317be66076c10aa6e2c8f534f WatchSource:0}: Error finding container efc33aeae7100f2739aa5c39c192ed0808f38aa317be66076c10aa6e2c8f534f: Status 404 returned error can't find the container with id efc33aeae7100f2739aa5c39c192ed0808f38aa317be66076c10aa6e2c8f534f
Sep 17 15:39:16.357371 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:16.357345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:16.357541 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:16.357521    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:16.357617 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:16.357598    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls podName:d4f9338a-7afd-40ed-a0f1-9590c3dd9922 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:17.357577889 +0000 UTC m=+36.139265217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls") pod "dns-default-j8lsq" (UID: "d4f9338a-7afd-40ed-a0f1-9590c3dd9922") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:16.853462 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:16.853416    2582 generic.go:356] "Generic (PLEG): container finished" podID="c0b5d87a-b617-46d3-919a-3b2a250c4cb4" containerID="d7fd68cd44ef42fef02bb1ef0a289f106438dcfadc20db68f898d5f6969b9f42" exitCode=0
Sep 17 15:39:16.854301 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:16.853533    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7p8b" event={"ID":"c0b5d87a-b617-46d3-919a-3b2a250c4cb4","Type":"ContainerDied","Data":"d7fd68cd44ef42fef02bb1ef0a289f106438dcfadc20db68f898d5f6969b9f42"}
Sep 17 15:39:16.854912 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:16.854885    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6j8lj" event={"ID":"4d6b81c3-e9ce-4806-be6a-4baed8d7b876","Type":"ContainerStarted","Data":"efc33aeae7100f2739aa5c39c192ed0808f38aa317be66076c10aa6e2c8f534f"}
Sep 17 15:39:17.365151 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:17.365097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:17.365316 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:17.365237    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:17.365316 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:17.365299    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls podName:d4f9338a-7afd-40ed-a0f1-9590c3dd9922 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:19.365281399 +0000 UTC m=+38.146968735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls") pod "dns-default-j8lsq" (UID: "d4f9338a-7afd-40ed-a0f1-9590c3dd9922") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:17.861997 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:17.861956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7p8b" event={"ID":"c0b5d87a-b617-46d3-919a-3b2a250c4cb4","Type":"ContainerStarted","Data":"00cd1ea594b72c5550bf5cfd15801e4907bb756457ce8af6f22a4a509c02f9a9"}
Sep 17 15:39:17.887364 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:17.887181    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v7p8b" podStartSLOduration=7.269985399 podStartE2EDuration="35.887163355s" totalImagesPullingTime="28.617177956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:17.885480448 +0000 UTC m=+36.667167785" watchObservedRunningTime="2026-09-17 15:39:17.887163355 +0000 UTC m=+36.668850691"
Sep 17 15:39:18.865914 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:18.865881    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6j8lj" event={"ID":"4d6b81c3-e9ce-4806-be6a-4baed8d7b876","Type":"ContainerStarted","Data":"702eb1a7edc377d9b9e0b93ad0dc1a59e8fd7630c38d59032192314689970a95"}
Sep 17 15:39:18.884022 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:18.883968    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6j8lj" podStartSLOduration=1.6054392370000001 podStartE2EDuration="3.883953336s" totalImagesPullingTime="2.278514099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:18.88289564 +0000 UTC m=+37.664582974" watchObservedRunningTime="2026-09-17 15:39:18.883953336 +0000 UTC m=+37.665640672"
Sep 17 15:39:19.378742 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:19.378703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:19.378920 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:19.378874    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:19.378986 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:19.378954    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls podName:d4f9338a-7afd-40ed-a0f1-9590c3dd9922 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:23.378931824 +0000 UTC m=+42.160619156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls") pod "dns-default-j8lsq" (UID: "d4f9338a-7afd-40ed-a0f1-9590c3dd9922") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:23.403612 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:23.403418    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:23.403953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:23.403586    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:23.403953 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:23.403727    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls podName:d4f9338a-7afd-40ed-a0f1-9590c3dd9922 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:31.403713436 +0000 UTC m=+50.185400750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls") pod "dns-default-j8lsq" (UID: "d4f9338a-7afd-40ed-a0f1-9590c3dd9922") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:31.464091 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:31.464050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:31.464628 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:31.464215    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:31.464628 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:31.464299    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls podName:d4f9338a-7afd-40ed-a0f1-9590c3dd9922 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:47.464280755 +0000 UTC m=+66.245968090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls") pod "dns-default-j8lsq" (UID: "d4f9338a-7afd-40ed-a0f1-9590c3dd9922") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:41.846011 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:41.845983    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m7j49"
Sep 17 15:39:47.467222 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.467183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:39:47.467673 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:47.467295    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 15:39:47.467673 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:47.467362    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls podName:d4f9338a-7afd-40ed-a0f1-9590c3dd9922 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:19.467344498 +0000 UTC m=+98.249031813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls") pod "dns-default-j8lsq" (UID: "d4f9338a-7afd-40ed-a0f1-9590c3dd9922") : secret "dns-default-metrics-tls" not found
Sep 17 15:39:47.568041 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.567997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:39:47.568219 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.568063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:47.568219 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.568129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:47.570844 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.570824    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 15:39:47.570906 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.570843    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 15:39:47.570906 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.570824    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 15:39:47.578297 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:47.578272    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 15:39:47.578368 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:47.578344    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs podName:3e9cbd72-5eac-406e-9742-59abcad1fd00 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:51.578327587 +0000 UTC m=+130.360014907 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs") pod "network-metrics-daemon-z9gzw" (UID: "3e9cbd72-5eac-406e-9742-59abcad1fd00") : secret "metrics-daemon-secret" not found
Sep 17 15:39:47.580446 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.580432    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 15:39:47.581900 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.581881    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3d650b9-e1ae-4f43-9f9e-47febc1e2384-original-pull-secret\") pod \"global-pull-secret-syncer-gr2d7\" (UID: \"c3d650b9-e1ae-4f43-9f9e-47febc1e2384\") " pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:47.591049 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.591027    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vj26\" (UniqueName: \"kubernetes.io/projected/fc77d824-d1cc-4e6b-8d7a-63fd80151cbc-kube-api-access-2vj26\") pod \"network-check-target-hlpnw\" (UID: \"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc\") " pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:47.766853 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.766771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr2d7"
Sep 17 15:39:47.779366 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.779343    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xkd6d\""
Sep 17 15:39:47.787638 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:47.787615    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:48.038419 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:48.038343    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gr2d7"]
Sep 17 15:39:48.041574 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:39:48.041550    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d650b9_e1ae_4f43_9f9e_47febc1e2384.slice/crio-505c03d440444e7830748f4ba781b4186cabf539b5d962205fc9e3e2de1dab9a WatchSource:0}: Error finding container 505c03d440444e7830748f4ba781b4186cabf539b5d962205fc9e3e2de1dab9a: Status 404 returned error can't find the container with id 505c03d440444e7830748f4ba781b4186cabf539b5d962205fc9e3e2de1dab9a
Sep 17 15:39:48.064827 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:48.064804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hlpnw"]
Sep 17 15:39:48.067748 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:39:48.067722    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc77d824_d1cc_4e6b_8d7a_63fd80151cbc.slice/crio-a15372bcdccf32c7923d8415333f953876483f92e6fd2c9502c2ad330c1b01fe WatchSource:0}: Error finding container a15372bcdccf32c7923d8415333f953876483f92e6fd2c9502c2ad330c1b01fe: Status 404 returned error can't find the container with id a15372bcdccf32c7923d8415333f953876483f92e6fd2c9502c2ad330c1b01fe
Sep 17 15:39:48.936063 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:48.935990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hlpnw" event={"ID":"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc","Type":"ContainerStarted","Data":"a15372bcdccf32c7923d8415333f953876483f92e6fd2c9502c2ad330c1b01fe"}
Sep 17 15:39:48.937618 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:48.937570    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gr2d7" event={"ID":"c3d650b9-e1ae-4f43-9f9e-47febc1e2384","Type":"ContainerStarted","Data":"505c03d440444e7830748f4ba781b4186cabf539b5d962205fc9e3e2de1dab9a"}
Sep 17 15:39:52.209445 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.209410    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-2wxrd"]
Sep 17 15:39:52.212397 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.212069    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-lcq4t"]
Sep 17 15:39:52.213843 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.213813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.215303 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.215283    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.216541 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.216522    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 15:39:52.218279 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.218250    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 15:39:52.218998 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.218978    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8btdv\""
Sep 17 15:39:52.219105 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:52.219005    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"operator-dockercfg-76tlb\" is forbidden: User \"system:node:ip-10-0-139-98.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-98.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"operator-dockercfg-76tlb\"" type="*v1.Secret"
Sep 17 15:39:52.219105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.218987    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 15:39:52.219105 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.218978    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:39:52.219252 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:52.219168    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-98.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-98.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 17 15:39:52.219252 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:52.219217    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-139-98.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-98.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap"
Sep 17 15:39:52.222432 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:52.222399    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-139-98.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-98.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap"
Sep 17 15:39:52.222717 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:52.222690    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-98.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-98.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 17 15:39:52.222784 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:52.222750    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-insights-serving-cert\" is forbidden: User \"system:node:ip-10-0-139-98.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-98.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret"
Sep 17 15:39:52.230551 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.230530    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 15:39:52.230972 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.230953    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-lcq4t"]
Sep 17 15:39:52.237539 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.237516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-2wxrd"]
Sep 17 15:39:52.299345 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c64be236-027b-4f49-baa0-64c6025619e7-tmp\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.299437 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qgz6\" (UniqueName: \"kubernetes.io/projected/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-kube-api-access-8qgz6\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.299437 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299417    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.299532 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-service-ca-bundle\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.299532 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-config\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.299606 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-serving-cert\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.299606 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c64be236-027b-4f49-baa0-64c6025619e7-snapshots\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.299697 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c64be236-027b-4f49-baa0-64c6025619e7-serving-cert\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.299697 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-trusted-ca\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.299802 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.299708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5v5x\" (UniqueName: \"kubernetes.io/projected/c64be236-027b-4f49-baa0-64c6025619e7-kube-api-access-n5v5x\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.309280 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.309257    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5"]
Sep 17 15:39:52.310934 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.310920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5"
Sep 17 15:39:52.312657 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.312637    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"]
Sep 17 15:39:52.313492 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.313468    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:39:52.313758 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.313738    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 15:39:52.313843 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.313814    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hdk4d\""
Sep 17 15:39:52.314223 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.314208    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.316661 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.316642    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w2hrw\""
Sep 17 15:39:52.317238 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.317221    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 15:39:52.317487 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.317463    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 15:39:52.317763 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.317747    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 15:39:52.323092 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.323071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5"]
Sep 17 15:39:52.324648 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.324627    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 15:39:52.340282 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.340257    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"]
Sep 17 15:39:52.400281 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c64be236-027b-4f49-baa0-64c6025619e7-serving-cert\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.400484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-trusted-ca\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.400484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5v5x\" (UniqueName: \"kubernetes.io/projected/c64be236-027b-4f49-baa0-64c6025619e7-kube-api-access-n5v5x\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.400484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72bbec78-62da-44ce-882f-54dbe98e5d0f-ca-trust-extracted\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.400484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqfnk\" (UniqueName: \"kubernetes.io/projected/05328d82-b3e8-4769-b757-8dd85c904a62-kube-api-access-nqfnk\") pod \"volume-data-source-validator-86695b7cc7-cxtv5\" (UID: \"05328d82-b3e8-4769-b757-8dd85c904a62\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5"
Sep 17 15:39:52.400484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c64be236-027b-4f49-baa0-64c6025619e7-tmp\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.400484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-image-registry-private-configuration\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.400484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-trusted-ca\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.400484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qgz6\" (UniqueName: \"kubernetes.io/projected/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-kube-api-access-8qgz6\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.400820 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-certificates\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.400820 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.400820 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-service-ca-bundle\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.400820 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-config\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.400984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.400723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7zr7\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-kube-api-access-r7zr7\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.401240 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.401219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c64be236-027b-4f49-baa0-64c6025619e7-tmp\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.401850 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.401829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-serving-cert\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.402060 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.402043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c64be236-027b-4f49-baa0-64c6025619e7-snapshots\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.402196 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.402182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.402776 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.402307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-config\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.402776 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.401921    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-trusted-ca\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.402776 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.402350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-installation-pull-secrets\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.402776 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.402454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-bound-sa-token\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.403198 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.403171    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c64be236-027b-4f49-baa0-64c6025619e7-snapshots\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:52.407412 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.405605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-serving-cert\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.410414 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.410393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qgz6\" (UniqueName: \"kubernetes.io/projected/e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22-kube-api-access-8qgz6\") pod \"console-operator-696884fb9c-2wxrd\" (UID: \"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22\") " pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.503204 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-installation-pull-secrets\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.503204 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503165    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-bound-sa-token\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.503204 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72bbec78-62da-44ce-882f-54dbe98e5d0f-ca-trust-extracted\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.503456 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqfnk\" (UniqueName: \"kubernetes.io/projected/05328d82-b3e8-4769-b757-8dd85c904a62-kube-api-access-nqfnk\") pod \"volume-data-source-validator-86695b7cc7-cxtv5\" (UID: \"05328d82-b3e8-4769-b757-8dd85c904a62\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5"
Sep 17 15:39:52.503456 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-image-registry-private-configuration\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.503456 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-trusted-ca\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.503456 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503302    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-certificates\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.503456 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7zr7\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-kube-api-access-r7zr7\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.503456 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.503766 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:52.503458    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:52.503766 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:52.503472    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb5bbb54b-5k7jv: secret "image-registry-tls" not found
Sep 17 15:39:52.503766 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:52.503543    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls podName:72bbec78-62da-44ce-882f-54dbe98e5d0f nodeName:}" failed. No retries permitted until 2026-09-17 15:39:53.00352342 +0000 UTC m=+71.785210748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls") pod "image-registry-5bb5bbb54b-5k7jv" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f") : secret "image-registry-tls" not found
Sep 17 15:39:52.503766 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72bbec78-62da-44ce-882f-54dbe98e5d0f-ca-trust-extracted\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.503987 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.503850    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-certificates\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.504297 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.504273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-trusted-ca\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.505853 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.505830    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-installation-pull-secrets\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.505964 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.505943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-image-registry-private-configuration\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.513050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.513029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-bound-sa-token\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.513266 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.513247    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7zr7\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-kube-api-access-r7zr7\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:52.513333 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.513318    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqfnk\" (UniqueName: \"kubernetes.io/projected/05328d82-b3e8-4769-b757-8dd85c904a62-kube-api-access-nqfnk\") pod \"volume-data-source-validator-86695b7cc7-cxtv5\" (UID: \"05328d82-b3e8-4769-b757-8dd85c904a62\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5"
Sep 17 15:39:52.525535 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.525517    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:39:52.633842 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.633808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5"
Sep 17 15:39:52.799019 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.798933    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-2wxrd"]
Sep 17 15:39:52.816471 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:39:52.816432    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d41a6d_2b76_4fcb_a16d_424b7cfeaf22.slice/crio-3739d327a058c773dbc594d2c8001cd7ef6d30fdc667cffc207af5e7900389de WatchSource:0}: Error finding container 3739d327a058c773dbc594d2c8001cd7ef6d30fdc667cffc207af5e7900389de: Status 404 returned error can't find the container with id 3739d327a058c773dbc594d2c8001cd7ef6d30fdc667cffc207af5e7900389de
Sep 17 15:39:52.904646 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.904605    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5"]
Sep 17 15:39:52.906982 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:39:52.906958    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05328d82_b3e8_4769_b757_8dd85c904a62.slice/crio-496b3faa6c01303a109fd37e5c9c60bf0c31af0a308188dc41d7d77a063fc1e1 WatchSource:0}: Error finding container 496b3faa6c01303a109fd37e5c9c60bf0c31af0a308188dc41d7d77a063fc1e1: Status 404 returned error can't find the container with id 496b3faa6c01303a109fd37e5c9c60bf0c31af0a308188dc41d7d77a063fc1e1
Sep 17 15:39:52.949820 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.949781    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hlpnw" event={"ID":"fc77d824-d1cc-4e6b-8d7a-63fd80151cbc","Type":"ContainerStarted","Data":"bd6370bd9ded2e3f6e8328c322f298b20495bfc075f363420ed29d67a0b25868"}
Sep 17 15:39:52.949979 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.949915    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:39:52.950850 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.950829    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" event={"ID":"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22","Type":"ContainerStarted","Data":"3739d327a058c773dbc594d2c8001cd7ef6d30fdc667cffc207af5e7900389de"}
Sep 17 15:39:52.952186 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.952170    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gr2d7" event={"ID":"c3d650b9-e1ae-4f43-9f9e-47febc1e2384","Type":"ContainerStarted","Data":"bdb4d7ef5be666902ff3d409fe096598b7826382a0ebd3607de422db5fff0dab"}
Sep 17 15:39:52.953362 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.953343    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5" event={"ID":"05328d82-b3e8-4769-b757-8dd85c904a62","Type":"ContainerStarted","Data":"496b3faa6c01303a109fd37e5c9c60bf0c31af0a308188dc41d7d77a063fc1e1"}
Sep 17 15:39:52.969407 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.969369    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hlpnw" podStartSLOduration=66.807743824 podStartE2EDuration="1m10.969356555s" totalImagesPullingTime="4.161612731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:52.968145234 +0000 UTC m=+71.749832570" watchObservedRunningTime="2026-09-17 15:39:52.969356555 +0000 UTC m=+71.751043888"
Sep 17 15:39:52.988860 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:52.988819    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gr2d7" podStartSLOduration=66.787638699 podStartE2EDuration="1m10.988805159s" totalImagesPullingTime="4.20116646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:52.988262816 +0000 UTC m=+71.769950153" watchObservedRunningTime="2026-09-17 15:39:52.988805159 +0000 UTC m=+71.770492493"
Sep 17 15:39:53.007207 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.007179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:53.007340 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:53.007320    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:53.007388 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:53.007340    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb5bbb54b-5k7jv: secret "image-registry-tls" not found
Sep 17 15:39:53.007388 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:53.007385    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls podName:72bbec78-62da-44ce-882f-54dbe98e5d0f nodeName:}" failed. No retries permitted until 2026-09-17 15:39:54.00737267 +0000 UTC m=+72.789060003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls") pod "image-registry-5bb5bbb54b-5k7jv" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f") : secret "image-registry-tls" not found
Sep 17 15:39:53.312381 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.312348    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-76tlb\""
Sep 17 15:39:53.384189 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.384155    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 17 15:39:53.393304 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.393273    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 15:39:53.393456 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.393435    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c64be236-027b-4f49-baa0-64c6025619e7-serving-cert\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:53.401421 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:53.401404    2582 configmap.go:193] Couldn't get configMap openshift-insights/trusted-ca-bundle: failed to sync configmap cache: timed out waiting for the condition
Sep 17 15:39:53.401526 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:53.401482    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-trusted-ca-bundle podName:c64be236-027b-4f49-baa0-64c6025619e7 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:53.901461332 +0000 UTC m=+72.683148665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-trusted-ca-bundle") pod "insights-operator-5844b856db-lcq4t" (UID: "c64be236-027b-4f49-baa0-64c6025619e7") : failed to sync configmap cache: timed out waiting for the condition
Sep 17 15:39:53.402492 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:53.402477    2582 configmap.go:193] Couldn't get configMap openshift-insights/service-ca-bundle: failed to sync configmap cache: timed out waiting for the condition
Sep 17 15:39:53.402567 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:53.402539    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-service-ca-bundle podName:c64be236-027b-4f49-baa0-64c6025619e7 nodeName:}" failed. No retries permitted until 2026-09-17 15:39:53.902527557 +0000 UTC m=+72.684214874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-service-ca-bundle") pod "insights-operator-5844b856db-lcq4t" (UID: "c64be236-027b-4f49-baa0-64c6025619e7") : failed to sync configmap cache: timed out waiting for the condition
Sep 17 15:39:53.534392 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.534356    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 17 15:39:53.670060 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.670022    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 15:39:53.683162 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.683129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5v5x\" (UniqueName: \"kubernetes.io/projected/c64be236-027b-4f49-baa0-64c6025619e7-kube-api-access-n5v5x\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:53.720882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.720851    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 17 15:39:53.915072 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.915033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:53.915267 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.915083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-service-ca-bundle\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:53.915822 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.915793    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-service-ca-bundle\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:53.916124 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:53.916097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c64be236-027b-4f49-baa0-64c6025619e7-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lcq4t\" (UID: \"c64be236-027b-4f49-baa0-64c6025619e7\") " pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:54.016190 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:54.016083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:54.016357 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:54.016238    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:54.016357 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:54.016262    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb5bbb54b-5k7jv: secret "image-registry-tls" not found
Sep 17 15:39:54.016357 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:54.016332    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls podName:72bbec78-62da-44ce-882f-54dbe98e5d0f nodeName:}" failed. No retries permitted until 2026-09-17 15:39:56.016311364 +0000 UTC m=+74.797998693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls") pod "image-registry-5bb5bbb54b-5k7jv" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f") : secret "image-registry-tls" not found
Sep 17 15:39:54.032494 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:54.032450    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-lcq4t"
Sep 17 15:39:54.326889 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:54.326809    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-lcq4t"]
Sep 17 15:39:54.330134 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:39:54.330107    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64be236_027b_4f49_baa0_64c6025619e7.slice/crio-bfa10901749636bb5507819691afe6d991af8bab8e4bae6af81a6c87dcb5f67a WatchSource:0}: Error finding container bfa10901749636bb5507819691afe6d991af8bab8e4bae6af81a6c87dcb5f67a: Status 404 returned error can't find the container with id bfa10901749636bb5507819691afe6d991af8bab8e4bae6af81a6c87dcb5f67a
Sep 17 15:39:54.959542 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:54.959492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lcq4t" event={"ID":"c64be236-027b-4f49-baa0-64c6025619e7","Type":"ContainerStarted","Data":"bfa10901749636bb5507819691afe6d991af8bab8e4bae6af81a6c87dcb5f67a"}
Sep 17 15:39:54.960944 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:54.960919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5" event={"ID":"05328d82-b3e8-4769-b757-8dd85c904a62","Type":"ContainerStarted","Data":"0ce7994cb0cef6747f4e848608277918de05e8190ff062070df52bea2a6ffe83"}
Sep 17 15:39:54.976790 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:54.976745    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-cxtv5" podStartSLOduration=1.7841958180000002 podStartE2EDuration="2.976730547s" totalImagesPullingTime="1.192534729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:54.976119649 +0000 UTC m=+73.757806996" watchObservedRunningTime="2026-09-17 15:39:54.976730547 +0000 UTC m=+73.758417897"
Sep 17 15:39:55.965701 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:55.965673    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/0.log"
Sep 17 15:39:55.966076 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:55.965711    2582 generic.go:356] "Generic (PLEG): container finished" podID="e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22" containerID="f3672831594962e074b8bac353d655399b2ba42c60ba95147e285ffd55ddd7db" exitCode=255
Sep 17 15:39:55.966076 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:55.965744    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" event={"ID":"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22","Type":"ContainerDied","Data":"f3672831594962e074b8bac353d655399b2ba42c60ba95147e285ffd55ddd7db"}
Sep 17 15:39:55.966076 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:55.966006    2582 scope.go:117] "RemoveContainer" containerID="f3672831594962e074b8bac353d655399b2ba42c60ba95147e285ffd55ddd7db"
Sep 17 15:39:56.032981 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:56.032943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:39:56.033161 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:56.033086    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:39:56.033161 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:56.033104    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb5bbb54b-5k7jv: secret "image-registry-tls" not found
Sep 17 15:39:56.033161 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:56.033193    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls podName:72bbec78-62da-44ce-882f-54dbe98e5d0f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:00.033164561 +0000 UTC m=+78.814863071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls") pod "image-registry-5bb5bbb54b-5k7jv" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f") : secret "image-registry-tls" not found
Sep 17 15:39:56.971279 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:56.971245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lcq4t" event={"ID":"c64be236-027b-4f49-baa0-64c6025619e7","Type":"ContainerStarted","Data":"701c5eedcadb01b21c6555a8a8cc52e209124b1d200d6348de89ff1de940268d"}
Sep 17 15:39:56.972861 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:56.972841    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/1.log"
Sep 17 15:39:56.973239 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:56.973226    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/0.log"
Sep 17 15:39:56.973283 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:56.973256    2582 generic.go:356] "Generic (PLEG): container finished" podID="e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22" containerID="5a2fc5417ef99e8635128828998b55777aa3ffaa2cd704bc69f3325c045a72f6" exitCode=255
Sep 17 15:39:56.973327 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:56.973284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" event={"ID":"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22","Type":"ContainerDied","Data":"5a2fc5417ef99e8635128828998b55777aa3ffaa2cd704bc69f3325c045a72f6"}
Sep 17 15:39:56.973327 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:56.973316    2582 scope.go:117] "RemoveContainer" containerID="f3672831594962e074b8bac353d655399b2ba42c60ba95147e285ffd55ddd7db"
Sep 17 15:39:56.973547 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:56.973531    2582 scope.go:117] "RemoveContainer" containerID="5a2fc5417ef99e8635128828998b55777aa3ffaa2cd704bc69f3325c045a72f6"
Sep 17 15:39:56.973717 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:56.973692    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-2wxrd_openshift-console-operator(e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22)\"" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" podUID="e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22"
Sep 17 15:39:56.988205 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:56.988163    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-lcq4t" podStartSLOduration=2.490602458 podStartE2EDuration="4.988148736s" totalImagesPullingTime="2.497546278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:39:56.987568707 +0000 UTC m=+75.769256044" watchObservedRunningTime="2026-09-17 15:39:56.988148736 +0000 UTC m=+75.769836073"
Sep 17 15:39:57.981062 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:57.981036    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/1.log"
Sep 17 15:39:57.981456 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:57.981440    2582 scope.go:117] "RemoveContainer" containerID="5a2fc5417ef99e8635128828998b55777aa3ffaa2cd704bc69f3325c045a72f6"
Sep 17 15:39:57.981610 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:57.981592    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-2wxrd_openshift-console-operator(e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22)\"" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" podUID="e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22"
Sep 17 15:39:58.037855 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.037828    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t"]
Sep 17 15:39:58.042903 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.042877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t"
Sep 17 15:39:58.046080 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.046058    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-p2wfn\""
Sep 17 15:39:58.046198 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.046121    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 15:39:58.046682 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.046663    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 15:39:58.063097 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.063075    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t"]
Sep 17 15:39:58.149435 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.149404    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zk94n"]
Sep 17 15:39:58.150696 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.150673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s6n5\" (UniqueName: \"kubernetes.io/projected/7ef85eaa-1958-42af-8153-0be8c5665da6-kube-api-access-4s6n5\") pod \"migrator-8b4d697c5-6dh8t\" (UID: \"7ef85eaa-1958-42af-8153-0be8c5665da6\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t"
Sep 17 15:39:58.152419 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.152404    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.155050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.155029    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 15:39:58.155141 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.155059    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 15:39:58.155141 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.155107    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8w8t9\""
Sep 17 15:39:58.164292 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.164267    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zk94n"]
Sep 17 15:39:58.251090 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.251004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0c2575e-edf3-4945-95a2-ab07f2cd022f-crio-socket\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.251090 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.251073    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.251272 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.251116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dllml\" (UniqueName: \"kubernetes.io/projected/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-api-access-dllml\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.251272 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.251138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s6n5\" (UniqueName: \"kubernetes.io/projected/7ef85eaa-1958-42af-8153-0be8c5665da6-kube-api-access-4s6n5\") pod \"migrator-8b4d697c5-6dh8t\" (UID: \"7ef85eaa-1958-42af-8153-0be8c5665da6\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t"
Sep 17 15:39:58.251272 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.251187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.251272 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.251223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c2575e-edf3-4945-95a2-ab07f2cd022f-data-volume\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.260056 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.260030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s6n5\" (UniqueName: \"kubernetes.io/projected/7ef85eaa-1958-42af-8153-0be8c5665da6-kube-api-access-4s6n5\") pod \"migrator-8b4d697c5-6dh8t\" (UID: \"7ef85eaa-1958-42af-8153-0be8c5665da6\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t"
Sep 17 15:39:58.352555 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.352487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.352555 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.352557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c2575e-edf3-4945-95a2-ab07f2cd022f-data-volume\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.352799 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.352590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0c2575e-edf3-4945-95a2-ab07f2cd022f-crio-socket\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.352799 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.352635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.352799 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:58.352643    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:39:58.352799 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:58.352708    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:39:58.352799 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:58.352719    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:39:58.852702095 +0000 UTC m=+77.634389414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:39:58.352799 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.352716    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0c2575e-edf3-4945-95a2-ab07f2cd022f-crio-socket\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.352799 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.352734    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t"
Sep 17 15:39:58.352799 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:58.352765    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:39:58.852750421 +0000 UTC m=+77.634437754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : configmap "kube-rbac-proxy" not found
Sep 17 15:39:58.353126 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.352808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dllml\" (UniqueName: \"kubernetes.io/projected/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-api-access-dllml\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.353126 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.352927    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c2575e-edf3-4945-95a2-ab07f2cd022f-data-volume\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.363876 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.363852    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dllml\" (UniqueName: \"kubernetes.io/projected/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-api-access-dllml\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.623904 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.623866    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t"]
Sep 17 15:39:58.627801 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:39:58.627766    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef85eaa_1958_42af_8153_0be8c5665da6.slice/crio-39a5eb789c3c032833e0bede98885862a1bf962248bac6a845df7ac5eb8c1d93 WatchSource:0}: Error finding container 39a5eb789c3c032833e0bede98885862a1bf962248bac6a845df7ac5eb8c1d93: Status 404 returned error can't find the container with id 39a5eb789c3c032833e0bede98885862a1bf962248bac6a845df7ac5eb8c1d93
Sep 17 15:39:58.857040 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.857007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.857233 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.857067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:58.857233 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:58.857141    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:39:58.857233 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:58.857154    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:39:58.857233 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:58.857215    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:39:59.857201459 +0000 UTC m=+78.638888773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:39:58.857233 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:58.857230    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:39:59.857223365 +0000 UTC m=+78.638910692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : configmap "kube-rbac-proxy" not found
Sep 17 15:39:58.985242 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:58.985141    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t" event={"ID":"7ef85eaa-1958-42af-8153-0be8c5665da6","Type":"ContainerStarted","Data":"39a5eb789c3c032833e0bede98885862a1bf962248bac6a845df7ac5eb8c1d93"}
Sep 17 15:39:59.864044 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:59.864010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:59.864193 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:59.864074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:39:59.864193 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:59.864138    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:39:59.864193 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:59.864178    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:39:59.864298 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:59.864211    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:01.86419572 +0000 UTC m=+80.645883050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : configmap "kube-rbac-proxy" not found
Sep 17 15:39:59.864298 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:39:59.864230    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:01.864218631 +0000 UTC m=+80.645905961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:39:59.879723 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:39:59.879696    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cpc7l_77bf9c98-b78e-40a0-b0fe-13ed68e9a31c/dns-node-resolver/0.log"
Sep 17 15:40:00.066043 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:00.066013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:40:00.066389 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:00.066201    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:40:00.066389 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:00.066222    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb5bbb54b-5k7jv: secret "image-registry-tls" not found
Sep 17 15:40:00.066389 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:00.066281    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls podName:72bbec78-62da-44ce-882f-54dbe98e5d0f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:08.066266285 +0000 UTC m=+86.847953599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls") pod "image-registry-5bb5bbb54b-5k7jv" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f") : secret "image-registry-tls" not found
Sep 17 15:40:00.880052 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:00.880014    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-45g96_1c2c3550-1ef1-47e3-a106-b211bcb731ec/node-ca/0.log"
Sep 17 15:40:00.993717 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:00.993681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t" event={"ID":"7ef85eaa-1958-42af-8153-0be8c5665da6","Type":"ContainerStarted","Data":"15d4e27abf2d35aa8394fbbf61d1b25005aa08f365f5a0fb5ea084a00c000381"}
Sep 17 15:40:00.993882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:00.993760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t" event={"ID":"7ef85eaa-1958-42af-8153-0be8c5665da6","Type":"ContainerStarted","Data":"5f7dadee03842202e74dcfb4185ac5f567b4800300edf93e55a6d952ffc44104"}
Sep 17 15:40:01.017922 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:01.017868    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-6dh8t" podStartSLOduration=1.5299541140000001 podStartE2EDuration="3.017853803s" totalImagesPullingTime="1.487899689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:01.016451205 +0000 UTC m=+79.798138540" watchObservedRunningTime="2026-09-17 15:40:01.017853803 +0000 UTC m=+79.799541138"
Sep 17 15:40:01.680545 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:01.680517    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6j8lj_4d6b81c3-e9ce-4806-be6a-4baed8d7b876/serve-healthcheck-canary/0.log"
Sep 17 15:40:01.878997 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:01.878966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:01.879151 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:01.879024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:01.879151 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:01.879097    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:40:01.879151 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:01.879138    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:01.879265 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:01.879164    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:05.879147265 +0000 UTC m=+84.660834585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : configmap "kube-rbac-proxy" not found
Sep 17 15:40:01.879265 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:01.879182    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:05.879170817 +0000 UTC m=+84.660858156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:02.526525 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.526454    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:40:02.526525 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.526538    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:40:02.526897 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.526883    2582 scope.go:117] "RemoveContainer" containerID="5a2fc5417ef99e8635128828998b55777aa3ffaa2cd704bc69f3325c045a72f6"
Sep 17 15:40:02.527050 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:02.527033    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-2wxrd_openshift-console-operator(e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22)\"" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" podUID="e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22"
Sep 17 15:40:02.988421 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.988386    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-f2shq"]
Sep 17 15:40:02.991397 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.991382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:02.996809 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.996783    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xgflk\""
Sep 17 15:40:02.997647 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.997624    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 15:40:02.997759 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.997624    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 15:40:02.997759 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.997742    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 15:40:02.997759 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:02.997743    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 15:40:03.006396 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.006365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-f2shq"]
Sep 17 15:40:03.088044 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.088001    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4n7b\" (UniqueName: \"kubernetes.io/projected/3b1c68ea-1b27-4cd9-953f-a92728169e3c-kube-api-access-c4n7b\") pod \"service-ca-568869fdc5-f2shq\" (UID: \"3b1c68ea-1b27-4cd9-953f-a92728169e3c\") " pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.088215 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.088091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3b1c68ea-1b27-4cd9-953f-a92728169e3c-signing-key\") pod \"service-ca-568869fdc5-f2shq\" (UID: \"3b1c68ea-1b27-4cd9-953f-a92728169e3c\") " pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.088215 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.088188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3b1c68ea-1b27-4cd9-953f-a92728169e3c-signing-cabundle\") pod \"service-ca-568869fdc5-f2shq\" (UID: \"3b1c68ea-1b27-4cd9-953f-a92728169e3c\") " pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.188733 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.188680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3b1c68ea-1b27-4cd9-953f-a92728169e3c-signing-key\") pod \"service-ca-568869fdc5-f2shq\" (UID: \"3b1c68ea-1b27-4cd9-953f-a92728169e3c\") " pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.188956 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.188936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3b1c68ea-1b27-4cd9-953f-a92728169e3c-signing-cabundle\") pod \"service-ca-568869fdc5-f2shq\" (UID: \"3b1c68ea-1b27-4cd9-953f-a92728169e3c\") " pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.189012 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.188977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4n7b\" (UniqueName: \"kubernetes.io/projected/3b1c68ea-1b27-4cd9-953f-a92728169e3c-kube-api-access-c4n7b\") pod \"service-ca-568869fdc5-f2shq\" (UID: \"3b1c68ea-1b27-4cd9-953f-a92728169e3c\") " pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.189597 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.189572    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3b1c68ea-1b27-4cd9-953f-a92728169e3c-signing-cabundle\") pod \"service-ca-568869fdc5-f2shq\" (UID: \"3b1c68ea-1b27-4cd9-953f-a92728169e3c\") " pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.191139 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.191117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3b1c68ea-1b27-4cd9-953f-a92728169e3c-signing-key\") pod \"service-ca-568869fdc5-f2shq\" (UID: \"3b1c68ea-1b27-4cd9-953f-a92728169e3c\") " pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.197928 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.197906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4n7b\" (UniqueName: \"kubernetes.io/projected/3b1c68ea-1b27-4cd9-953f-a92728169e3c-kube-api-access-c4n7b\") pod \"service-ca-568869fdc5-f2shq\" (UID: \"3b1c68ea-1b27-4cd9-953f-a92728169e3c\") " pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.300458 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.300355    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-f2shq"
Sep 17 15:40:03.571367 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:03.571291    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-f2shq"]
Sep 17 15:40:03.574662 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:03.574634    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1c68ea_1b27_4cd9_953f_a92728169e3c.slice/crio-48728917b3a6ab733b2f21751f83d8ca0a1420e94aca1b089989c271b8210de3 WatchSource:0}: Error finding container 48728917b3a6ab733b2f21751f83d8ca0a1420e94aca1b089989c271b8210de3: Status 404 returned error can't find the container with id 48728917b3a6ab733b2f21751f83d8ca0a1420e94aca1b089989c271b8210de3
Sep 17 15:40:04.003908 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:04.003878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-f2shq" event={"ID":"3b1c68ea-1b27-4cd9-953f-a92728169e3c","Type":"ContainerStarted","Data":"48728917b3a6ab733b2f21751f83d8ca0a1420e94aca1b089989c271b8210de3"}
Sep 17 15:40:05.911266 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:05.911232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:05.911680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:05.911298    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:05.911680 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:05.911382    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 15:40:05.911680 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:05.911414    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:05.911680 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:05.911439    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:13.91142384 +0000 UTC m=+92.693111168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : configmap "kube-rbac-proxy" not found
Sep 17 15:40:05.911680 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:05.911465    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:13.911452322 +0000 UTC m=+92.693139664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:06.011536 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:06.011479    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-f2shq" event={"ID":"3b1c68ea-1b27-4cd9-953f-a92728169e3c","Type":"ContainerStarted","Data":"dd24ae43654dba11dbccb7c88dfbe33c3e250e972f87ba6190840cd2479b618c"}
Sep 17 15:40:06.028918 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:06.028865    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-f2shq" podStartSLOduration=2.178642304 podStartE2EDuration="4.02884839s" totalImagesPullingTime="1.850206086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:06.02802247 +0000 UTC m=+84.809709808" watchObservedRunningTime="2026-09-17 15:40:06.02884839 +0000 UTC m=+84.810535727"
Sep 17 15:40:08.127154 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:08.127115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:40:08.127521 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:08.127285    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 15:40:08.127521 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:08.127308    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bb5bbb54b-5k7jv: secret "image-registry-tls" not found
Sep 17 15:40:08.127521 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:08.127372    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls podName:72bbec78-62da-44ce-882f-54dbe98e5d0f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:24.127352809 +0000 UTC m=+102.909040138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls") pod "image-registry-5bb5bbb54b-5k7jv" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f") : secret "image-registry-tls" not found
Sep 17 15:40:13.646563 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:13.646522    2582 scope.go:117] "RemoveContainer" containerID="5a2fc5417ef99e8635128828998b55777aa3ffaa2cd704bc69f3325c045a72f6"
Sep 17 15:40:13.972257 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:13.972167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:13.972257 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:13.972231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:13.972449 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:13.972338    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:13.972449 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:13.972390    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls podName:e0c2575e-edf3-4945-95a2-ab07f2cd022f nodeName:}" failed. No retries permitted until 2026-09-17 15:40:29.972376804 +0000 UTC m=+108.754064119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk94n" (UID: "e0c2575e-edf3-4945-95a2-ab07f2cd022f") : secret "insights-runtime-extractor-tls" not found
Sep 17 15:40:13.972717 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:13.972696    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c2575e-edf3-4945-95a2-ab07f2cd022f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:14.036145 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:14.036116    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:40:14.036553 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:14.036537    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/1.log"
Sep 17 15:40:14.036616 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:14.036570    2582 generic.go:356] "Generic (PLEG): container finished" podID="e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22" containerID="c14dec48f4a6d3ee65858c3f0e914325e7bd3dd33b2862b8209b07c1039a3506" exitCode=255
Sep 17 15:40:14.036616 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:14.036596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" event={"ID":"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22","Type":"ContainerDied","Data":"c14dec48f4a6d3ee65858c3f0e914325e7bd3dd33b2862b8209b07c1039a3506"}
Sep 17 15:40:14.036690 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:14.036662    2582 scope.go:117] "RemoveContainer" containerID="5a2fc5417ef99e8635128828998b55777aa3ffaa2cd704bc69f3325c045a72f6"
Sep 17 15:40:14.036997 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:14.036976    2582 scope.go:117] "RemoveContainer" containerID="c14dec48f4a6d3ee65858c3f0e914325e7bd3dd33b2862b8209b07c1039a3506"
Sep 17 15:40:14.037159 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:14.037134    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-2wxrd_openshift-console-operator(e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22)\"" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" podUID="e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22"
Sep 17 15:40:15.041184 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:15.041157    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:40:19.512787 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:19.512746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:40:19.515148 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:19.515124    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d4f9338a-7afd-40ed-a0f1-9590c3dd9922-metrics-tls\") pod \"dns-default-j8lsq\" (UID: \"d4f9338a-7afd-40ed-a0f1-9590c3dd9922\") " pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:40:19.544935 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:19.544901    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9xnvp\""
Sep 17 15:40:19.552969 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:19.552942    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:40:19.825212 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:19.825123    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j8lsq"]
Sep 17 15:40:19.833669 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:19.832610    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f9338a_7afd_40ed_a0f1_9590c3dd9922.slice/crio-5086ab29c89047bc5b9f42aac80c74cb29d824c12038cdd7220013f4601f706b WatchSource:0}: Error finding container 5086ab29c89047bc5b9f42aac80c74cb29d824c12038cdd7220013f4601f706b: Status 404 returned error can't find the container with id 5086ab29c89047bc5b9f42aac80c74cb29d824c12038cdd7220013f4601f706b
Sep 17 15:40:20.058232 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:20.058189    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8lsq" event={"ID":"d4f9338a-7afd-40ed-a0f1-9590c3dd9922","Type":"ContainerStarted","Data":"5086ab29c89047bc5b9f42aac80c74cb29d824c12038cdd7220013f4601f706b"}
Sep 17 15:40:22.066422 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:22.066393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8lsq" event={"ID":"d4f9338a-7afd-40ed-a0f1-9590c3dd9922","Type":"ContainerStarted","Data":"0ba5afd9b06573ae299cb7c52d37e542a26e25d712b85a19f17a274fa6cc9ed1"}
Sep 17 15:40:22.066802 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:22.066443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j8lsq" event={"ID":"d4f9338a-7afd-40ed-a0f1-9590c3dd9922","Type":"ContainerStarted","Data":"59e9d390d8ac2186d927b8d70cd8003883c2b1891567690ef03796c6fdb27d55"}
Sep 17 15:40:22.066802 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:22.066611    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:40:22.086058 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:22.086012    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j8lsq" podStartSLOduration=65.580349086 podStartE2EDuration="1m7.085995772s" totalImagesPullingTime="1.505646686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:22.085010834 +0000 UTC m=+100.866698185" watchObservedRunningTime="2026-09-17 15:40:22.085995772 +0000 UTC m=+100.867683107"
Sep 17 15:40:22.526570 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:22.526528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:40:22.526740 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:22.526585    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:40:22.526918 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:22.526906    2582 scope.go:117] "RemoveContainer" containerID="c14dec48f4a6d3ee65858c3f0e914325e7bd3dd33b2862b8209b07c1039a3506"
Sep 17 15:40:22.527059 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:22.527044    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-2wxrd_openshift-console-operator(e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22)\"" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" podUID="e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22"
Sep 17 15:40:23.958566 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:23.958538    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hlpnw"
Sep 17 15:40:24.146021 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:24.145989    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:40:24.149530 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:24.149356    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"image-registry-5bb5bbb54b-5k7jv\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") " pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:40:24.438057 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:24.438014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:40:24.733286 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:24.733192    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"]
Sep 17 15:40:24.737788 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:24.737761    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bbec78_62da_44ce_882f_54dbe98e5d0f.slice/crio-e9d40d27e2b1c2a10b3f40e58a592b33b7edfed63367a4fa5c3887e2a2e6e88d WatchSource:0}: Error finding container e9d40d27e2b1c2a10b3f40e58a592b33b7edfed63367a4fa5c3887e2a2e6e88d: Status 404 returned error can't find the container with id e9d40d27e2b1c2a10b3f40e58a592b33b7edfed63367a4fa5c3887e2a2e6e88d
Sep 17 15:40:25.077073 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:25.076987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv" event={"ID":"72bbec78-62da-44ce-882f-54dbe98e5d0f","Type":"ContainerStarted","Data":"2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba"}
Sep 17 15:40:25.077073 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:25.077042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv" event={"ID":"72bbec78-62da-44ce-882f-54dbe98e5d0f","Type":"ContainerStarted","Data":"e9d40d27e2b1c2a10b3f40e58a592b33b7edfed63367a4fa5c3887e2a2e6e88d"}
Sep 17 15:40:25.077599 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:25.077128    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:40:25.099439 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:25.099390    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv" podStartSLOduration=33.099375566 podStartE2EDuration="33.099375566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:25.09765944 +0000 UTC m=+103.879346775" watchObservedRunningTime="2026-09-17 15:40:25.099375566 +0000 UTC m=+103.881062902"
Sep 17 15:40:29.987994 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:29.987943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:29.990196 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:29.990175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c2575e-edf3-4945-95a2-ab07f2cd022f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk94n\" (UID: \"e0c2575e-edf3-4945-95a2-ab07f2cd022f\") " pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:30.261615 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:30.261527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zk94n"
Sep 17 15:40:30.530984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:30.530911    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zk94n"]
Sep 17 15:40:30.534647 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:30.534625    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c2575e_edf3_4945_95a2_ab07f2cd022f.slice/crio-2e2ad13f1b7a1d3145fa36629f6ef06679ba54959beea1a01479b9fdeac3aa28 WatchSource:0}: Error finding container 2e2ad13f1b7a1d3145fa36629f6ef06679ba54959beea1a01479b9fdeac3aa28: Status 404 returned error can't find the container with id 2e2ad13f1b7a1d3145fa36629f6ef06679ba54959beea1a01479b9fdeac3aa28
Sep 17 15:40:31.096857 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:31.096828    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk94n" event={"ID":"e0c2575e-edf3-4945-95a2-ab07f2cd022f","Type":"ContainerStarted","Data":"bdd4e73f5750d5cfb41cd2db45eba0388018093632036032c57e64af310e704d"}
Sep 17 15:40:31.097167 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:31.096879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk94n" event={"ID":"e0c2575e-edf3-4945-95a2-ab07f2cd022f","Type":"ContainerStarted","Data":"2e2ad13f1b7a1d3145fa36629f6ef06679ba54959beea1a01479b9fdeac3aa28"}
Sep 17 15:40:32.072158 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.072128    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j8lsq"
Sep 17 15:40:32.102179 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.102143    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk94n" event={"ID":"e0c2575e-edf3-4945-95a2-ab07f2cd022f","Type":"ContainerStarted","Data":"fd0265e0121c7adbac395a8faead4e2488d562c44abf7b148fa9da56ddfc8a22"}
Sep 17 15:40:32.679473 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.679440    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"]
Sep 17 15:40:32.681129 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.681113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"
Sep 17 15:40:32.684233 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.684199    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7tt4g\""
Sep 17 15:40:32.685680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.685117    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 15:40:32.686323 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.686298    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 15:40:32.700133 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.700109    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"]
Sep 17 15:40:32.749910 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.749878    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"]
Sep 17 15:40:32.802623 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.802593    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"]
Sep 17 15:40:32.804669 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.804652    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"
Sep 17 15:40:32.811043 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.811019    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-t4s7q\""
Sep 17 15:40:32.811168 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.811084    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 17 15:40:32.815689 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.815670    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09eb77a8-df29-403b-8065-3b908e2d8f8d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8tsqf\" (UID: \"09eb77a8-df29-403b-8065-3b908e2d8f8d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"
Sep 17 15:40:32.815771 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.815729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09eb77a8-df29-403b-8065-3b908e2d8f8d-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-8tsqf\" (UID: \"09eb77a8-df29-403b-8065-3b908e2d8f8d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"
Sep 17 15:40:32.829857 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.829828    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"]
Sep 17 15:40:32.905441 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.905408    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69ccd54795-ckwx2"]
Sep 17 15:40:32.907263 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.907248    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:32.916107 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.916083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09eb77a8-df29-403b-8065-3b908e2d8f8d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8tsqf\" (UID: \"09eb77a8-df29-403b-8065-3b908e2d8f8d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"
Sep 17 15:40:32.916225 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.916139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09eb77a8-df29-403b-8065-3b908e2d8f8d-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-8tsqf\" (UID: \"09eb77a8-df29-403b-8065-3b908e2d8f8d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"
Sep 17 15:40:32.916225 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.916163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed2df3b9-f8cd-4eb3-a447-1700049b83c5-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-xzx7f\" (UID: \"ed2df3b9-f8cd-4eb3-a447-1700049b83c5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"
Sep 17 15:40:32.916716 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.916699    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09eb77a8-df29-403b-8065-3b908e2d8f8d-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-8tsqf\" (UID: \"09eb77a8-df29-403b-8065-3b908e2d8f8d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"
Sep 17 15:40:32.918343 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.918327    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/09eb77a8-df29-403b-8065-3b908e2d8f8d-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8tsqf\" (UID: \"09eb77a8-df29-403b-8065-3b908e2d8f8d\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"
Sep 17 15:40:32.938447 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.938390    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69ccd54795-ckwx2"]
Sep 17 15:40:32.991672 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:32.991644    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"
Sep 17 15:40:33.016681 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.016638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c3287e0-00da-48be-a130-d83129515f62-ca-trust-extracted\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.016823 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.016698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c3287e0-00da-48be-a130-d83129515f62-trusted-ca\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.016823 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.016723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c3287e0-00da-48be-a130-d83129515f62-installation-pull-secrets\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.016823 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.016745    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c3287e0-00da-48be-a130-d83129515f62-bound-sa-token\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.016823 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.016772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed2df3b9-f8cd-4eb3-a447-1700049b83c5-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-xzx7f\" (UID: \"ed2df3b9-f8cd-4eb3-a447-1700049b83c5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"
Sep 17 15:40:33.016980 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.016830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c3287e0-00da-48be-a130-d83129515f62-image-registry-private-configuration\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.016980 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.016885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c3287e0-00da-48be-a130-d83129515f62-registry-tls\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.016980 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.016934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m64sn\" (UniqueName: \"kubernetes.io/projected/3c3287e0-00da-48be-a130-d83129515f62-kube-api-access-m64sn\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.017089 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.016980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c3287e0-00da-48be-a130-d83129515f62-registry-certificates\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.019141 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.019118    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ed2df3b9-f8cd-4eb3-a447-1700049b83c5-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-xzx7f\" (UID: \"ed2df3b9-f8cd-4eb3-a447-1700049b83c5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"
Sep 17 15:40:33.107660 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.107627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk94n" event={"ID":"e0c2575e-edf3-4945-95a2-ab07f2cd022f","Type":"ContainerStarted","Data":"76b05c745254f6a503723528fd4ae3431ea65c38bdf8c3a58d3c62a069b58fdb"}
Sep 17 15:40:33.112794 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.112774    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"
Sep 17 15:40:33.117524 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.117481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c3287e0-00da-48be-a130-d83129515f62-image-registry-private-configuration\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.117642 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.117548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c3287e0-00da-48be-a130-d83129515f62-registry-tls\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.117642 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.117589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m64sn\" (UniqueName: \"kubernetes.io/projected/3c3287e0-00da-48be-a130-d83129515f62-kube-api-access-m64sn\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.117760 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.117738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c3287e0-00da-48be-a130-d83129515f62-registry-certificates\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.117866 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.117844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c3287e0-00da-48be-a130-d83129515f62-ca-trust-extracted\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.117961 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.117899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c3287e0-00da-48be-a130-d83129515f62-trusted-ca\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.117961 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.117925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c3287e0-00da-48be-a130-d83129515f62-installation-pull-secrets\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.117961 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.117956    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c3287e0-00da-48be-a130-d83129515f62-bound-sa-token\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.118765 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.118286    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3c3287e0-00da-48be-a130-d83129515f62-ca-trust-extracted\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.118765 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.118671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3c3287e0-00da-48be-a130-d83129515f62-registry-certificates\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.118970 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.118944    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c3287e0-00da-48be-a130-d83129515f62-trusted-ca\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.120204 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.120183    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3c3287e0-00da-48be-a130-d83129515f62-image-registry-private-configuration\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.120493 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.120473    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3c3287e0-00da-48be-a130-d83129515f62-registry-tls\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.120666 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.120650    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3c3287e0-00da-48be-a130-d83129515f62-installation-pull-secrets\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.129354 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.129334    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m64sn\" (UniqueName: \"kubernetes.io/projected/3c3287e0-00da-48be-a130-d83129515f62-kube-api-access-m64sn\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.135345 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.135318    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c3287e0-00da-48be-a130-d83129515f62-bound-sa-token\") pod \"image-registry-69ccd54795-ckwx2\" (UID: \"3c3287e0-00da-48be-a130-d83129515f62\") " pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.215408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.215309    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:33.262562 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.262494    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zk94n" podStartSLOduration=33.629503816 podStartE2EDuration="35.262474531s" totalImagesPullingTime="1.632970715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 15:39:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:33.136326845 +0000 UTC m=+111.918014183" watchObservedRunningTime="2026-09-17 15:40:33.262474531 +0000 UTC m=+112.044161866"
Sep 17 15:40:33.263268 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.263227    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf"]
Sep 17 15:40:33.268127 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:33.268077    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09eb77a8_df29_403b_8065_3b908e2d8f8d.slice/crio-7a691d2f2a827c8429c672d61c297b0de2cb9add7db662d927b5248b0d3a3184 WatchSource:0}: Error finding container 7a691d2f2a827c8429c672d61c297b0de2cb9add7db662d927b5248b0d3a3184: Status 404 returned error can't find the container with id 7a691d2f2a827c8429c672d61c297b0de2cb9add7db662d927b5248b0d3a3184
Sep 17 15:40:33.379984 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.379946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"]
Sep 17 15:40:33.382625 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:33.382596    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2df3b9_f8cd_4eb3_a447_1700049b83c5.slice/crio-bb7d319b59d06b646af06817e723a8251ed963f3de9abbee36cbecaf3786e1a3 WatchSource:0}: Error finding container bb7d319b59d06b646af06817e723a8251ed963f3de9abbee36cbecaf3786e1a3: Status 404 returned error can't find the container with id bb7d319b59d06b646af06817e723a8251ed963f3de9abbee36cbecaf3786e1a3
Sep 17 15:40:33.488672 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:33.488594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69ccd54795-ckwx2"]
Sep 17 15:40:33.491637 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:33.491598    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c3287e0_00da_48be_a130_d83129515f62.slice/crio-ba680352d653da678fd386b5feddb9ca69e3aadeb525d42409ae6209f9be7d31 WatchSource:0}: Error finding container ba680352d653da678fd386b5feddb9ca69e3aadeb525d42409ae6209f9be7d31: Status 404 returned error can't find the container with id ba680352d653da678fd386b5feddb9ca69e3aadeb525d42409ae6209f9be7d31
Sep 17 15:40:34.114304 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:34.114263    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f" event={"ID":"ed2df3b9-f8cd-4eb3-a447-1700049b83c5","Type":"ContainerStarted","Data":"bb7d319b59d06b646af06817e723a8251ed963f3de9abbee36cbecaf3786e1a3"}
Sep 17 15:40:34.116271 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:34.116241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69ccd54795-ckwx2" event={"ID":"3c3287e0-00da-48be-a130-d83129515f62","Type":"ContainerStarted","Data":"27d056b488a21bb4961f417d8d7e3582be36bf55ffae3ea70961db04709c5099"}
Sep 17 15:40:34.116419 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:34.116287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69ccd54795-ckwx2" event={"ID":"3c3287e0-00da-48be-a130-d83129515f62","Type":"ContainerStarted","Data":"ba680352d653da678fd386b5feddb9ca69e3aadeb525d42409ae6209f9be7d31"}
Sep 17 15:40:34.116419 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:34.116350    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:34.117927 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:34.117879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf" event={"ID":"09eb77a8-df29-403b-8065-3b908e2d8f8d","Type":"ContainerStarted","Data":"7a691d2f2a827c8429c672d61c297b0de2cb9add7db662d927b5248b0d3a3184"}
Sep 17 15:40:34.141441 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:34.141291    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69ccd54795-ckwx2" podStartSLOduration=2.14127058 podStartE2EDuration="2.14127058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:34.140555354 +0000 UTC m=+112.922242696" watchObservedRunningTime="2026-09-17 15:40:34.14127058 +0000 UTC m=+112.922957916"
Sep 17 15:40:35.123175 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:35.123135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f" event={"ID":"ed2df3b9-f8cd-4eb3-a447-1700049b83c5","Type":"ContainerStarted","Data":"eee3df2c9502febdfbd472f19ffee011e74aa0d40d4ff91c91bb232d19ed366b"}
Sep 17 15:40:35.123717 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:35.123234    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"
Sep 17 15:40:35.124876 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:35.124846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf" event={"ID":"09eb77a8-df29-403b-8065-3b908e2d8f8d","Type":"ContainerStarted","Data":"a39360dcd217bddc7a416d325a4294ed5a3b7fc9b5bb73507f3d8cdbe20c95d9"}
Sep 17 15:40:35.128125 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:35.128103    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f"
Sep 17 15:40:35.141337 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:35.141291    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-xzx7f" podStartSLOduration=1.836931403 podStartE2EDuration="3.14127321s" totalImagesPullingTime="1.304341807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:35.140790167 +0000 UTC m=+113.922477503" watchObservedRunningTime="2026-09-17 15:40:35.14127321 +0000 UTC m=+113.922960582"
Sep 17 15:40:35.172727 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:35.172670    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8tsqf" podStartSLOduration=1.7565057149999999 podStartE2EDuration="3.172653012s" totalImagesPullingTime="1.416147297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:35.171885668 +0000 UTC m=+113.953573004" watchObservedRunningTime="2026-09-17 15:40:35.172653012 +0000 UTC m=+113.954340346"
Sep 17 15:40:36.646396 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:36.646363    2582 scope.go:117] "RemoveContainer" containerID="c14dec48f4a6d3ee65858c3f0e914325e7bd3dd33b2862b8209b07c1039a3506"
Sep 17 15:40:37.133322 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.133295    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:40:37.133484 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.133411    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" event={"ID":"e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22","Type":"ContainerStarted","Data":"8dacd57d8fd86210db84bf511e891f4156700dbeecca06acfbb3f7a606d9e568"}
Sep 17 15:40:37.133792 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.133773    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:40:37.154183 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.154127    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd" podStartSLOduration=42.965051843 podStartE2EDuration="45.154110493s" totalImagesPullingTime="2.18905865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:37.152656185 +0000 UTC m=+115.934343539" watchObservedRunningTime="2026-09-17 15:40:37.154110493 +0000 UTC m=+115.935797827"
Sep 17 15:40:37.305083 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.305053    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-2wxrd"
Sep 17 15:40:37.472830 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.472751    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-hlj6t"]
Sep 17 15:40:37.476333 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.476312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-hlj6t"
Sep 17 15:40:37.478687 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.478662    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 15:40:37.478687 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.478677    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 15:40:37.478932 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.478918    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5mzhd\""
Sep 17 15:40:37.485683 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.485664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-hlj6t"]
Sep 17 15:40:37.559276 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.559235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9jn\" (UniqueName: \"kubernetes.io/projected/284c37c1-300d-4177-951c-d6418a04e2e2-kube-api-access-bs9jn\") pod \"downloads-76f99584f4-hlj6t\" (UID: \"284c37c1-300d-4177-951c-d6418a04e2e2\") " pod="openshift-console/downloads-76f99584f4-hlj6t"
Sep 17 15:40:37.659609 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.659577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9jn\" (UniqueName: \"kubernetes.io/projected/284c37c1-300d-4177-951c-d6418a04e2e2-kube-api-access-bs9jn\") pod \"downloads-76f99584f4-hlj6t\" (UID: \"284c37c1-300d-4177-951c-d6418a04e2e2\") " pod="openshift-console/downloads-76f99584f4-hlj6t"
Sep 17 15:40:37.668110 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.668088    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9jn\" (UniqueName: \"kubernetes.io/projected/284c37c1-300d-4177-951c-d6418a04e2e2-kube-api-access-bs9jn\") pod \"downloads-76f99584f4-hlj6t\" (UID: \"284c37c1-300d-4177-951c-d6418a04e2e2\") " pod="openshift-console/downloads-76f99584f4-hlj6t"
Sep 17 15:40:37.785764 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:37.785673    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-hlj6t"
Sep 17 15:40:38.061731 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:38.061641    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-hlj6t"]
Sep 17 15:40:38.065620 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:38.065591    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284c37c1_300d_4177_951c_d6418a04e2e2.slice/crio-aead816abd0a717d119f61959a06bf03ccd5d7a57f04f181811f66edbe6ca1ff WatchSource:0}: Error finding container aead816abd0a717d119f61959a06bf03ccd5d7a57f04f181811f66edbe6ca1ff: Status 404 returned error can't find the container with id aead816abd0a717d119f61959a06bf03ccd5d7a57f04f181811f66edbe6ca1ff
Sep 17 15:40:38.138944 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:38.138904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-hlj6t" event={"ID":"284c37c1-300d-4177-951c-d6418a04e2e2","Type":"ContainerStarted","Data":"aead816abd0a717d119f61959a06bf03ccd5d7a57f04f181811f66edbe6ca1ff"}
Sep 17 15:40:40.138227 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.138123    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"]
Sep 17 15:40:40.147403 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.147329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.149857 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.149739    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 17 15:40:40.151531 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.151008    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6vmp7\""
Sep 17 15:40:40.151531 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.151225    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 17 15:40:40.151531 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.151390    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 15:40:40.152193 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.151827    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 15:40:40.152193 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.152051    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 15:40:40.161858 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.161409    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"]
Sep 17 15:40:40.165700 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.165674    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"]
Sep 17 15:40:40.165793 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.165733    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k6l42"]
Sep 17 15:40:40.166758 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.166009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.173894 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.170574    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 17 15:40:40.173894 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.171010    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 17 15:40:40.173894 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.171057    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 17 15:40:40.173894 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.171584    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-skxtt\""
Sep 17 15:40:40.173894 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.171783    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.178054 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.176324    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 15:40:40.178054 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.176797    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 15:40:40.178054 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.177430    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m94zj\""
Sep 17 15:40:40.184013 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.183990    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"]
Sep 17 15:40:40.185314 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.185067    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 15:40:40.282795 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.282695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.282795 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.282756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rnpv\" (UniqueName: \"kubernetes.io/projected/8039d0d6-99cd-43b4-b88e-31b81d9a1494-kube-api-access-6rnpv\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.283035 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.282812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.283035 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.282897    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23e2edfd-f23a-48b4-929a-cd05307c5edf-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.283035 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.282923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-tls\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.283035 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.282946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxx24\" (UniqueName: \"kubernetes.io/projected/23e2edfd-f23a-48b4-929a-cd05307c5edf-kube-api-access-dxx24\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.283035 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23e2edfd-f23a-48b4-929a-cd05307c5edf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.283269 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.283269 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8039d0d6-99cd-43b4-b88e-31b81d9a1494-sys\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.283269 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283146    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d90707b6-3ea2-451f-ae71-37d1c2fbf114-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.283269 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.283269 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-wtmp\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.283528 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtpt9\" (UniqueName: \"kubernetes.io/projected/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-api-access-dtpt9\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.283528 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8039d0d6-99cd-43b4-b88e-31b81d9a1494-root\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.283528 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.283528 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e2edfd-f23a-48b4-929a-cd05307c5edf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.283528 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8039d0d6-99cd-43b4-b88e-31b81d9a1494-metrics-client-ca\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.283528 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-textfile\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.283528 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.283426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d90707b6-3ea2-451f-ae71-37d1c2fbf114-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.384603 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.384790 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8039d0d6-99cd-43b4-b88e-31b81d9a1494-sys\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.384790 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384709    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d90707b6-3ea2-451f-ae71-37d1c2fbf114-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.384790 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.384790 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384743    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8039d0d6-99cd-43b4-b88e-31b81d9a1494-sys\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.384790 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-wtmp\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtpt9\" (UniqueName: \"kubernetes.io/projected/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-api-access-dtpt9\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8039d0d6-99cd-43b4-b88e-31b81d9a1494-root\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e2edfd-f23a-48b4-929a-cd05307c5edf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8039d0d6-99cd-43b4-b88e-31b81d9a1494-metrics-client-ca\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-textfile\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.384995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d90707b6-3ea2-451f-ae71-37d1c2fbf114-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rnpv\" (UniqueName: \"kubernetes.io/projected/8039d0d6-99cd-43b4-b88e-31b81d9a1494-kube-api-access-6rnpv\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385093 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.385594 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23e2edfd-f23a-48b4-929a-cd05307c5edf-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.385594 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-tls\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385594 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385166    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d90707b6-3ea2-451f-ae71-37d1c2fbf114-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.385594 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxx24\" (UniqueName: \"kubernetes.io/projected/23e2edfd-f23a-48b4-929a-cd05307c5edf-kube-api-access-dxx24\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.385594 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23e2edfd-f23a-48b4-929a-cd05307c5edf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.385594 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385324    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-wtmp\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385594 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385256    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-accelerators-collector-config\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385594 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8039d0d6-99cd-43b4-b88e-31b81d9a1494-root\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.385594 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:40.385581    2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 17 15:40:40.386004 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-textfile\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.386004 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:40.385659    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e2edfd-f23a-48b4-929a-cd05307c5edf-openshift-state-metrics-tls podName:23e2edfd-f23a-48b4-929a-cd05307c5edf nodeName:}" failed. No retries permitted until 2026-09-17 15:40:40.88563839 +0000 UTC m=+119.667325719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/23e2edfd-f23a-48b4-929a-cd05307c5edf-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-n5kvp" (UID: "23e2edfd-f23a-48b4-929a-cd05307c5edf") : secret "openshift-state-metrics-tls" not found
Sep 17 15:40:40.386004 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:40.385703    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 15:40:40.386004 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:40.385760    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-tls podName:8039d0d6-99cd-43b4-b88e-31b81d9a1494 nodeName:}" failed. No retries permitted until 2026-09-17 15:40:40.885743766 +0000 UTC m=+119.667431094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-tls") pod "node-exporter-k6l42" (UID: "8039d0d6-99cd-43b4-b88e-31b81d9a1494") : secret "node-exporter-tls" not found
Sep 17 15:40:40.386004 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.385820    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8039d0d6-99cd-43b4-b88e-31b81d9a1494-metrics-client-ca\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.386566 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.386455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23e2edfd-f23a-48b4-929a-cd05307c5edf-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.386566 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.386531    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.386801 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.386743    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d90707b6-3ea2-451f-ae71-37d1c2fbf114-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.388712 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.388658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23e2edfd-f23a-48b4-929a-cd05307c5edf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.388712 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.388666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.389477 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.389443    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.389570 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.389492    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.397307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.397275    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxx24\" (UniqueName: \"kubernetes.io/projected/23e2edfd-f23a-48b4-929a-cd05307c5edf-kube-api-access-dxx24\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.397488 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.397444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rnpv\" (UniqueName: \"kubernetes.io/projected/8039d0d6-99cd-43b4-b88e-31b81d9a1494-kube-api-access-6rnpv\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.398987 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.398945    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtpt9\" (UniqueName: \"kubernetes.io/projected/d90707b6-3ea2-451f-ae71-37d1c2fbf114-kube-api-access-dtpt9\") pod \"kube-state-metrics-59fbdd77d-rn7qn\" (UID: \"d90707b6-3ea2-451f-ae71-37d1c2fbf114\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.487975 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.487945    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"
Sep 17 15:40:40.778405 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.778371    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn"]
Sep 17 15:40:40.780933 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:40.780904    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90707b6_3ea2_451f_ae71_37d1c2fbf114.slice/crio-478c6db89477431eb2b0e778e7fb4f3ffb8bdcf40b50e14012bca510b796bd56 WatchSource:0}: Error finding container 478c6db89477431eb2b0e778e7fb4f3ffb8bdcf40b50e14012bca510b796bd56: Status 404 returned error can't find the container with id 478c6db89477431eb2b0e778e7fb4f3ffb8bdcf40b50e14012bca510b796bd56
Sep 17 15:40:40.889553 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.889520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e2edfd-f23a-48b4-929a-cd05307c5edf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:40.889729 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.889593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-tls\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.892182 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.892150    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8039d0d6-99cd-43b4-b88e-31b81d9a1494-node-exporter-tls\") pod \"node-exporter-k6l42\" (UID: \"8039d0d6-99cd-43b4-b88e-31b81d9a1494\") " pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:40.892443 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:40.892419    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/23e2edfd-f23a-48b4-929a-cd05307c5edf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-n5kvp\" (UID: \"23e2edfd-f23a-48b4-929a-cd05307c5edf\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:41.073940 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:41.073691    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"
Sep 17 15:40:41.096137 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:41.096087    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k6l42"
Sep 17 15:40:41.112318 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:41.112282    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8039d0d6_99cd_43b4_b88e_31b81d9a1494.slice/crio-c85774ef2b0b9c417a59e03a8af92590b0bd1655ec7c262c11a6596c65bedfd4 WatchSource:0}: Error finding container c85774ef2b0b9c417a59e03a8af92590b0bd1655ec7c262c11a6596c65bedfd4: Status 404 returned error can't find the container with id c85774ef2b0b9c417a59e03a8af92590b0bd1655ec7c262c11a6596c65bedfd4
Sep 17 15:40:41.159664 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:41.159624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6l42" event={"ID":"8039d0d6-99cd-43b4-b88e-31b81d9a1494","Type":"ContainerStarted","Data":"c85774ef2b0b9c417a59e03a8af92590b0bd1655ec7c262c11a6596c65bedfd4"}
Sep 17 15:40:41.160964 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:41.160932    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn" event={"ID":"d90707b6-3ea2-451f-ae71-37d1c2fbf114","Type":"ContainerStarted","Data":"478c6db89477431eb2b0e778e7fb4f3ffb8bdcf40b50e14012bca510b796bd56"}
Sep 17 15:40:41.375080 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:41.375042    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp"]
Sep 17 15:40:41.378611 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:41.378580    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e2edfd_f23a_48b4_929a_cd05307c5edf.slice/crio-c0fbce493b86a8855fdfb835dd7ea3e999649e83e54e9f8cecf48e0d009ffdeb WatchSource:0}: Error finding container c0fbce493b86a8855fdfb835dd7ea3e999649e83e54e9f8cecf48e0d009ffdeb: Status 404 returned error can't find the container with id c0fbce493b86a8855fdfb835dd7ea3e999649e83e54e9f8cecf48e0d009ffdeb
Sep 17 15:40:42.167728 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:42.167691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp" event={"ID":"23e2edfd-f23a-48b4-929a-cd05307c5edf","Type":"ContainerStarted","Data":"a1686ecd7a3f972d217c5997b0061e588e9c9886eb6129483a9f0d02fc4748cd"}
Sep 17 15:40:42.168187 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:42.167790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp" event={"ID":"23e2edfd-f23a-48b4-929a-cd05307c5edf","Type":"ContainerStarted","Data":"20095d57849167dc66232af62fa0fc0f33e591758db0ac0d76907b2a2cbac063"}
Sep 17 15:40:42.168187 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:42.167822    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp" event={"ID":"23e2edfd-f23a-48b4-929a-cd05307c5edf","Type":"ContainerStarted","Data":"c0fbce493b86a8855fdfb835dd7ea3e999649e83e54e9f8cecf48e0d009ffdeb"}
Sep 17 15:40:42.758651 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:42.758620    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:40:43.180677 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:43.180583    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn" event={"ID":"d90707b6-3ea2-451f-ae71-37d1c2fbf114","Type":"ContainerStarted","Data":"191552cec050516e29ea0b8c989f00130de32f5f313ebf3ac77c41aa61d935a6"}
Sep 17 15:40:43.180677 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:43.180654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn" event={"ID":"d90707b6-3ea2-451f-ae71-37d1c2fbf114","Type":"ContainerStarted","Data":"ee72e097ca123648325e6c716e5eb8b688f1a2ff05202a2c7110f3d3f2021d25"}
Sep 17 15:40:43.181171 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:43.180682    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn" event={"ID":"d90707b6-3ea2-451f-ae71-37d1c2fbf114","Type":"ContainerStarted","Data":"79de40c0a47b34bd6578435aef66a963686c0361e9c0c914d37939a2bfd3c90d"}
Sep 17 15:40:43.183511 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:43.183469    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp" event={"ID":"23e2edfd-f23a-48b4-929a-cd05307c5edf","Type":"ContainerStarted","Data":"3ee1dfb55558ab8809f65268f6ab8b49d1ff625e44c5d83eebc9b9617252cfb8"}
Sep 17 15:40:43.186184 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:43.186118    2582 generic.go:356] "Generic (PLEG): container finished" podID="8039d0d6-99cd-43b4-b88e-31b81d9a1494" containerID="a979bf3d86f331adb766119c646efb52b11e03fb664c7d13a0ff47f869084cfa" exitCode=0
Sep 17 15:40:43.186305 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:43.186184    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6l42" event={"ID":"8039d0d6-99cd-43b4-b88e-31b81d9a1494","Type":"ContainerDied","Data":"a979bf3d86f331adb766119c646efb52b11e03fb664c7d13a0ff47f869084cfa"}
Sep 17 15:40:43.203327 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:43.203250    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rn7qn" podStartSLOduration=1.455158303 podStartE2EDuration="3.203226129s" totalImagesPullingTime="1.748067826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:43.202391138 +0000 UTC m=+121.984078476" watchObservedRunningTime="2026-09-17 15:40:43.203226129 +0000 UTC m=+121.984913468"
Sep 17 15:40:43.223841 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:43.223683    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-n5kvp" podStartSLOduration=1.902581963 podStartE2EDuration="3.223575949s" totalImagesPullingTime="1.320993986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:43.221729795 +0000 UTC m=+122.003417133" watchObservedRunningTime="2026-09-17 15:40:43.223575949 +0000 UTC m=+122.005263280"
Sep 17 15:40:44.193039 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:44.192984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6l42" event={"ID":"8039d0d6-99cd-43b4-b88e-31b81d9a1494","Type":"ContainerStarted","Data":"0b5f5bba1080342f66a14deacc81a7f022ce0fcaf0b6c2bee29e091bc3e72690"}
Sep 17 15:40:44.193550 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:44.193059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k6l42" event={"ID":"8039d0d6-99cd-43b4-b88e-31b81d9a1494","Type":"ContainerStarted","Data":"0f77b90c305834f13626514a98f0a8ecbde395467f552f4c181a96e8176f187e"}
Sep 17 15:40:44.215575 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:44.215523    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k6l42" podStartSLOduration=2.70754803 podStartE2EDuration="4.215495007s" totalImagesPullingTime="1.418017206s" totalInitContainerRuntime="89.929771ms" isStatefulPod=true podCreationTimestamp="2026-09-17 15:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:44.213699228 +0000 UTC m=+122.995386603" watchObservedRunningTime="2026-09-17 15:40:44.215495007 +0000 UTC m=+122.997182346"
Sep 17 15:40:46.445910 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.445876    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:40:46.450009 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.449984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.452922 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.452893    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 15:40:46.453048 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.453021    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 15:40:46.453217 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.453024    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9q68rbhcmu0n\""
Sep 17 15:40:46.453355 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.453334    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 15:40:46.455399 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.455278    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 15:40:46.455573 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.455468    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 15:40:46.455573 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.455491    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 15:40:46.455693 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.455640    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 15:40:46.456409 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.455831    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4t25c\""
Sep 17 15:40:46.456409 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.455939    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 15:40:46.456409 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.456109    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 15:40:46.456409 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.456151    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 15:40:46.456409 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.456267    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 15:40:46.456409 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.456296    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 15:40:46.461200 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.461038    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 15:40:46.462010 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.461986    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 15:40:46.464902 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.464881    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 15:40:46.468573 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.468553    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:40:46.542888 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.542852    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-config\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543090 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.542894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543090 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.542922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543090 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.542939    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543090 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.542962    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tdtv\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-kube-api-access-7tdtv\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543090 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543026    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543090 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543379 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543102    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543379 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543129    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543379 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543379 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543200    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543379 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543379 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543379 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543326    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543379 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543358    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543686 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543686 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543686 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543686 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543492    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.543686 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.543556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644657 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644657 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644892 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644892 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644705    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644892 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644892 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644892 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644892 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644814    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644892 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.644892 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.645173 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.645173 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.645173 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.645173 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.644981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.645173 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.645029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.646081 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.645783    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.646081 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.645829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.646081 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.645926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-config\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.646081 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.645979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.646081 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.646010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.646081 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.646036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.646081 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.646060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tdtv\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-kube-api-access-7tdtv\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.649053 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.648057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.649053 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.648263    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.649053 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.648547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.649053 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.648583    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.649053 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.648960    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.649360 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.649062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.649360 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.649319    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.650432 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.649995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.650432 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.650122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.650432 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.650173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.650709 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.650668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.653364 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.653323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.654335 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.653973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-config\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.654335 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.654061    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.654335 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.654279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.654335 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.654329    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.657806 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.657784    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.659882 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.659858    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tdtv\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-kube-api-access-7tdtv\") pod \"prometheus-k8s-0\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:46.764272 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:46.764179    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:40:47.073768 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:47.073744    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:40:47.075889 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:47.075860    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd535d5d_af07_478f_ae3b_32a7d8191765.slice/crio-e0a446ae4aaf35c8d63c28b698f6e5fb745c940ece5a2d81d8fc5d09e8b01bc6 WatchSource:0}: Error finding container e0a446ae4aaf35c8d63c28b698f6e5fb745c940ece5a2d81d8fc5d09e8b01bc6: Status 404 returned error can't find the container with id e0a446ae4aaf35c8d63c28b698f6e5fb745c940ece5a2d81d8fc5d09e8b01bc6
Sep 17 15:40:47.208980 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:47.208940    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerStarted","Data":"e0a446ae4aaf35c8d63c28b698f6e5fb745c940ece5a2d81d8fc5d09e8b01bc6"}
Sep 17 15:40:48.215287 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:48.215243    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerStarted","Data":"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"}
Sep 17 15:40:51.595526 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:51.595470    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:40:51.598151 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:51.598113    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e9cbd72-5eac-406e-9742-59abcad1fd00-metrics-certs\") pod \"network-metrics-daemon-z9gzw\" (UID: \"3e9cbd72-5eac-406e-9742-59abcad1fd00\") " pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:40:51.675580 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:51.675544    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j5497\""
Sep 17 15:40:51.681591 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:51.681565    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z9gzw"
Sep 17 15:40:55.129697 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:55.129672    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69ccd54795-ckwx2"
Sep 17 15:40:55.240094 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:55.239969    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z9gzw"]
Sep 17 15:40:55.243151 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:40:55.243119    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9cbd72_5eac_406e_9742_59abcad1fd00.slice/crio-5d03c00daed79ca51f23ec050c452bf74506908f8d72697b1d45e4efc46b902b WatchSource:0}: Error finding container 5d03c00daed79ca51f23ec050c452bf74506908f8d72697b1d45e4efc46b902b: Status 404 returned error can't find the container with id 5d03c00daed79ca51f23ec050c452bf74506908f8d72697b1d45e4efc46b902b
Sep 17 15:40:55.247118 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:55.247091    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-hlj6t" event={"ID":"284c37c1-300d-4177-951c-d6418a04e2e2","Type":"ContainerStarted","Data":"5fad14fcaa3c2f639462b2c03d84c9f6460a0fbb0b92dc1c2059ecc65e2e798d"}
Sep 17 15:40:55.248642 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:55.248089    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-hlj6t"
Sep 17 15:40:55.255537 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:55.249212    2582 patch_prober.go:28] interesting pod/downloads-76f99584f4-hlj6t container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" start-of-body=
Sep 17 15:40:55.255537 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:55.249276    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-hlj6t" podUID="284c37c1-300d-4177-951c-d6418a04e2e2" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused"
Sep 17 15:40:55.256568 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:55.256544    2582 generic.go:356] "Generic (PLEG): container finished" podID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerID="32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405" exitCode=0
Sep 17 15:40:55.256658 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:55.256589    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerDied","Data":"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"}
Sep 17 15:40:55.271211 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:55.271159    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-hlj6t" podStartSLOduration=1.2812785500000001 podStartE2EDuration="18.271138556s" totalImagesPullingTime="16.989860006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:55.269555341 +0000 UTC m=+134.051242679" watchObservedRunningTime="2026-09-17 15:40:55.271138556 +0000 UTC m=+134.052825895"
Sep 17 15:40:56.265782 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:56.265742    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z9gzw" event={"ID":"3e9cbd72-5eac-406e-9742-59abcad1fd00","Type":"ContainerStarted","Data":"5d03c00daed79ca51f23ec050c452bf74506908f8d72697b1d45e4efc46b902b"}
Sep 17 15:40:56.276170 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:56.275956    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-hlj6t"
Sep 17 15:40:57.274825 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:57.274782    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z9gzw" event={"ID":"3e9cbd72-5eac-406e-9742-59abcad1fd00","Type":"ContainerStarted","Data":"85c4b3672fcf314c518aab67ec10fdad2da034bed7ee49ad27b674d4a4f425c0"}
Sep 17 15:40:57.275311 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:57.274859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z9gzw" event={"ID":"3e9cbd72-5eac-406e-9742-59abcad1fd00","Type":"ContainerStarted","Data":"23fa2d9548adfedf81b528fcdd2debd09d055120039649f2bff756e42de05070"}
Sep 17 15:40:57.299823 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:57.299759    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z9gzw" podStartSLOduration=134.165936546 podStartE2EDuration="2m15.299737108s" totalImagesPullingTime="1.133800562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:40:57.298085774 +0000 UTC m=+136.079773112" watchObservedRunningTime="2026-09-17 15:40:57.299737108 +0000 UTC m=+136.081424446"
Sep 17 15:40:57.768674 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:57.768487    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv" podUID="72bbec78-62da-44ce-882f-54dbe98e5d0f" containerName="registry" containerID="cri-o://2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba" gracePeriod=30
Sep 17 15:40:59.167195 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.167165    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:40:59.267974 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.267899    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-image-registry-private-configuration\") pod \"72bbec78-62da-44ce-882f-54dbe98e5d0f\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") "
Sep 17 15:40:59.267974 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.267943    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") pod \"72bbec78-62da-44ce-882f-54dbe98e5d0f\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") "
Sep 17 15:40:59.267974 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.267972    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-installation-pull-secrets\") pod \"72bbec78-62da-44ce-882f-54dbe98e5d0f\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") "
Sep 17 15:40:59.268285 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.268056    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-bound-sa-token\") pod \"72bbec78-62da-44ce-882f-54dbe98e5d0f\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") "
Sep 17 15:40:59.268285 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.268089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7zr7\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-kube-api-access-r7zr7\") pod \"72bbec78-62da-44ce-882f-54dbe98e5d0f\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") "
Sep 17 15:40:59.268285 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.268159    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-trusted-ca\") pod \"72bbec78-62da-44ce-882f-54dbe98e5d0f\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") "
Sep 17 15:40:59.268285 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.268181    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-certificates\") pod \"72bbec78-62da-44ce-882f-54dbe98e5d0f\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") "
Sep 17 15:40:59.268285 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.268214    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72bbec78-62da-44ce-882f-54dbe98e5d0f-ca-trust-extracted\") pod \"72bbec78-62da-44ce-882f-54dbe98e5d0f\" (UID: \"72bbec78-62da-44ce-882f-54dbe98e5d0f\") "
Sep 17 15:40:59.268706 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.268675    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "72bbec78-62da-44ce-882f-54dbe98e5d0f" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:40:59.268868 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.268750    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "72bbec78-62da-44ce-882f-54dbe98e5d0f" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:40:59.270960 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.270907    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "72bbec78-62da-44ce-882f-54dbe98e5d0f" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:40:59.271172 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.271143    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "72bbec78-62da-44ce-882f-54dbe98e5d0f" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:40:59.272084 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.272059    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-kube-api-access-r7zr7" (OuterVolumeSpecName: "kube-api-access-r7zr7") pod "72bbec78-62da-44ce-882f-54dbe98e5d0f" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f"). InnerVolumeSpecName "kube-api-access-r7zr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:40:59.272282 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.272245    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "72bbec78-62da-44ce-882f-54dbe98e5d0f" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:40:59.272427 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.272407    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "72bbec78-62da-44ce-882f-54dbe98e5d0f" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:40:59.281995 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.281968    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72bbec78-62da-44ce-882f-54dbe98e5d0f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "72bbec78-62da-44ce-882f-54dbe98e5d0f" (UID: "72bbec78-62da-44ce-882f-54dbe98e5d0f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:40:59.286822 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.286765    2582 generic.go:356] "Generic (PLEG): container finished" podID="72bbec78-62da-44ce-882f-54dbe98e5d0f" containerID="2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba" exitCode=0
Sep 17 15:40:59.286916 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.286838    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv" event={"ID":"72bbec78-62da-44ce-882f-54dbe98e5d0f","Type":"ContainerDied","Data":"2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba"}
Sep 17 15:40:59.286916 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.286883    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"
Sep 17 15:40:59.287019 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.286938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bb5bbb54b-5k7jv" event={"ID":"72bbec78-62da-44ce-882f-54dbe98e5d0f","Type":"ContainerDied","Data":"e9d40d27e2b1c2a10b3f40e58a592b33b7edfed63367a4fa5c3887e2a2e6e88d"}
Sep 17 15:40:59.287019 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.286971    2582 scope.go:117] "RemoveContainer" containerID="2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba"
Sep 17 15:40:59.311754 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.311725    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"]
Sep 17 15:40:59.317912 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.317886    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bb5bbb54b-5k7jv"]
Sep 17 15:40:59.369608 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.369575    2582 scope.go:117] "RemoveContainer" containerID="2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba"
Sep 17 15:40:59.369864 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.369749    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-bound-sa-token\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:40:59.369864 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.369771    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7zr7\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-kube-api-access-r7zr7\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:40:59.369864 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.369785    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-trusted-ca\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:40:59.369864 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.369798    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-certificates\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:40:59.369864 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.369823    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/72bbec78-62da-44ce-882f-54dbe98e5d0f-ca-trust-extracted\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:40:59.369864 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.369838    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-image-registry-private-configuration\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:40:59.369864 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.369850    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/72bbec78-62da-44ce-882f-54dbe98e5d0f-registry-tls\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:40:59.369864 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.369862    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/72bbec78-62da-44ce-882f-54dbe98e5d0f-installation-pull-secrets\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:40:59.370319 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:40:59.370027    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba\": container with ID starting with 2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba not found: ID does not exist" containerID="2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba"
Sep 17 15:40:59.370319 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.370069    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba"} err="failed to get container status \"2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba\": rpc error: code = NotFound desc = could not find container \"2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba\": container with ID starting with 2964841dc0355673fe2c56c60c7480e898c895455272e68fa6cc9e4989ca47ba not found: ID does not exist"
Sep 17 15:40:59.654169 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:40:59.654132    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72bbec78-62da-44ce-882f-54dbe98e5d0f" path="/var/lib/kubelet/pods/72bbec78-62da-44ce-882f-54dbe98e5d0f/volumes"
Sep 17 15:41:00.297181 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:00.297008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerStarted","Data":"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"}
Sep 17 15:41:00.297181 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:00.297094    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerStarted","Data":"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"}
Sep 17 15:41:02.312214 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:02.312169    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerStarted","Data":"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"}
Sep 17 15:41:03.321329 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:03.321284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerStarted","Data":"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"}
Sep 17 15:41:03.321810 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:03.321389    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerStarted","Data":"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"}
Sep 17 15:41:03.321810 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:03.321468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerStarted","Data":"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"}
Sep 17 15:41:03.358230 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:03.358164    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.810054224 podStartE2EDuration="17.35814307s" totalImagesPullingTime="7.528760047s" totalInitContainerRuntime="19.328799ms" isStatefulPod=false podCreationTimestamp="2026-09-17 15:40:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:41:03.356859744 +0000 UTC m=+142.138547082" watchObservedRunningTime="2026-09-17 15:41:03.35814307 +0000 UTC m=+142.139830406"
Sep 17 15:41:06.764857 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:06.764821    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:41:08.345990 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:08.345946    2582 generic.go:356] "Generic (PLEG): container finished" podID="c64be236-027b-4f49-baa0-64c6025619e7" containerID="701c5eedcadb01b21c6555a8a8cc52e209124b1d200d6348de89ff1de940268d" exitCode=0
Sep 17 15:41:08.346477 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:08.346016    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lcq4t" event={"ID":"c64be236-027b-4f49-baa0-64c6025619e7","Type":"ContainerDied","Data":"701c5eedcadb01b21c6555a8a8cc52e209124b1d200d6348de89ff1de940268d"}
Sep 17 15:41:08.346477 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:08.346378    2582 scope.go:117] "RemoveContainer" containerID="701c5eedcadb01b21c6555a8a8cc52e209124b1d200d6348de89ff1de940268d"
Sep 17 15:41:09.180429 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:09.180402    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6j8lj_4d6b81c3-e9ce-4806-be6a-4baed8d7b876/serve-healthcheck-canary/0.log"
Sep 17 15:41:09.352337 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:09.352305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lcq4t" event={"ID":"c64be236-027b-4f49-baa0-64c6025619e7","Type":"ContainerStarted","Data":"ece61eb00b7bebd69d2bba02b98d779c6462d3c6712c0972b7b7b2c03b9b1258"}
Sep 17 15:41:46.764696 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:46.764650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:41:46.784641 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:46.784613    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:41:47.517615 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:41:47.517586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:04.910342 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:04.910304    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:42:04.910902 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:04.910615    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="prometheus" containerID="cri-o://c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9" gracePeriod=600
Sep 17 15:42:04.910902 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:04.910643    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="thanos-sidecar" containerID="cri-o://80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38" gracePeriod=600
Sep 17 15:42:04.910902 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:04.910679    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="config-reloader" containerID="cri-o://18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b" gracePeriod=600
Sep 17 15:42:04.910902 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:04.910691    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy-web" containerID="cri-o://2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886" gracePeriod=600
Sep 17 15:42:04.910902 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:04.910709    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy-thanos" containerID="cri-o://60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d" gracePeriod=600
Sep 17 15:42:04.910902 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:04.910643    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy" containerID="cri-o://b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d" gracePeriod=600
Sep 17 15:42:05.148175 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.148150    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.225432 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225343    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-web-config\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225432 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225382    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-db\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225432 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225404    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-metrics-client-ca\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225432 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225433    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tdtv\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-kube-api-access-7tdtv\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225451    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-config\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225469    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-trusted-ca-bundle\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225494    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-kube-rbac-proxy\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225533    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-config-out\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225555    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-thanos-prometheus-http-client-file\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225579    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-tls-assets\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225626    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-2\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-grpc-tls\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225684    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-metrics-client-certs\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.225770 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225757    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-tls\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.226326 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225781    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.226326 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225810    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-serving-certs-ca-bundle\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.226326 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225844    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-1\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.226326 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225901    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-kubelet-serving-ca-bundle\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.226326 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225905    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:42:05.226326 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.225924    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-0\") pod \"bd535d5d-af07-478f-ae3b-32a7d8191765\" (UID: \"bd535d5d-af07-478f-ae3b-32a7d8191765\") "
Sep 17 15:42:05.226326 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.226160    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:42:05.226326 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.226187    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-metrics-client-ca\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.227359 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.227065    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:42:05.227721 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.227687    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:42:05.228001 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.227970    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:42:05.228693 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.228589    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:42:05.229017 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.228952    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:42:05.229098 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.229032    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-config" (OuterVolumeSpecName: "config") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:42:05.229367 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.229342    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:42:05.230155 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.230123    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:42:05.230244 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.230146    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:42:05.230244 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.230236    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:42:05.230354 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.230270    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-kube-api-access-7tdtv" (OuterVolumeSpecName: "kube-api-access-7tdtv") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "kube-api-access-7tdtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:42:05.230948 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.230840    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:42:05.230948 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.230920    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-config-out" (OuterVolumeSpecName: "config-out") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:42:05.231185 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.231155    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:42:05.231291 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.231249    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:42:05.231392 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.231375    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:42:05.231819 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.231797    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:42:05.241150 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.241111    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-web-config" (OuterVolumeSpecName: "web-config") pod "bd535d5d-af07-478f-ae3b-32a7d8191765" (UID: "bd535d5d-af07-478f-ae3b-32a7d8191765"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 15:42:05.326817 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326780    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.326817 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326812    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.326817 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326825    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-web-config\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326834    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-db\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326844    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tdtv\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-kube-api-access-7tdtv\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326852    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-config\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326861    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326869    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-kube-rbac-proxy\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326877    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd535d5d-af07-478f-ae3b-32a7d8191765-config-out\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326885    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326893    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd535d5d-af07-478f-ae3b-32a7d8191765-tls-assets\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326901    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326910    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-grpc-tls\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326918    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326927    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-metrics-client-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326934    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326942    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd535d5d-af07-478f-ae3b-32a7d8191765-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326952    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.327050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.326961    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd535d5d-af07-478f-ae3b-32a7d8191765-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:42:05.575132 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575050    2582 generic.go:356] "Generic (PLEG): container finished" podID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerID="60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d" exitCode=0
Sep 17 15:42:05.575132 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575073    2582 generic.go:356] "Generic (PLEG): container finished" podID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerID="b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d" exitCode=0
Sep 17 15:42:05.575132 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575079    2582 generic.go:356] "Generic (PLEG): container finished" podID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerID="2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886" exitCode=0
Sep 17 15:42:05.575132 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575085    2582 generic.go:356] "Generic (PLEG): container finished" podID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerID="80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38" exitCode=0
Sep 17 15:42:05.575132 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575090    2582 generic.go:356] "Generic (PLEG): container finished" podID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerID="18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b" exitCode=0
Sep 17 15:42:05.575132 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575095    2582 generic.go:356] "Generic (PLEG): container finished" podID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerID="c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9" exitCode=0
Sep 17 15:42:05.575132 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575123    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.575132 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerDied","Data":"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"}
Sep 17 15:42:05.575494 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerDied","Data":"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"}
Sep 17 15:42:05.575494 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerDied","Data":"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"}
Sep 17 15:42:05.575494 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerDied","Data":"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"}
Sep 17 15:42:05.575494 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575256    2582 scope.go:117] "RemoveContainer" containerID="60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"
Sep 17 15:42:05.575494 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerDied","Data":"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"}
Sep 17 15:42:05.575494 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerDied","Data":"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"}
Sep 17 15:42:05.575494 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.575332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd535d5d-af07-478f-ae3b-32a7d8191765","Type":"ContainerDied","Data":"e0a446ae4aaf35c8d63c28b698f6e5fb745c940ece5a2d81d8fc5d09e8b01bc6"}
Sep 17 15:42:05.588786 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.588762    2582 scope.go:117] "RemoveContainer" containerID="b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"
Sep 17 15:42:05.595788 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.595766    2582 scope.go:117] "RemoveContainer" containerID="2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"
Sep 17 15:42:05.602462 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.602435    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:42:05.603172 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.603154    2582 scope.go:117] "RemoveContainer" containerID="80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"
Sep 17 15:42:05.607309 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.607287    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:42:05.610743 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.610721    2582 scope.go:117] "RemoveContainer" containerID="18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"
Sep 17 15:42:05.617670 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.617653    2582 scope.go:117] "RemoveContainer" containerID="c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"
Sep 17 15:42:05.625362 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.625337    2582 scope.go:117] "RemoveContainer" containerID="32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"
Sep 17 15:42:05.632347 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.632325    2582 scope.go:117] "RemoveContainer" containerID="60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"
Sep 17 15:42:05.632733 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:42:05.632705    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": container with ID starting with 60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d not found: ID does not exist" containerID="60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"
Sep 17 15:42:05.632878 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.632746    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"} err="failed to get container status \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": rpc error: code = NotFound desc = could not find container \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": container with ID starting with 60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d not found: ID does not exist"
Sep 17 15:42:05.632878 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.632777    2582 scope.go:117] "RemoveContainer" containerID="b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"
Sep 17 15:42:05.633244 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:42:05.633159    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": container with ID starting with b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d not found: ID does not exist" containerID="b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"
Sep 17 15:42:05.633244 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.633191    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"} err="failed to get container status \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": rpc error: code = NotFound desc = could not find container \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": container with ID starting with b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d not found: ID does not exist"
Sep 17 15:42:05.633244 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.633212    2582 scope.go:117] "RemoveContainer" containerID="2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"
Sep 17 15:42:05.633595 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:42:05.633567    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": container with ID starting with 2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886 not found: ID does not exist" containerID="2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"
Sep 17 15:42:05.633670 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.633600    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"} err="failed to get container status \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": rpc error: code = NotFound desc = could not find container \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": container with ID starting with 2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886 not found: ID does not exist"
Sep 17 15:42:05.633670 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.633615    2582 scope.go:117] "RemoveContainer" containerID="80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"
Sep 17 15:42:05.633927 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:42:05.633905    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": container with ID starting with 80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38 not found: ID does not exist" containerID="80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"
Sep 17 15:42:05.633991 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.633929    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"} err="failed to get container status \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": rpc error: code = NotFound desc = could not find container \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": container with ID starting with 80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38 not found: ID does not exist"
Sep 17 15:42:05.633991 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.633942    2582 scope.go:117] "RemoveContainer" containerID="18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"
Sep 17 15:42:05.634219 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:42:05.634201    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": container with ID starting with 18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b not found: ID does not exist" containerID="18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"
Sep 17 15:42:05.634277 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.634223    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"} err="failed to get container status \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": rpc error: code = NotFound desc = could not find container \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": container with ID starting with 18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b not found: ID does not exist"
Sep 17 15:42:05.634277 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.634238    2582 scope.go:117] "RemoveContainer" containerID="c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"
Sep 17 15:42:05.634484 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:42:05.634461    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": container with ID starting with c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9 not found: ID does not exist" containerID="c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"
Sep 17 15:42:05.634567 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.634490    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"} err="failed to get container status \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": rpc error: code = NotFound desc = could not find container \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": container with ID starting with c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9 not found: ID does not exist"
Sep 17 15:42:05.634567 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.634526    2582 scope.go:117] "RemoveContainer" containerID="32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"
Sep 17 15:42:05.634666 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.634625    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:42:05.634790 ip-10-0-139-98 kubenswrapper[2582]: E0917 15:42:05.634771    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": container with ID starting with 32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405 not found: ID does not exist" containerID="32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"
Sep 17 15:42:05.634840 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.634793    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"} err="failed to get container status \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": rpc error: code = NotFound desc = could not find container \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": container with ID starting with 32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405 not found: ID does not exist"
Sep 17 15:42:05.634840 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.634807    2582 scope.go:117] "RemoveContainer" containerID="60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"
Sep 17 15:42:05.635024 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635007    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="init-config-reloader"
Sep 17 15:42:05.635082 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635028    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="init-config-reloader"
Sep 17 15:42:05.635082 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635042    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy-web"
Sep 17 15:42:05.635082 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635051    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy-web"
Sep 17 15:42:05.635082 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635026    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"} err="failed to get container status \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": rpc error: code = NotFound desc = could not find container \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": container with ID starting with 60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d not found: ID does not exist"
Sep 17 15:42:05.635082 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635067    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy"
Sep 17 15:42:05.635082 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635077    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy"
Sep 17 15:42:05.635082 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635080    2582 scope.go:117] "RemoveContainer" containerID="b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635090    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="prometheus"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635098    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="prometheus"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635112    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="thanos-sidecar"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635120    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="thanos-sidecar"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635131    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72bbec78-62da-44ce-882f-54dbe98e5d0f" containerName="registry"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635139    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="72bbec78-62da-44ce-882f-54dbe98e5d0f" containerName="registry"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635148    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="config-reloader"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635158    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="config-reloader"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635167    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy-thanos"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635176    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy-thanos"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635248    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy-thanos"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635262    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="thanos-sidecar"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635271    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy-web"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635279    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="config-reloader"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635289    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="prometheus"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635297    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="72bbec78-62da-44ce-882f-54dbe98e5d0f" containerName="registry"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635306    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" containerName="kube-rbac-proxy"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635308    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"} err="failed to get container status \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": rpc error: code = NotFound desc = could not find container \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": container with ID starting with b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d not found: ID does not exist"
Sep 17 15:42:05.635408 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635331    2582 scope.go:117] "RemoveContainer" containerID="2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"
Sep 17 15:42:05.636297 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635585    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"} err="failed to get container status \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": rpc error: code = NotFound desc = could not find container \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": container with ID starting with 2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886 not found: ID does not exist"
Sep 17 15:42:05.636297 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635599    2582 scope.go:117] "RemoveContainer" containerID="80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"
Sep 17 15:42:05.636297 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635797    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"} err="failed to get container status \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": rpc error: code = NotFound desc = could not find container \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": container with ID starting with 80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38 not found: ID does not exist"
Sep 17 15:42:05.636297 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.635813    2582 scope.go:117] "RemoveContainer" containerID="18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"
Sep 17 15:42:05.636297 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636023    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"} err="failed to get container status \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": rpc error: code = NotFound desc = could not find container \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": container with ID starting with 18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b not found: ID does not exist"
Sep 17 15:42:05.636297 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636036    2582 scope.go:117] "RemoveContainer" containerID="c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"
Sep 17 15:42:05.636297 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636249    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"} err="failed to get container status \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": rpc error: code = NotFound desc = could not find container \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": container with ID starting with c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9 not found: ID does not exist"
Sep 17 15:42:05.636297 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636263    2582 scope.go:117] "RemoveContainer" containerID="32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"
Sep 17 15:42:05.636676 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636484    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"} err="failed to get container status \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": rpc error: code = NotFound desc = could not find container \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": container with ID starting with 32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405 not found: ID does not exist"
Sep 17 15:42:05.636676 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636517    2582 scope.go:117] "RemoveContainer" containerID="60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"
Sep 17 15:42:05.636826 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636729    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"} err="failed to get container status \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": rpc error: code = NotFound desc = could not find container \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": container with ID starting with 60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d not found: ID does not exist"
Sep 17 15:42:05.636826 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636743    2582 scope.go:117] "RemoveContainer" containerID="b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"
Sep 17 15:42:05.636962 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636942    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"} err="failed to get container status \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": rpc error: code = NotFound desc = could not find container \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": container with ID starting with b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d not found: ID does not exist"
Sep 17 15:42:05.636962 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.636961    2582 scope.go:117] "RemoveContainer" containerID="2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"
Sep 17 15:42:05.637173 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.637155    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"} err="failed to get container status \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": rpc error: code = NotFound desc = could not find container \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": container with ID starting with 2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886 not found: ID does not exist"
Sep 17 15:42:05.637173 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.637173    2582 scope.go:117] "RemoveContainer" containerID="80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"
Sep 17 15:42:05.637451 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.637429    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"} err="failed to get container status \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": rpc error: code = NotFound desc = could not find container \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": container with ID starting with 80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38 not found: ID does not exist"
Sep 17 15:42:05.637559 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.637453    2582 scope.go:117] "RemoveContainer" containerID="18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"
Sep 17 15:42:05.637812 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.637788    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"} err="failed to get container status \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": rpc error: code = NotFound desc = could not find container \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": container with ID starting with 18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b not found: ID does not exist"
Sep 17 15:42:05.637878 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.637812    2582 scope.go:117] "RemoveContainer" containerID="c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"
Sep 17 15:42:05.638172 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.638132    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"} err="failed to get container status \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": rpc error: code = NotFound desc = could not find container \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": container with ID starting with c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9 not found: ID does not exist"
Sep 17 15:42:05.638172 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.638156    2582 scope.go:117] "RemoveContainer" containerID="32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"
Sep 17 15:42:05.641744 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.638423    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"} err="failed to get container status \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": rpc error: code = NotFound desc = could not find container \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": container with ID starting with 32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405 not found: ID does not exist"
Sep 17 15:42:05.641744 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.638448    2582 scope.go:117] "RemoveContainer" containerID="60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"
Sep 17 15:42:05.641744 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.639663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.642199 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.642173    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"} err="failed to get container status \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": rpc error: code = NotFound desc = could not find container \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": container with ID starting with 60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d not found: ID does not exist"
Sep 17 15:42:05.642199 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.642198    2582 scope.go:117] "RemoveContainer" containerID="b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"
Sep 17 15:42:05.642540 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.642517    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"} err="failed to get container status \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": rpc error: code = NotFound desc = could not find container \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": container with ID starting with b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d not found: ID does not exist"
Sep 17 15:42:05.642619 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.642541    2582 scope.go:117] "RemoveContainer" containerID="2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"
Sep 17 15:42:05.642806 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.642786    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 15:42:05.642906 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.642841    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 15:42:05.642906 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.642845    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"} err="failed to get container status \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": rpc error: code = NotFound desc = could not find container \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": container with ID starting with 2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886 not found: ID does not exist"
Sep 17 15:42:05.642906 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.642874    2582 scope.go:117] "RemoveContainer" containerID="80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"
Sep 17 15:42:05.643083 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.642929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 15:42:05.643083 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643056    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4t25c\""
Sep 17 15:42:05.643182 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643166    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"} err="failed to get container status \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": rpc error: code = NotFound desc = could not find container \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": container with ID starting with 80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38 not found: ID does not exist"
Sep 17 15:42:05.643233 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643188    2582 scope.go:117] "RemoveContainer" containerID="18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"
Sep 17 15:42:05.643458 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643440    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"} err="failed to get container status \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": rpc error: code = NotFound desc = could not find container \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": container with ID starting with 18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b not found: ID does not exist"
Sep 17 15:42:05.643458 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643457    2582 scope.go:117] "RemoveContainer" containerID="c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"
Sep 17 15:42:05.643815 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643796    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 15:42:05.643925 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643834    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 15:42:05.643925 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643792    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"} err="failed to get container status \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": rpc error: code = NotFound desc = could not find container \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": container with ID starting with c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9 not found: ID does not exist"
Sep 17 15:42:05.643925 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643873    2582 scope.go:117] "RemoveContainer" containerID="32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"
Sep 17 15:42:05.643925 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643797    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 15:42:05.643925 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643915    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 15:42:05.643925 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.643924    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 15:42:05.644242 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644208    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"} err="failed to get container status \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": rpc error: code = NotFound desc = could not find container \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": container with ID starting with 32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405 not found: ID does not exist"
Sep 17 15:42:05.644242 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644234    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9q68rbhcmu0n\""
Sep 17 15:42:05.644363 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644258    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 15:42:05.644363 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644283    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 15:42:05.644363 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644321    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 15:42:05.644526 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644376    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 15:42:05.644526 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644235    2582 scope.go:117] "RemoveContainer" containerID="60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"
Sep 17 15:42:05.644526 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644416    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 15:42:05.644706 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644685    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"} err="failed to get container status \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": rpc error: code = NotFound desc = could not find container \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": container with ID starting with 60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d not found: ID does not exist"
Sep 17 15:42:05.644706 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644705    2582 scope.go:117] "RemoveContainer" containerID="b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"
Sep 17 15:42:05.645019 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.644997    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"} err="failed to get container status \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": rpc error: code = NotFound desc = could not find container \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": container with ID starting with b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d not found: ID does not exist"
Sep 17 15:42:05.645019 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.645018    2582 scope.go:117] "RemoveContainer" containerID="2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"
Sep 17 15:42:05.645312 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.645267    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"} err="failed to get container status \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": rpc error: code = NotFound desc = could not find container \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": container with ID starting with 2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886 not found: ID does not exist"
Sep 17 15:42:05.645312 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.645291    2582 scope.go:117] "RemoveContainer" containerID="80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"
Sep 17 15:42:05.645715 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.645684    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"} err="failed to get container status \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": rpc error: code = NotFound desc = could not find container \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": container with ID starting with 80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38 not found: ID does not exist"
Sep 17 15:42:05.645819 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.645716    2582 scope.go:117] "RemoveContainer" containerID="18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"
Sep 17 15:42:05.646020 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.645997    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"} err="failed to get container status \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": rpc error: code = NotFound desc = could not find container \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": container with ID starting with 18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b not found: ID does not exist"
Sep 17 15:42:05.646103 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.646020    2582 scope.go:117] "RemoveContainer" containerID="c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"
Sep 17 15:42:05.646300 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.646279    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"} err="failed to get container status \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": rpc error: code = NotFound desc = could not find container \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": container with ID starting with c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9 not found: ID does not exist"
Sep 17 15:42:05.646413 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.646303    2582 scope.go:117] "RemoveContainer" containerID="32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"
Sep 17 15:42:05.646668 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.646608    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"} err="failed to get container status \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": rpc error: code = NotFound desc = could not find container \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": container with ID starting with 32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405 not found: ID does not exist"
Sep 17 15:42:05.646668 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.646646    2582 scope.go:117] "RemoveContainer" containerID="60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"
Sep 17 15:42:05.646919 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.646895    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d"} err="failed to get container status \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": rpc error: code = NotFound desc = could not find container \"60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d\": container with ID starting with 60b9ccad5a6af90da088130af44d58a2ed3e1c6610e99659c74ff597d2ff0f6d not found: ID does not exist"
Sep 17 15:42:05.646994 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.646919    2582 scope.go:117] "RemoveContainer" containerID="b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"
Sep 17 15:42:05.647249 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.647221    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d"} err="failed to get container status \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": rpc error: code = NotFound desc = could not find container \"b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d\": container with ID starting with b3428a299119780ab9d6442dc9f7d76450e188529fc730758f7456cfa410059d not found: ID does not exist"
Sep 17 15:42:05.647304 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.647250    2582 scope.go:117] "RemoveContainer" containerID="2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"
Sep 17 15:42:05.647619 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.647528    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886"} err="failed to get container status \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": rpc error: code = NotFound desc = could not find container \"2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886\": container with ID starting with 2bd6964065a012745d11f75c6b52eee1bc575693d738c4a2622973bc6945c886 not found: ID does not exist"
Sep 17 15:42:05.647619 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.647555    2582 scope.go:117] "RemoveContainer" containerID="80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"
Sep 17 15:42:05.647619 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.647559    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 15:42:05.647843 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.647821    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38"} err="failed to get container status \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": rpc error: code = NotFound desc = could not find container \"80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38\": container with ID starting with 80d03fe93f2f17abbc938faad907879d436170f8c2067f3d7c7f576057f39a38 not found: ID does not exist"
Sep 17 15:42:05.647902 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.647851    2582 scope.go:117] "RemoveContainer" containerID="18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"
Sep 17 15:42:05.648113 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.648090    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b"} err="failed to get container status \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": rpc error: code = NotFound desc = could not find container \"18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b\": container with ID starting with 18ed9209088e13a2e8bd4da18d3bcb42c8f15ba9c4d3ad8d877a1824598d087b not found: ID does not exist"
Sep 17 15:42:05.648173 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.648114    2582 scope.go:117] "RemoveContainer" containerID="c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"
Sep 17 15:42:05.648411 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.648389    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9"} err="failed to get container status \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": rpc error: code = NotFound desc = could not find container \"c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9\": container with ID starting with c2779269b055fef613ea2f49dc48c309543eb722c356e2519c35298fd16bf4c9 not found: ID does not exist"
Sep 17 15:42:05.648516 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.648412    2582 scope.go:117] "RemoveContainer" containerID="32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"
Sep 17 15:42:05.648726 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.648697    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405"} err="failed to get container status \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": rpc error: code = NotFound desc = could not find container \"32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405\": container with ID starting with 32ed21f6f40d480ea0bbc8a93cea4190189005abcf73ee3dd779acf3b96a3405 not found: ID does not exist"
Sep 17 15:42:05.650058 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.649902    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 15:42:05.651355 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.651333    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd535d5d-af07-478f-ae3b-32a7d8191765" path="/var/lib/kubelet/pods/bd535d5d-af07-478f-ae3b-32a7d8191765/volumes"
Sep 17 15:42:05.655481 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.655460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:42:05.729694 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/427eaec3-7379-4721-bf20-a13c1c9b743a-config-out\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.729694 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.729946 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-config\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.729946 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.729946 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.729946 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729780    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.729946 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729800    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn6vf\" (UniqueName: \"kubernetes.io/projected/427eaec3-7379-4721-bf20-a13c1c9b743a-kube-api-access-dn6vf\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.729946 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730179 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729939    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730179 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.729976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730179 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730179 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-web-config\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730319 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730319 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730319 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730319 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730319 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/427eaec3-7379-4721-bf20-a13c1c9b743a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730631 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730631 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.730631 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.730464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.831884 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.831775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/427eaec3-7379-4721-bf20-a13c1c9b743a-config-out\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.831884 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.831821    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.831884 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.831853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-config\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.831884 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.831878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.831904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.831928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.831957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn6vf\" (UniqueName: \"kubernetes.io/projected/427eaec3-7379-4721-bf20-a13c1c9b743a-kube-api-access-dn6vf\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-web-config\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/427eaec3-7379-4721-bf20-a13c1c9b743a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.832680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.833065 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.832933    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.834923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.834779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/427eaec3-7379-4721-bf20-a13c1c9b743a-config-out\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.834923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.835020    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-config\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.835307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.835163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.835307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.835177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.835307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.835284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.835307 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.835293    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.835582 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.835541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.835736 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.835710    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.835977 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.835957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.836109 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.835998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.836109 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.836048    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.836605 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.836581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.836711 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.836606    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/427eaec3-7379-4721-bf20-a13c1c9b743a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.837308 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.837289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-web-config\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.837588 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.837572    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/427eaec3-7379-4721-bf20-a13c1c9b743a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.837942 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.837923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.838094 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.838079    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/427eaec3-7379-4721-bf20-a13c1c9b743a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.841383 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.841367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn6vf\" (UniqueName: \"kubernetes.io/projected/427eaec3-7379-4721-bf20-a13c1c9b743a-kube-api-access-dn6vf\") pod \"prometheus-k8s-0\" (UID: \"427eaec3-7379-4721-bf20-a13c1c9b743a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:05.952696 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:05.952660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:42:06.234543 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:06.234394    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 15:42:06.237311 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:42:06.237282    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427eaec3_7379_4721_bf20_a13c1c9b743a.slice/crio-775e6b4ef43e7a8673f24c55f3f37589e17d3f63db781e9b50b1feab70849f88 WatchSource:0}: Error finding container 775e6b4ef43e7a8673f24c55f3f37589e17d3f63db781e9b50b1feab70849f88: Status 404 returned error can't find the container with id 775e6b4ef43e7a8673f24c55f3f37589e17d3f63db781e9b50b1feab70849f88
Sep 17 15:42:06.580447 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:06.580348    2582 generic.go:356] "Generic (PLEG): container finished" podID="427eaec3-7379-4721-bf20-a13c1c9b743a" containerID="78df1e94dd21ff6bca975d6cdc3a6d88f2afe1ca2ee47138d5192b16a6dc1a40" exitCode=0
Sep 17 15:42:06.580628 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:06.580445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"427eaec3-7379-4721-bf20-a13c1c9b743a","Type":"ContainerDied","Data":"78df1e94dd21ff6bca975d6cdc3a6d88f2afe1ca2ee47138d5192b16a6dc1a40"}
Sep 17 15:42:06.580628 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:06.580557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"427eaec3-7379-4721-bf20-a13c1c9b743a","Type":"ContainerStarted","Data":"775e6b4ef43e7a8673f24c55f3f37589e17d3f63db781e9b50b1feab70849f88"}
Sep 17 15:42:07.588826 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:07.588791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"427eaec3-7379-4721-bf20-a13c1c9b743a","Type":"ContainerStarted","Data":"453da533c8f9a96f09e66f1c513ca1a93054692338449f0fd8cdacc71ed511b8"}
Sep 17 15:42:07.589180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:07.588880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"427eaec3-7379-4721-bf20-a13c1c9b743a","Type":"ContainerStarted","Data":"64b27970d0fae396d2606328ce201cbc13fec085284ddc384101edaeeee6bb2b"}
Sep 17 15:42:07.589180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:07.588906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"427eaec3-7379-4721-bf20-a13c1c9b743a","Type":"ContainerStarted","Data":"754a0342293093a6992a327ee2737cd391271c07d1615e713f37f7de51ad80b0"}
Sep 17 15:42:07.589180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:07.588932    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"427eaec3-7379-4721-bf20-a13c1c9b743a","Type":"ContainerStarted","Data":"d02c7cc6369bacb90314c58e7125f60f66c578b0cfa91b2d6a5e366487fdc6c4"}
Sep 17 15:42:07.589180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:07.588956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"427eaec3-7379-4721-bf20-a13c1c9b743a","Type":"ContainerStarted","Data":"32693a1623000ff26e587322c2d84a8a1c4c7a3923582a2101865c2473fd85b4"}
Sep 17 15:42:07.589180 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:07.588980    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"427eaec3-7379-4721-bf20-a13c1c9b743a","Type":"ContainerStarted","Data":"eaf06099ffb8045a4f2d7257a3c96ea3e376970577c288dc40ae1fcef96d7b3b"}
Sep 17 15:42:07.623279 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:07.623218    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.606121876 podStartE2EDuration="2.623201393s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.079517ms" isStatefulPod=false podCreationTimestamp="2026-09-17 15:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:42:07.620812851 +0000 UTC m=+206.402500204" watchObservedRunningTime="2026-09-17 15:42:07.623201393 +0000 UTC m=+206.404888730"
Sep 17 15:42:10.953530 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:42:10.953471    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:43:05.953184 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:43:05.953095    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:43:05.968546 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:43:05.968514    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:43:06.828056 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:43:06.828026    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 15:43:41.599820 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:43:41.599792    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:43:41.600537 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:43:41.600520    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:43:41.610376 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:43:41.610351    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 15:46:38.931855 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:38.931820    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5jnmb"]
Sep 17 15:46:38.934414 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:38.934397    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:38.937547 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:38.937525    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 15:46:38.937681 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:38.937527    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2698s\""
Sep 17 15:46:38.942311 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:38.942293    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 15:46:38.952358 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:38.952333    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5jnmb"]
Sep 17 15:46:39.064614 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.064581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4eb1973-c679-45d3-ad4e-e3a564217796-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5jnmb\" (UID: \"e4eb1973-c679-45d3-ad4e-e3a564217796\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:39.064806 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.064643    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzl68\" (UniqueName: \"kubernetes.io/projected/e4eb1973-c679-45d3-ad4e-e3a564217796-kube-api-access-hzl68\") pod \"cert-manager-webhook-6486ffd997-5jnmb\" (UID: \"e4eb1973-c679-45d3-ad4e-e3a564217796\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:39.165123 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.165082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzl68\" (UniqueName: \"kubernetes.io/projected/e4eb1973-c679-45d3-ad4e-e3a564217796-kube-api-access-hzl68\") pod \"cert-manager-webhook-6486ffd997-5jnmb\" (UID: \"e4eb1973-c679-45d3-ad4e-e3a564217796\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:39.165308 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.165152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4eb1973-c679-45d3-ad4e-e3a564217796-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5jnmb\" (UID: \"e4eb1973-c679-45d3-ad4e-e3a564217796\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:39.182630 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.182557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4eb1973-c679-45d3-ad4e-e3a564217796-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5jnmb\" (UID: \"e4eb1973-c679-45d3-ad4e-e3a564217796\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:39.182630 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.182621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzl68\" (UniqueName: \"kubernetes.io/projected/e4eb1973-c679-45d3-ad4e-e3a564217796-kube-api-access-hzl68\") pod \"cert-manager-webhook-6486ffd997-5jnmb\" (UID: \"e4eb1973-c679-45d3-ad4e-e3a564217796\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:39.257256 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.257225    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:39.531367 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.531309    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5jnmb"]
Sep 17 15:46:39.533828 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:46:39.533798    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4eb1973_c679_45d3_ad4e_e3a564217796.slice/crio-e1158dc94e567eab62fbfaff5617398c8054141be7be4e17375b933390f0af3b WatchSource:0}: Error finding container e1158dc94e567eab62fbfaff5617398c8054141be7be4e17375b933390f0af3b: Status 404 returned error can't find the container with id e1158dc94e567eab62fbfaff5617398c8054141be7be4e17375b933390f0af3b
Sep 17 15:46:39.536213 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.536196    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 15:46:39.619277 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:39.619239    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb" event={"ID":"e4eb1973-c679-45d3-ad4e-e3a564217796","Type":"ContainerStarted","Data":"e1158dc94e567eab62fbfaff5617398c8054141be7be4e17375b933390f0af3b"}
Sep 17 15:46:43.639681 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:43.639643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb" event={"ID":"e4eb1973-c679-45d3-ad4e-e3a564217796","Type":"ContainerStarted","Data":"641b5fbc907fc1e9f8c698222abeedfdf9fea15feeaf8b25658b511743e14209"}
Sep 17 15:46:43.640091 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:43.639706    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:43.664030 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:43.663975    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb" podStartSLOduration=2.255602214 podStartE2EDuration="5.663959293s" totalImagesPullingTime="3.408357079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:46:43.662012201 +0000 UTC m=+482.443699542" watchObservedRunningTime="2026-09-17 15:46:43.663959293 +0000 UTC m=+482.445646631"
Sep 17 15:46:49.650385 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:49.650356    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5jnmb"
Sep 17 15:46:51.578676 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.578643    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m9dqm"]
Sep 17 15:46:51.581826 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.581806    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m9dqm"
Sep 17 15:46:51.584291 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.584262    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kzfrk\""
Sep 17 15:46:51.593406 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.593385    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m9dqm"]
Sep 17 15:46:51.771013 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.770974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg2zm\" (UniqueName: \"kubernetes.io/projected/11bc5c54-ab8f-49f1-b4d9-8419d5771208-kube-api-access-zg2zm\") pod \"cert-manager-55b4d954d5-m9dqm\" (UID: \"11bc5c54-ab8f-49f1-b4d9-8419d5771208\") " pod="cert-manager/cert-manager-55b4d954d5-m9dqm"
Sep 17 15:46:51.771201 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.771030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11bc5c54-ab8f-49f1-b4d9-8419d5771208-bound-sa-token\") pod \"cert-manager-55b4d954d5-m9dqm\" (UID: \"11bc5c54-ab8f-49f1-b4d9-8419d5771208\") " pod="cert-manager/cert-manager-55b4d954d5-m9dqm"
Sep 17 15:46:51.872234 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.872199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg2zm\" (UniqueName: \"kubernetes.io/projected/11bc5c54-ab8f-49f1-b4d9-8419d5771208-kube-api-access-zg2zm\") pod \"cert-manager-55b4d954d5-m9dqm\" (UID: \"11bc5c54-ab8f-49f1-b4d9-8419d5771208\") " pod="cert-manager/cert-manager-55b4d954d5-m9dqm"
Sep 17 15:46:51.872414 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.872242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11bc5c54-ab8f-49f1-b4d9-8419d5771208-bound-sa-token\") pod \"cert-manager-55b4d954d5-m9dqm\" (UID: \"11bc5c54-ab8f-49f1-b4d9-8419d5771208\") " pod="cert-manager/cert-manager-55b4d954d5-m9dqm"
Sep 17 15:46:51.881336 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.881296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11bc5c54-ab8f-49f1-b4d9-8419d5771208-bound-sa-token\") pod \"cert-manager-55b4d954d5-m9dqm\" (UID: \"11bc5c54-ab8f-49f1-b4d9-8419d5771208\") " pod="cert-manager/cert-manager-55b4d954d5-m9dqm"
Sep 17 15:46:51.881485 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.881469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg2zm\" (UniqueName: \"kubernetes.io/projected/11bc5c54-ab8f-49f1-b4d9-8419d5771208-kube-api-access-zg2zm\") pod \"cert-manager-55b4d954d5-m9dqm\" (UID: \"11bc5c54-ab8f-49f1-b4d9-8419d5771208\") " pod="cert-manager/cert-manager-55b4d954d5-m9dqm"
Sep 17 15:46:51.891284 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:51.891256    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m9dqm"
Sep 17 15:46:52.178613 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:52.178533    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m9dqm"]
Sep 17 15:46:52.182079 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:46:52.182053    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11bc5c54_ab8f_49f1_b4d9_8419d5771208.slice/crio-5291553e239de9e48de47d1d79964cc391b10166bf1e045036744b66ad9c6591 WatchSource:0}: Error finding container 5291553e239de9e48de47d1d79964cc391b10166bf1e045036744b66ad9c6591: Status 404 returned error can't find the container with id 5291553e239de9e48de47d1d79964cc391b10166bf1e045036744b66ad9c6591
Sep 17 15:46:52.680182 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:52.680147    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m9dqm" event={"ID":"11bc5c54-ab8f-49f1-b4d9-8419d5771208","Type":"ContainerStarted","Data":"a85f1350310b89d4951b5f25f14758d0cffaca64e48a5de9c0e04b09f08c36bd"}
Sep 17 15:46:52.680625 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:52.680191    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m9dqm" event={"ID":"11bc5c54-ab8f-49f1-b4d9-8419d5771208","Type":"ContainerStarted","Data":"5291553e239de9e48de47d1d79964cc391b10166bf1e045036744b66ad9c6591"}
Sep 17 15:46:52.705398 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:46:52.705335    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-m9dqm" podStartSLOduration=1.7053202029999999 podStartE2EDuration="1.705320203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:46:52.703018499 +0000 UTC m=+491.484705837" watchObservedRunningTime="2026-09-17 15:46:52.705320203 +0000 UTC m=+491.487007539"
Sep 17 15:47:24.673648 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.673592    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"]
Sep 17 15:47:24.680243 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.680224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.683738 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.683714    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 17 15:47:24.684216 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.684197    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 17 15:47:24.685359 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.685183    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 17 15:47:24.685359 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.685217    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 15:47:24.685359 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.685239    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 15:47:24.685359 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.685180    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k22bg\""
Sep 17 15:47:24.698648 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.698616    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"]
Sep 17 15:47:24.739631 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.739593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e94c4095-b900-4eb7-8859-94740a8aa4ca-cert\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.739631 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.739633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e94c4095-b900-4eb7-8859-94740a8aa4ca-metrics-cert\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.739838 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.739655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e94c4095-b900-4eb7-8859-94740a8aa4ca-manager-config\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.739838 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.739706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qj99\" (UniqueName: \"kubernetes.io/projected/e94c4095-b900-4eb7-8859-94740a8aa4ca-kube-api-access-9qj99\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.840738 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.840704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e94c4095-b900-4eb7-8859-94740a8aa4ca-cert\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.840738 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.840742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e94c4095-b900-4eb7-8859-94740a8aa4ca-metrics-cert\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.841005 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.840767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e94c4095-b900-4eb7-8859-94740a8aa4ca-manager-config\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.841005 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.840970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qj99\" (UniqueName: \"kubernetes.io/projected/e94c4095-b900-4eb7-8859-94740a8aa4ca-kube-api-access-9qj99\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.841566 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.841540    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e94c4095-b900-4eb7-8859-94740a8aa4ca-manager-config\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.843830 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.843803    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e94c4095-b900-4eb7-8859-94740a8aa4ca-cert\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.843953 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.843899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e94c4095-b900-4eb7-8859-94740a8aa4ca-metrics-cert\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.851008 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.850958    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qj99\" (UniqueName: \"kubernetes.io/projected/e94c4095-b900-4eb7-8859-94740a8aa4ca-kube-api-access-9qj99\") pod \"lws-controller-manager-65f7746b69-9kkmr\" (UID: \"e94c4095-b900-4eb7-8859-94740a8aa4ca\") " pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:24.991926 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:24.991834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:25.270364 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:25.270339    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"]
Sep 17 15:47:25.273086 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:47:25.273058    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94c4095_b900_4eb7_8859_94740a8aa4ca.slice/crio-09e22d566d15bad6b02deb01985ce7ac49dd403ec4e2533ff87a1e5ba646e2c5 WatchSource:0}: Error finding container 09e22d566d15bad6b02deb01985ce7ac49dd403ec4e2533ff87a1e5ba646e2c5: Status 404 returned error can't find the container with id 09e22d566d15bad6b02deb01985ce7ac49dd403ec4e2533ff87a1e5ba646e2c5
Sep 17 15:47:25.815406 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:25.815374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr" event={"ID":"e94c4095-b900-4eb7-8859-94740a8aa4ca","Type":"ContainerStarted","Data":"09e22d566d15bad6b02deb01985ce7ac49dd403ec4e2533ff87a1e5ba646e2c5"}
Sep 17 15:47:28.830020 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:28.829986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr" event={"ID":"e94c4095-b900-4eb7-8859-94740a8aa4ca","Type":"ContainerStarted","Data":"50016ce6474e004b6ab86a0590b96d4ffc7bffcda3dc20f61374f51b57d60269"}
Sep 17 15:47:28.830443 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:28.830042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:28.849642 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:28.849593    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr" podStartSLOduration=2.2137215279999998 podStartE2EDuration="4.849577958s" totalImagesPullingTime="2.63585643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:47:28.848521472 +0000 UTC m=+527.630208810" watchObservedRunningTime="2026-09-17 15:47:28.849577958 +0000 UTC m=+527.631265291"
Sep 17 15:47:39.836653 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:39.836571    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65f7746b69-9kkmr"
Sep 17 15:47:51.745734 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.745675    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"]
Sep 17 15:47:51.750750 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.750727    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"
Sep 17 15:47:51.754400 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.754373    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 17 15:47:51.754400 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.754393    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5rz7l\""
Sep 17 15:47:51.755524 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.755484    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 15:47:51.756119 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.756084    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 15:47:51.766298 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.766273    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"]
Sep 17 15:47:51.877358 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.877284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjfs7\" (UniqueName: \"kubernetes.io/projected/3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9-kube-api-access-zjfs7\") pod \"dns-operator-controller-manager-65dc8f76f5-69q8j\" (UID: \"3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"
Sep 17 15:47:51.940648 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.940617    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"]
Sep 17 15:47:51.943886 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.943857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:51.946459 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.946441    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 17 15:47:51.946766 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.946749    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 17 15:47:51.947590 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.947576    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w6hk6\""
Sep 17 15:47:51.954485 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.954460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"]
Sep 17 15:47:51.977875 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.977838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjfs7\" (UniqueName: \"kubernetes.io/projected/3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9-kube-api-access-zjfs7\") pod \"dns-operator-controller-manager-65dc8f76f5-69q8j\" (UID: \"3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"
Sep 17 15:47:51.986677 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:51.986648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjfs7\" (UniqueName: \"kubernetes.io/projected/3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9-kube-api-access-zjfs7\") pod \"dns-operator-controller-manager-65dc8f76f5-69q8j\" (UID: \"3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"
Sep 17 15:47:52.062715 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.062625    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"
Sep 17 15:47:52.078925 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.078898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45ceaaed-8076-40f4-8d73-6981a7000e33-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-lbsqr\" (UID: \"45ceaaed-8076-40f4-8d73-6981a7000e33\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.079028 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.078937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/45ceaaed-8076-40f4-8d73-6981a7000e33-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-lbsqr\" (UID: \"45ceaaed-8076-40f4-8d73-6981a7000e33\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.079028 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.078994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk2kc\" (UniqueName: \"kubernetes.io/projected/45ceaaed-8076-40f4-8d73-6981a7000e33-kube-api-access-lk2kc\") pod \"kuadrant-console-plugin-fbdd4f445-lbsqr\" (UID: \"45ceaaed-8076-40f4-8d73-6981a7000e33\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.180146 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.180100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk2kc\" (UniqueName: \"kubernetes.io/projected/45ceaaed-8076-40f4-8d73-6981a7000e33-kube-api-access-lk2kc\") pod \"kuadrant-console-plugin-fbdd4f445-lbsqr\" (UID: \"45ceaaed-8076-40f4-8d73-6981a7000e33\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.180356 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.180177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45ceaaed-8076-40f4-8d73-6981a7000e33-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-lbsqr\" (UID: \"45ceaaed-8076-40f4-8d73-6981a7000e33\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.180356 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.180209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/45ceaaed-8076-40f4-8d73-6981a7000e33-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-lbsqr\" (UID: \"45ceaaed-8076-40f4-8d73-6981a7000e33\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.180883 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.180858    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45ceaaed-8076-40f4-8d73-6981a7000e33-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-lbsqr\" (UID: \"45ceaaed-8076-40f4-8d73-6981a7000e33\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.182686 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.182665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/45ceaaed-8076-40f4-8d73-6981a7000e33-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-lbsqr\" (UID: \"45ceaaed-8076-40f4-8d73-6981a7000e33\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.192812 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.192782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk2kc\" (UniqueName: \"kubernetes.io/projected/45ceaaed-8076-40f4-8d73-6981a7000e33-kube-api-access-lk2kc\") pod \"kuadrant-console-plugin-fbdd4f445-lbsqr\" (UID: \"45ceaaed-8076-40f4-8d73-6981a7000e33\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.254268 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.254234    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"
Sep 17 15:47:52.335928 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.335903    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"]
Sep 17 15:47:52.338368 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:47:52.338339    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf06ac4_b8bd_4cc7_a03b_24e3d9a14bd9.slice/crio-f7597b115614cef551e74b73485f64d69a8e3ce8878e52bceae449389510da56 WatchSource:0}: Error finding container f7597b115614cef551e74b73485f64d69a8e3ce8878e52bceae449389510da56: Status 404 returned error can't find the container with id f7597b115614cef551e74b73485f64d69a8e3ce8878e52bceae449389510da56
Sep 17 15:47:52.529912 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.529887    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr"]
Sep 17 15:47:52.531891 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:47:52.531858    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45ceaaed_8076_40f4_8d73_6981a7000e33.slice/crio-762a2edaffdfb798a22d8de7ba972cef76579b7ccf5c655a13a7760986b21dca WatchSource:0}: Error finding container 762a2edaffdfb798a22d8de7ba972cef76579b7ccf5c655a13a7760986b21dca: Status 404 returned error can't find the container with id 762a2edaffdfb798a22d8de7ba972cef76579b7ccf5c655a13a7760986b21dca
Sep 17 15:47:52.927695 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.927658    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j" event={"ID":"3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9","Type":"ContainerStarted","Data":"f7597b115614cef551e74b73485f64d69a8e3ce8878e52bceae449389510da56"}
Sep 17 15:47:52.928892 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:52.928867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr" event={"ID":"45ceaaed-8076-40f4-8d73-6981a7000e33","Type":"ContainerStarted","Data":"762a2edaffdfb798a22d8de7ba972cef76579b7ccf5c655a13a7760986b21dca"}
Sep 17 15:47:57.960650 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:57.960617    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j" event={"ID":"3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9","Type":"ContainerStarted","Data":"df05ba362a5c9d8003b669f9ac426a0ca5b316db51af7fb097a763f3580b32e3"}
Sep 17 15:47:57.961011 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:57.960731    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"
Sep 17 15:47:57.980784 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:57.980741    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j" podStartSLOduration=1.491000029 podStartE2EDuration="6.980726465s" totalImagesPullingTime="5.489726436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:47:57.979587986 +0000 UTC m=+556.761275325" watchObservedRunningTime="2026-09-17 15:47:57.980726465 +0000 UTC m=+556.762413801"
Sep 17 15:47:58.966587 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:58.966549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr" event={"ID":"45ceaaed-8076-40f4-8d73-6981a7000e33","Type":"ContainerStarted","Data":"5ecf3dee1d7e06c0774b922547d8f7a2df2504f3f5c2f54182cc989e053ad58b"}
Sep 17 15:47:58.985036 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:47:58.984991    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-lbsqr" podStartSLOduration=2.606460181 podStartE2EDuration="7.984974886s" totalImagesPullingTime="5.378514705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:47:58.9838117 +0000 UTC m=+557.765499038" watchObservedRunningTime="2026-09-17 15:47:58.984974886 +0000 UTC m=+557.766662223"
Sep 17 15:48:08.969312 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:08.969282    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-69q8j"
Sep 17 15:48:32.798166 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:32.798130    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rnvjl"]
Sep 17 15:48:32.816240 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:32.816212    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:32.820569 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:32.820545    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 15:48:32.824994 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:32.824939    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rnvjl"]
Sep 17 15:48:32.895099 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:32.895066    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rnvjl"]
Sep 17 15:48:32.935561 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:32.935523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-config-file\") pod \"limitador-limitador-8588749977-rnvjl\" (UID: \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\") " pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:32.935756 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:32.935576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfwt2\" (UniqueName: \"kubernetes.io/projected/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-kube-api-access-xfwt2\") pod \"limitador-limitador-8588749977-rnvjl\" (UID: \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\") " pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:33.037028 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:33.036984    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-config-file\") pod \"limitador-limitador-8588749977-rnvjl\" (UID: \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\") " pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:33.037217 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:33.037040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfwt2\" (UniqueName: \"kubernetes.io/projected/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-kube-api-access-xfwt2\") pod \"limitador-limitador-8588749977-rnvjl\" (UID: \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\") " pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:33.037667 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:33.037648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-config-file\") pod \"limitador-limitador-8588749977-rnvjl\" (UID: \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\") " pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:33.046270 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:33.046246    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfwt2\" (UniqueName: \"kubernetes.io/projected/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-kube-api-access-xfwt2\") pod \"limitador-limitador-8588749977-rnvjl\" (UID: \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\") " pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:33.127539 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:33.127487    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:33.419119 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:33.419089    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rnvjl"]
Sep 17 15:48:33.421351 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:48:33.421320    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa68d60f_01ee_4b2c_8f6c_6dc5f77ba9ab.slice/crio-46832b0dbbcb7b846735992459b1e54a5b345b0c0889736553a76d61c1ecd23e WatchSource:0}: Error finding container 46832b0dbbcb7b846735992459b1e54a5b345b0c0889736553a76d61c1ecd23e: Status 404 returned error can't find the container with id 46832b0dbbcb7b846735992459b1e54a5b345b0c0889736553a76d61c1ecd23e
Sep 17 15:48:34.116646 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:34.116613    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl" event={"ID":"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab","Type":"ContainerStarted","Data":"46832b0dbbcb7b846735992459b1e54a5b345b0c0889736553a76d61c1ecd23e"}
Sep 17 15:48:35.122751 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:35.122715    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl" event={"ID":"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab","Type":"ContainerStarted","Data":"3c7e94ba21a43000d0c871167a7c9de7e90c088580e5589d30510e095edea926"}
Sep 17 15:48:35.123149 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:35.122812    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:35.141305 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:35.141252    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl" podStartSLOduration=1.544974895 podStartE2EDuration="3.14123619s" totalImagesPullingTime="1.596261295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:48:35.139144209 +0000 UTC m=+593.920831567" watchObservedRunningTime="2026-09-17 15:48:35.14123619 +0000 UTC m=+593.922923542"
Sep 17 15:48:41.634674 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:41.634641    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:48:41.635821 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:41.635800    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:48:46.129880 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:46.129853    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:46.667230 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:46.667192    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rnvjl"]
Sep 17 15:48:46.667459 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:46.667437    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl" podUID="fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab" containerName="limitador" containerID="cri-o://3c7e94ba21a43000d0c871167a7c9de7e90c088580e5589d30510e095edea926" gracePeriod=30
Sep 17 15:48:47.181660 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:47.181627    2582 generic.go:356] "Generic (PLEG): container finished" podID="fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab" containerID="3c7e94ba21a43000d0c871167a7c9de7e90c088580e5589d30510e095edea926" exitCode=0
Sep 17 15:48:47.182050 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:47.181704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl" event={"ID":"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab","Type":"ContainerDied","Data":"3c7e94ba21a43000d0c871167a7c9de7e90c088580e5589d30510e095edea926"}
Sep 17 15:48:47.209837 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:47.209806    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:47.261553 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:47.261448    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-config-file\") pod \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\" (UID: \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\") "
Sep 17 15:48:47.261553 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:47.261490    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfwt2\" (UniqueName: \"kubernetes.io/projected/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-kube-api-access-xfwt2\") pod \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\" (UID: \"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab\") "
Sep 17 15:48:47.261812 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:47.261789    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-config-file" (OuterVolumeSpecName: "config-file") pod "fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab" (UID: "fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:48:47.263816 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:47.263770    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-kube-api-access-xfwt2" (OuterVolumeSpecName: "kube-api-access-xfwt2") pod "fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab" (UID: "fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab"). InnerVolumeSpecName "kube-api-access-xfwt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:48:47.362923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:47.362882    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-config-file\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:48:47.362923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:47.362921    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfwt2\" (UniqueName: \"kubernetes.io/projected/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab-kube-api-access-xfwt2\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:48:48.188056 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:48.188023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl" event={"ID":"fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab","Type":"ContainerDied","Data":"46832b0dbbcb7b846735992459b1e54a5b345b0c0889736553a76d61c1ecd23e"}
Sep 17 15:48:48.188544 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:48.188081    2582 scope.go:117] "RemoveContainer" containerID="3c7e94ba21a43000d0c871167a7c9de7e90c088580e5589d30510e095edea926"
Sep 17 15:48:48.188544 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:48.188035    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-rnvjl"
Sep 17 15:48:48.204438 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:48.204411    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rnvjl"]
Sep 17 15:48:48.209082 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:48.209061    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-rnvjl"]
Sep 17 15:48:49.651642 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:48:49.651612    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab" path="/var/lib/kubelet/pods/fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab/volumes"
Sep 17 15:49:16.531361 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.531281    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"]
Sep 17 15:49:16.531852 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.531648    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab" containerName="limitador"
Sep 17 15:49:16.531852 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.531661    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab" containerName="limitador"
Sep 17 15:49:16.531852 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.531732    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa68d60f-01ee-4b2c-8f6c-6dc5f77ba9ab" containerName="limitador"
Sep 17 15:49:16.533662 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.533644    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.537454 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.537429    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 15:49:16.537621 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.537432    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 15:49:16.537621 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.537440    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 15:49:16.537621 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.537488    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 15:49:16.538389 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.538373    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 15:49:16.538563 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.538545    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 15:49:16.538616 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.538565    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lsm7w\""
Sep 17 15:49:16.552673 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.552650    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"]
Sep 17 15:49:16.620659 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.620630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.620814 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.620664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.620814 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.620689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b84ac7f-48e0-4feb-8753-3814ed307ae4-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.620814 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.620741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qxjw\" (UniqueName: \"kubernetes.io/projected/4b84ac7f-48e0-4feb-8753-3814ed307ae4-kube-api-access-4qxjw\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.620814 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.620792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b84ac7f-48e0-4feb-8753-3814ed307ae4-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.620814 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.620811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.620976 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.620827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.721388 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.721352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b84ac7f-48e0-4feb-8753-3814ed307ae4-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.721388 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.721389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.721657 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.721409    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.721657 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.721444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.721657 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.721472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.721657 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.721523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b84ac7f-48e0-4feb-8753-3814ed307ae4-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.721657 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.721558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qxjw\" (UniqueName: \"kubernetes.io/projected/4b84ac7f-48e0-4feb-8753-3814ed307ae4-kube-api-access-4qxjw\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.722256 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.722231    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.723833 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.723803    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.723950 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.723914    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.724151 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.724133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b84ac7f-48e0-4feb-8753-3814ed307ae4-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.724255 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.724234    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4b84ac7f-48e0-4feb-8753-3814ed307ae4-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.744999 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.744954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b84ac7f-48e0-4feb-8753-3814ed307ae4-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.749035 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.749004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qxjw\" (UniqueName: \"kubernetes.io/projected/4b84ac7f-48e0-4feb-8753-3814ed307ae4-kube-api-access-4qxjw\") pod \"istiod-openshift-gateway-5677ccb49b-jgqwq\" (UID: \"4b84ac7f-48e0-4feb-8753-3814ed307ae4\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:16.842759 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:16.842736    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:17.132119 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:17.132092    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"]
Sep 17 15:49:17.134201 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:49:17.134175    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b84ac7f_48e0_4feb_8753_3814ed307ae4.slice/crio-a4d4fb9c019be1687b27db129a2f6c6fdd1c6ed41274e7f69005e7940cc637cb WatchSource:0}: Error finding container a4d4fb9c019be1687b27db129a2f6c6fdd1c6ed41274e7f69005e7940cc637cb: Status 404 returned error can't find the container with id a4d4fb9c019be1687b27db129a2f6c6fdd1c6ed41274e7f69005e7940cc637cb
Sep 17 15:49:17.318130 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:17.318097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq" event={"ID":"4b84ac7f-48e0-4feb-8753-3814ed307ae4","Type":"ContainerStarted","Data":"a4d4fb9c019be1687b27db129a2f6c6fdd1c6ed41274e7f69005e7940cc637cb"}
Sep 17 15:49:19.346691 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:19.346643    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 15:49:19.346997 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:19.346715    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 15:49:20.335636 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:20.335600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq" event={"ID":"4b84ac7f-48e0-4feb-8753-3814ed307ae4","Type":"ContainerStarted","Data":"02d3369062fcfadeca3e796408cae2a538c5a29daf7a5095457f759432e6786c"}
Sep 17 15:49:20.335915 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:20.335758    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:20.337377 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:20.337355    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq"
Sep 17 15:49:20.357317 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:49:20.357268    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jgqwq" podStartSLOduration=2.147137343 podStartE2EDuration="4.357253756s" totalImagesPullingTime="2.210116413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:49:20.355711031 +0000 UTC m=+639.137398383" watchObservedRunningTime="2026-09-17 15:49:20.357253756 +0000 UTC m=+639.138941093"
Sep 17 15:53:41.668477 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:53:41.668446    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:53:41.669423 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:53:41.669405    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:57:21.325816 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.325779    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"]
Sep 17 15:57:21.329231 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.329205    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.332318 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.332291    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"openshift-gw-ca-root-cert\""
Sep 17 15:57:21.333290 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.333269    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"router-gateway-1-openshift-default-dockercfg-hqc9j\""
Sep 17 15:57:21.333657 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.333618    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"kube-root-ca.crt\""
Sep 17 15:57:21.333799 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.333779    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"openshift-service-ca.crt\""
Sep 17 15:57:21.360167 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.360132    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"]
Sep 17 15:57:21.474010 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.473975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.474010 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.474013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.474240 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.474035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.474240 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.474112    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.474240 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.474147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q9vf\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-kube-api-access-8q9vf\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.474240 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.474169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.474240 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.474230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.474419 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.474260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.474419 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.474309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.574914 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.574832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.574914 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.574897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575119 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.574934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575119 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.574963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575119 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575276 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q9vf\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-kube-api-access-8q9vf\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575276 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575276 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575220    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575276 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575464 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575344    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575464 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575408    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575620 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575598    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575680 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.575735 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.575717    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.577313 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.577296    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.577580 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.577563    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.587581 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.587556    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.587700 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.587638    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q9vf\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-kube-api-access-8q9vf\") pod \"router-gateway-1-openshift-default-7dcbd489bd-v59pz\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.640308 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.640267    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:21.924923 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.924897    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"]
Sep 17 15:57:21.927475 ip-10-0-139-98 kubenswrapper[2582]: W0917 15:57:21.927446    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aec9d67_ed77_4b9b_9bff_67af8d79d16e.slice/crio-1d7b14702fec8d4619a68f9bb47eb3380d4c0cc2875e01a8488bf89f8e5943de WatchSource:0}: Error finding container 1d7b14702fec8d4619a68f9bb47eb3380d4c0cc2875e01a8488bf89f8e5943de: Status 404 returned error can't find the container with id 1d7b14702fec8d4619a68f9bb47eb3380d4c0cc2875e01a8488bf89f8e5943de
Sep 17 15:57:21.929461 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:21.929442    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 15:57:22.463997 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:22.463946    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz" event={"ID":"6aec9d67-ed77-4b9b-9bff-67af8d79d16e","Type":"ContainerStarted","Data":"1d7b14702fec8d4619a68f9bb47eb3380d4c0cc2875e01a8488bf89f8e5943de"}
Sep 17 15:57:24.535074 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:24.535032    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 15:57:24.535398 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:24.535106    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 15:57:24.535398 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:24.535137    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 17 15:57:25.480848 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:25.480806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz" event={"ID":"6aec9d67-ed77-4b9b-9bff-67af8d79d16e","Type":"ContainerStarted","Data":"230528fab1efc6183422aee36f6098a818bcd10996c68714fd3ff2f72e6d1c86"}
Sep 17 15:57:25.532826 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:25.532747    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz" podStartSLOduration=1.927572238 podStartE2EDuration="4.532728823s" totalImagesPullingTime="2.605156585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 15:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 15:57:25.526106663 +0000 UTC m=+1124.307794000" watchObservedRunningTime="2026-09-17 15:57:25.532728823 +0000 UTC m=+1124.314416159"
Sep 17 15:57:25.640873 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:25.640834    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:25.652265 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:25.652238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:26.486495 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:26.486460    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:26.487682 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:26.487656    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:53.760678 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:53.760638    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"]
Sep 17 15:57:53.761158 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:53.760864    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz" podUID="6aec9d67-ed77-4b9b-9bff-67af8d79d16e" containerName="istio-proxy" containerID="cri-o://230528fab1efc6183422aee36f6098a818bcd10996c68714fd3ff2f72e6d1c86" gracePeriod=30
Sep 17 15:57:56.494813 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.494473    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz" podUID="6aec9d67-ed77-4b9b-9bff-67af8d79d16e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": read tcp 10.133.0.2:48454->10.133.0.30:15021: read: connection reset by peer"
Sep 17 15:57:56.631618 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.631571    2582 generic.go:356] "Generic (PLEG): container finished" podID="6aec9d67-ed77-4b9b-9bff-67af8d79d16e" containerID="230528fab1efc6183422aee36f6098a818bcd10996c68714fd3ff2f72e6d1c86" exitCode=0
Sep 17 15:57:56.631754 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.631641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz" event={"ID":"6aec9d67-ed77-4b9b-9bff-67af8d79d16e","Type":"ContainerDied","Data":"230528fab1efc6183422aee36f6098a818bcd10996c68714fd3ff2f72e6d1c86"}
Sep 17 15:57:56.715756 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.715726    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:56.807072 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807039    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istiod-ca-cert\") pod \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") "
Sep 17 15:57:56.807258 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807087    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-data\") pod \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") "
Sep 17 15:57:56.807258 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807124    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-socket\") pod \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") "
Sep 17 15:57:56.807258 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807149    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-credential-socket\") pod \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") "
Sep 17 15:57:56.807258 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807193    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-certs\") pod \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") "
Sep 17 15:57:56.807468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807261    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q9vf\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-kube-api-access-8q9vf\") pod \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") "
Sep 17 15:57:56.807468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-envoy\") pod \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") "
Sep 17 15:57:56.807468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807310    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-token\") pod \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") "
Sep 17 15:57:56.807468 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807407    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6aec9d67-ed77-4b9b-9bff-67af8d79d16e" (UID: "6aec9d67-ed77-4b9b-9bff-67af8d79d16e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:57:56.807703 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807471    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-podinfo\") pod \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\" (UID: \"6aec9d67-ed77-4b9b-9bff-67af8d79d16e\") "
Sep 17 15:57:56.807703 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807474    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6aec9d67-ed77-4b9b-9bff-67af8d79d16e" (UID: "6aec9d67-ed77-4b9b-9bff-67af8d79d16e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 15:57:56.807703 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807550    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6aec9d67-ed77-4b9b-9bff-67af8d79d16e" (UID: "6aec9d67-ed77-4b9b-9bff-67af8d79d16e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:57:56.807703 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807574    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6aec9d67-ed77-4b9b-9bff-67af8d79d16e" (UID: "6aec9d67-ed77-4b9b-9bff-67af8d79d16e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:57:56.807911 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807752    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6aec9d67-ed77-4b9b-9bff-67af8d79d16e" (UID: "6aec9d67-ed77-4b9b-9bff-67af8d79d16e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:57:56.807911 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807782    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istiod-ca-cert\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:57:56.807911 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807797    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-data\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:57:56.807911 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807805    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-socket\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:57:56.807911 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.807813    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-credential-socket\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:57:56.809777 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.809749    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6aec9d67-ed77-4b9b-9bff-67af8d79d16e" (UID: "6aec9d67-ed77-4b9b-9bff-67af8d79d16e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:57:56.809777 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.809766    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-kube-api-access-8q9vf" (OuterVolumeSpecName: "kube-api-access-8q9vf") pod "6aec9d67-ed77-4b9b-9bff-67af8d79d16e" (UID: "6aec9d67-ed77-4b9b-9bff-67af8d79d16e"). InnerVolumeSpecName "kube-api-access-8q9vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 15:57:56.809924 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.809776    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6aec9d67-ed77-4b9b-9bff-67af8d79d16e" (UID: "6aec9d67-ed77-4b9b-9bff-67af8d79d16e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 15:57:56.809924 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.809783    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6aec9d67-ed77-4b9b-9bff-67af8d79d16e" (UID: "6aec9d67-ed77-4b9b-9bff-67af8d79d16e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 15:57:56.909027 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.908986    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-workload-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:57:56.909027 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.909021    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q9vf\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-kube-api-access-8q9vf\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:57:56.909027 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.909033    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-envoy\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:57:56.909275 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.909046    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-token\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:57:56.909275 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:56.909057    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aec9d67-ed77-4b9b-9bff-67af8d79d16e-istio-podinfo\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 15:57:57.637129 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:57.637090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz" event={"ID":"6aec9d67-ed77-4b9b-9bff-67af8d79d16e","Type":"ContainerDied","Data":"1d7b14702fec8d4619a68f9bb47eb3380d4c0cc2875e01a8488bf89f8e5943de"}
Sep 17 15:57:57.637129 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:57.637118    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"
Sep 17 15:57:57.637731 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:57.637189    2582 scope.go:117] "RemoveContainer" containerID="230528fab1efc6183422aee36f6098a818bcd10996c68714fd3ff2f72e6d1c86"
Sep 17 15:57:57.678038 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:57.677998    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"]
Sep 17 15:57:57.683423 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:57.683386    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-v59pz"]
Sep 17 15:57:59.651171 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:57:59.651131    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aec9d67-ed77-4b9b-9bff-67af8d79d16e" path="/var/lib/kubelet/pods/6aec9d67-ed77-4b9b-9bff-67af8d79d16e/volumes"
Sep 17 15:58:41.699167 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:58:41.699135    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 15:58:41.699747 ip-10-0-139-98 kubenswrapper[2582]: I0917 15:58:41.699253    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:01:22.818051 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.817973    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"]
Sep 17 16:01:22.818438 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.818351    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aec9d67-ed77-4b9b-9bff-67af8d79d16e" containerName="istio-proxy"
Sep 17 16:01:22.818438 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.818365    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aec9d67-ed77-4b9b-9bff-67af8d79d16e" containerName="istio-proxy"
Sep 17 16:01:22.818438 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.818418    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aec9d67-ed77-4b9b-9bff-67af8d79d16e" containerName="istio-proxy"
Sep 17 16:01:22.821837 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.821815    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:22.824750 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.824724    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"seaweedfs-s3-creds\""
Sep 17 16:01:22.824858 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.824811    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"default-dockercfg-jrgx7\""
Sep 17 16:01:22.824946 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.824932    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"kube-root-ca.crt\""
Sep 17 16:01:22.825698 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.825682    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"openshift-service-ca.crt\""
Sep 17 16:01:22.826047 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.826028    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"tokenizer-clean-path-test-kserve-self-signed-certs\""
Sep 17 16:01:22.826047 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.826043    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-cf47448b\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:01:22.835514 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.835477    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"]
Sep 17 16:01:22.899723 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.899685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-kserve-provision-location\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:22.899723 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.899728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c70cd4d-679e-429e-9081-41120b6dd85f-tls-certs\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:22.899965 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.899766    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd4d-679e-429e-9081-41120b6dd85f-cabundle-cert\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:22.899965 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.899797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-dshm\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:22.899965 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.899832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-model-cache\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:22.899965 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.899864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-home\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:22.899965 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.899880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqjdn\" (UniqueName: \"kubernetes.io/projected/6c70cd4d-679e-429e-9081-41120b6dd85f-kube-api-access-jqjdn\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:22.899965 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:22.899899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-tmp-dir\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001077 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-model-cache\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001282 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-home\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001282 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqjdn\" (UniqueName: \"kubernetes.io/projected/6c70cd4d-679e-429e-9081-41120b6dd85f-kube-api-access-jqjdn\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001282 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-tmp-dir\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001453 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-kserve-provision-location\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001453 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c70cd4d-679e-429e-9081-41120b6dd85f-tls-certs\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001453 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001416    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-model-cache\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001453 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd4d-679e-429e-9081-41120b6dd85f-cabundle-cert\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001520    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-home\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-dshm\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001574    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-tmp-dir\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.001716 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.001678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-kserve-provision-location\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.002106 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.002079    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd4d-679e-429e-9081-41120b6dd85f-cabundle-cert\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.003634 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.003605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-dshm\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.003957 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.003936    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c70cd4d-679e-429e-9081-41120b6dd85f-tls-certs\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.009872 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.009853    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqjdn\" (UniqueName: \"kubernetes.io/projected/6c70cd4d-679e-429e-9081-41120b6dd85f-kube-api-access-jqjdn\") pod \"tokenizer-clean-path-test-kserve-644886d9cf-wj6wp\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") " pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.132636 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.132595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:23.414351 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.414325    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"]
Sep 17 16:01:23.416204 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:01:23.416175    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c70cd4d_679e_429e_9081_41120b6dd85f.slice/crio-aad5575e59d67b10b54f4f302bcceec19b052cb884877dbbb5a5c0b7d68a3367 WatchSource:0}: Error finding container aad5575e59d67b10b54f4f302bcceec19b052cb884877dbbb5a5c0b7d68a3367: Status 404 returned error can't find the container with id aad5575e59d67b10b54f4f302bcceec19b052cb884877dbbb5a5c0b7d68a3367
Sep 17 16:01:23.548754 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:23.548714    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" event={"ID":"6c70cd4d-679e-429e-9081-41120b6dd85f","Type":"ContainerStarted","Data":"aad5575e59d67b10b54f4f302bcceec19b052cb884877dbbb5a5c0b7d68a3367"}
Sep 17 16:01:28.576858 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:28.576823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" event={"ID":"6c70cd4d-679e-429e-9081-41120b6dd85f","Type":"ContainerStarted","Data":"d7627c250ca32c1a0b4be4958a0c5ea017f5a5bdcd4532ffbfbd844a55dc208d"}
Sep 17 16:01:30.586713 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:30.586683    2582 generic.go:356] "Generic (PLEG): container finished" podID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerID="d7627c250ca32c1a0b4be4958a0c5ea017f5a5bdcd4532ffbfbd844a55dc208d" exitCode=0
Sep 17 16:01:30.587069 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:30.586756    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" event={"ID":"6c70cd4d-679e-429e-9081-41120b6dd85f","Type":"ContainerDied","Data":"d7627c250ca32c1a0b4be4958a0c5ea017f5a5bdcd4532ffbfbd844a55dc208d"}
Sep 17 16:01:32.598837 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:32.598806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" event={"ID":"6c70cd4d-679e-429e-9081-41120b6dd85f","Type":"ContainerStarted","Data":"236a2f3d8efb4c2f14cffe658c6699df903e96f7e8442104436ac7faf92a361c"}
Sep 17 16:01:32.628371 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:32.628319    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" podStartSLOduration=2.263266123 podStartE2EDuration="10.628303775s" totalImagesPullingTime="6.146394846s" totalInitContainerRuntime="2.218642806s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:01:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:01:32.626958013 +0000 UTC m=+1371.408645350" watchObservedRunningTime="2026-09-17 16:01:32.628303775 +0000 UTC m=+1371.409991111"
Sep 17 16:01:33.133609 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:33.133573    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:33.133789 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:33.133635    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:33.146052 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:33.146029    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:33.614427 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:33.614395    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:01:58.607213 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.607179    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"]
Sep 17 16:01:58.620460 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.620434    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.623392 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.623365    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"auth-invalid-token-test-kserve-self-signed-certs\""
Sep 17 16:01:58.623670 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.623644    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"default-dockercfg-fbmzl\""
Sep 17 16:01:58.623791 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.623698    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"seaweedfs-s3-creds\""
Sep 17 16:01:58.623791 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.623718    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:01:58.623791 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.623727    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"kube-root-ca.crt\""
Sep 17 16:01:58.623791 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.623769    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6\"/\"openshift-service-ca.crt\""
Sep 17 16:01:58.632279 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.632253    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"]
Sep 17 16:01:58.735281 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.735245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-model-cache\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.735281 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.735277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27f737c1-86e8-4237-8f2b-5300ce06448d-tls-certs\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.735493 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.735297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/27f737c1-86e8-4237-8f2b-5300ce06448d-cabundle-cert\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.735493 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.735410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-home\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.735493 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.735442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-tmp-dir\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.735654 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.735546    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-kserve-provision-location\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.735654 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.735572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-dshm\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.735654 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.735596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnwlz\" (UniqueName: \"kubernetes.io/projected/27f737c1-86e8-4237-8f2b-5300ce06448d-kube-api-access-hnwlz\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836174 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836137    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnwlz\" (UniqueName: \"kubernetes.io/projected/27f737c1-86e8-4237-8f2b-5300ce06448d-kube-api-access-hnwlz\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836355 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-model-cache\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836355 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27f737c1-86e8-4237-8f2b-5300ce06448d-tls-certs\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836355 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/27f737c1-86e8-4237-8f2b-5300ce06448d-cabundle-cert\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836355 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-home\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836653 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-tmp-dir\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836653 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-kserve-provision-location\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836653 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-dshm\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836653 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-model-cache\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836868 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836849    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-tmp-dir\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.836921 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.836869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-kserve-provision-location\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.837058 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.837040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-home\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.837058 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.837050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/27f737c1-86e8-4237-8f2b-5300ce06448d-cabundle-cert\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.838804 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.838782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27f737c1-86e8-4237-8f2b-5300ce06448d-tls-certs\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.838916 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.838840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-dshm\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.850152 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.850124    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnwlz\" (UniqueName: \"kubernetes.io/projected/27f737c1-86e8-4237-8f2b-5300ce06448d-kube-api-access-hnwlz\") pod \"auth-invalid-token-test-kserve-7bfbc967dc-kpbhm\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") " pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:58.932183 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:58.932093    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:01:59.216064 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:59.215994    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"]
Sep 17 16:01:59.219144 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:01:59.219117    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f737c1_86e8_4237_8f2b_5300ce06448d.slice/crio-14ede90be4e678a3e0fc9ed19432bb6e1910333ca2d57cb5d045562d999bd2e0 WatchSource:0}: Error finding container 14ede90be4e678a3e0fc9ed19432bb6e1910333ca2d57cb5d045562d999bd2e0: Status 404 returned error can't find the container with id 14ede90be4e678a3e0fc9ed19432bb6e1910333ca2d57cb5d045562d999bd2e0
Sep 17 16:01:59.723799 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:59.723762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" event={"ID":"27f737c1-86e8-4237-8f2b-5300ce06448d","Type":"ContainerStarted","Data":"5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6"}
Sep 17 16:01:59.724290 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:01:59.723827    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" event={"ID":"27f737c1-86e8-4237-8f2b-5300ce06448d","Type":"ContainerStarted","Data":"14ede90be4e678a3e0fc9ed19432bb6e1910333ca2d57cb5d045562d999bd2e0"}
Sep 17 16:02:01.735634 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:01.735599    2582 generic.go:356] "Generic (PLEG): container finished" podID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerID="5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6" exitCode=0
Sep 17 16:02:01.736126 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:01.735640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" event={"ID":"27f737c1-86e8-4237-8f2b-5300ce06448d","Type":"ContainerDied","Data":"5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6"}
Sep 17 16:02:29.900452 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:29.900412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" event={"ID":"27f737c1-86e8-4237-8f2b-5300ce06448d","Type":"ContainerStarted","Data":"fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17"}
Sep 17 16:02:29.933286 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:29.933231    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:02:29.935731 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:29.935655    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podStartSLOduration=1.689207854 podStartE2EDuration="31.935634946s" totalImagesPullingTime="28.000050604s" totalInitContainerRuntime="2.246376488s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:02:29.934312371 +0000 UTC m=+1428.715999710" watchObservedRunningTime="2026-09-17 16:02:29.935634946 +0000 UTC m=+1428.717322294"
Sep 17 16:02:38.932860 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:38.932768    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:02:38.934577 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:38.934547    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:02:47.546089 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:47.546048    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"]
Sep 17 16:02:47.556891 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:02:47.556832    2582 log.go:32] "ExecSync cmd from runtime service failed" err=<
Sep 17 16:02:47.556891 ip-10-0-139-98 kubenswrapper[2582]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Sep 17 16:02:47.556891 ip-10-0-139-98 kubenswrapper[2582]:         , stdout: , stderr: , exit code -1
Sep 17 16:02:47.556891 ip-10-0-139-98 kubenswrapper[2582]:  > containerID="236a2f3d8efb4c2f14cffe658c6699df903e96f7e8442104436ac7faf92a361c" cmd=["/bin/sleep","15"]
Sep 17 16:02:47.557267 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:47.556923    2582 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" message="" err=<
Sep 17 16:02:47.557267 ip-10-0-139-98 kubenswrapper[2582]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Sep 17 16:02:47.557267 ip-10-0-139-98 kubenswrapper[2582]:         , stdout: , stderr: , exit code -1
Sep 17 16:02:47.557267 ip-10-0-139-98 kubenswrapper[2582]:  >
Sep 17 16:02:47.557267 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:02:47.556943    2582 kuberuntime_container.go:755] "PreStop hook failed" err=<
Sep 17 16:02:47.557267 ip-10-0-139-98 kubenswrapper[2582]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Sep 17 16:02:47.557267 ip-10-0-139-98 kubenswrapper[2582]:         , stdout: , stderr: , exit code -1
Sep 17 16:02:47.557267 ip-10-0-139-98 kubenswrapper[2582]:  > pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" podUID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerName="main" containerID="cri-o://236a2f3d8efb4c2f14cffe658c6699df903e96f7e8442104436ac7faf92a361c"
Sep 17 16:02:47.557267 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:47.557011    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" podUID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerName="main" containerID="cri-o://236a2f3d8efb4c2f14cffe658c6699df903e96f7e8442104436ac7faf92a361c" gracePeriod=60
Sep 17 16:02:47.603773 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:47.603723    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" podUID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.31:8000/health\": dial tcp 10.133.0.31:8000: connect: connection refused"
Sep 17 16:02:47.992887 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:47.992855    2582 generic.go:356] "Generic (PLEG): container finished" podID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerID="236a2f3d8efb4c2f14cffe658c6699df903e96f7e8442104436ac7faf92a361c" exitCode=0
Sep 17 16:02:47.993061 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:47.992926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" event={"ID":"6c70cd4d-679e-429e-9081-41120b6dd85f","Type":"ContainerDied","Data":"236a2f3d8efb4c2f14cffe658c6699df903e96f7e8442104436ac7faf92a361c"}
Sep 17 16:02:48.342253 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.342223    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:02:48.411032 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411001    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-model-cache\") pod \"6c70cd4d-679e-429e-9081-41120b6dd85f\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") "
Sep 17 16:02:48.411220 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411076    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c70cd4d-679e-429e-9081-41120b6dd85f-tls-certs\") pod \"6c70cd4d-679e-429e-9081-41120b6dd85f\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") "
Sep 17 16:02:48.411220 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411106    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqjdn\" (UniqueName: \"kubernetes.io/projected/6c70cd4d-679e-429e-9081-41120b6dd85f-kube-api-access-jqjdn\") pod \"6c70cd4d-679e-429e-9081-41120b6dd85f\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") "
Sep 17 16:02:48.411220 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411142    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-kserve-provision-location\") pod \"6c70cd4d-679e-429e-9081-41120b6dd85f\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") "
Sep 17 16:02:48.411220 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411164    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-home\") pod \"6c70cd4d-679e-429e-9081-41120b6dd85f\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") "
Sep 17 16:02:48.411220 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411222    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd4d-679e-429e-9081-41120b6dd85f-cabundle-cert\") pod \"6c70cd4d-679e-429e-9081-41120b6dd85f\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") "
Sep 17 16:02:48.411475 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411238    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-dshm\") pod \"6c70cd4d-679e-429e-9081-41120b6dd85f\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") "
Sep 17 16:02:48.411475 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-tmp-dir\") pod \"6c70cd4d-679e-429e-9081-41120b6dd85f\" (UID: \"6c70cd4d-679e-429e-9081-41120b6dd85f\") "
Sep 17 16:02:48.411475 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411293    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c70cd4d-679e-429e-9081-41120b6dd85f" (UID: "6c70cd4d-679e-429e-9081-41120b6dd85f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:02:48.411658 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411476    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c70cd4d-679e-429e-9081-41120b6dd85f" (UID: "6c70cd4d-679e-429e-9081-41120b6dd85f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:02:48.411658 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411596    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-tmp-dir\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:02:48.411658 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411613    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-model-cache\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:02:48.411835 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411812    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c70cd4d-679e-429e-9081-41120b6dd85f-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "6c70cd4d-679e-429e-9081-41120b6dd85f" (UID: "6c70cd4d-679e-429e-9081-41120b6dd85f"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:02:48.411889 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.411853    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-home" (OuterVolumeSpecName: "home") pod "6c70cd4d-679e-429e-9081-41120b6dd85f" (UID: "6c70cd4d-679e-429e-9081-41120b6dd85f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:02:48.413663 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.413634    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c70cd4d-679e-429e-9081-41120b6dd85f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c70cd4d-679e-429e-9081-41120b6dd85f" (UID: "6c70cd4d-679e-429e-9081-41120b6dd85f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:02:48.413915 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.413881    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-dshm" (OuterVolumeSpecName: "dshm") pod "6c70cd4d-679e-429e-9081-41120b6dd85f" (UID: "6c70cd4d-679e-429e-9081-41120b6dd85f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:02:48.413997 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.413972    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c70cd4d-679e-429e-9081-41120b6dd85f-kube-api-access-jqjdn" (OuterVolumeSpecName: "kube-api-access-jqjdn") pod "6c70cd4d-679e-429e-9081-41120b6dd85f" (UID: "6c70cd4d-679e-429e-9081-41120b6dd85f"). InnerVolumeSpecName "kube-api-access-jqjdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:02:48.430584 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.430543    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6c70cd4d-679e-429e-9081-41120b6dd85f" (UID: "6c70cd4d-679e-429e-9081-41120b6dd85f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:02:48.512728 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.512686    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-home\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:02:48.512728 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.512721    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c70cd4d-679e-429e-9081-41120b6dd85f-cabundle-cert\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:02:48.512728 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.512731    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-dshm\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:02:48.512728 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.512740    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c70cd4d-679e-429e-9081-41120b6dd85f-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:02:48.512997 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.512749    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqjdn\" (UniqueName: \"kubernetes.io/projected/6c70cd4d-679e-429e-9081-41120b6dd85f-kube-api-access-jqjdn\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:02:48.512997 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.512759    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c70cd4d-679e-429e-9081-41120b6dd85f-kserve-provision-location\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:02:48.933157 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.933109    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:02:48.998853 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.998819    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"
Sep 17 16:02:48.999024 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.998819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp" event={"ID":"6c70cd4d-679e-429e-9081-41120b6dd85f","Type":"ContainerDied","Data":"aad5575e59d67b10b54f4f302bcceec19b052cb884877dbbb5a5c0b7d68a3367"}
Sep 17 16:02:48.999024 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:48.998956    2582 scope.go:117] "RemoveContainer" containerID="236a2f3d8efb4c2f14cffe658c6699df903e96f7e8442104436ac7faf92a361c"
Sep 17 16:02:49.009788 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:49.009756    2582 scope.go:117] "RemoveContainer" containerID="d7627c250ca32c1a0b4be4958a0c5ea017f5a5bdcd4532ffbfbd844a55dc208d"
Sep 17 16:02:49.022381 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:49.022357    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"]
Sep 17 16:02:49.026626 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:49.026603    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-cf47448b/tokenizer-clean-path-test-kserve-644886d9cf-wj6wp"]
Sep 17 16:02:49.652086 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:49.652051    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c70cd4d-679e-429e-9081-41120b6dd85f" path="/var/lib/kubelet/pods/6c70cd4d-679e-429e-9081-41120b6dd85f/volumes"
Sep 17 16:02:58.933558 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:02:58.933494    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:03:08.933258 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:08.933211    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:03:18.932846 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:18.932801    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:03:28.933025 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:28.932980    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:03:38.933524 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:38.933456    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:03:41.730254 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:41.730221    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:03:41.731254 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:41.731229    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:03:48.933653 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:48.933600    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:03:51.522860 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.522817    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"]
Sep 17 16:03:51.523394 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.523370    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerName="storage-initializer"
Sep 17 16:03:51.523442 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.523400    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerName="storage-initializer"
Sep 17 16:03:51.523442 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.523426    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerName="main"
Sep 17 16:03:51.523442 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.523436    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerName="main"
Sep 17 16:03:51.523570 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.523552    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c70cd4d-679e-429e-9081-41120b6dd85f" containerName="main"
Sep 17 16:03:51.525988 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.525963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.529031 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.529011    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"openshift-service-ca.crt\""
Sep 17 16:03:51.529160 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.529034    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"kube-root-ca.crt\""
Sep 17 16:03:51.529160 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.529011    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"default-dockercfg-j7q5k\""
Sep 17 16:03:51.530038 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.530020    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"seaweedfs-s3-creds\""
Sep 17 16:03:51.530038 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.530032    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"tokenizer-migration-path-test-kserve-self-signed-certs\""
Sep 17 16:03:51.530198 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.530032    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-312caf2d\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:03:51.544644 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.544610    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"]
Sep 17 16:03:51.601897 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.601862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9x7p\" (UniqueName: \"kubernetes.io/projected/a76b84b3-03dc-43c3-9f08-a533b7043223-kube-api-access-w9x7p\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.602096 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.601906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-tmp-dir\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.602096 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.601964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-dshm\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.602096 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.602039    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-model-cache\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.602096 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.602060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a76b84b3-03dc-43c3-9f08-a533b7043223-cabundle-cert\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.602277 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.602164    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-home\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.602277 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.602228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76b84b3-03dc-43c3-9f08-a533b7043223-tls-certs\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.602277 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.602264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-kserve-provision-location\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703221 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-tmp-dir\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703221 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-dshm\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703481 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703273    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-model-cache\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703481 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a76b84b3-03dc-43c3-9f08-a533b7043223-cabundle-cert\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703661 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-home\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703721 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-tmp-dir\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703721 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703690    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76b84b3-03dc-43c3-9f08-a533b7043223-tls-certs\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703830 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-kserve-provision-location\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703830 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-model-cache\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.703830 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9x7p\" (UniqueName: \"kubernetes.io/projected/a76b84b3-03dc-43c3-9f08-a533b7043223-kube-api-access-w9x7p\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.704005 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.703982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-home\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.704303 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.704276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-kserve-provision-location\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.704381 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.704282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a76b84b3-03dc-43c3-9f08-a533b7043223-cabundle-cert\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.705695 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.705669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-dshm\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.706027 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.706009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76b84b3-03dc-43c3-9f08-a533b7043223-tls-certs\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.713908 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.713884    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9x7p\" (UniqueName: \"kubernetes.io/projected/a76b84b3-03dc-43c3-9f08-a533b7043223-kube-api-access-w9x7p\") pod \"tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") " pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:51.844453 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:51.844425    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:52.126452 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:52.126324    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"]
Sep 17 16:03:52.129440 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:03:52.129414    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76b84b3_03dc_43c3_9f08_a533b7043223.slice/crio-408b5165a8c6f05f5683ef3b9ca39e90b631993f1f086cc647a7ec41c29542ff WatchSource:0}: Error finding container 408b5165a8c6f05f5683ef3b9ca39e90b631993f1f086cc647a7ec41c29542ff: Status 404 returned error can't find the container with id 408b5165a8c6f05f5683ef3b9ca39e90b631993f1f086cc647a7ec41c29542ff
Sep 17 16:03:52.312788 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:52.312737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" event={"ID":"a76b84b3-03dc-43c3-9f08-a533b7043223","Type":"ContainerStarted","Data":"2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966"}
Sep 17 16:03:52.312985 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:52.312816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" event={"ID":"a76b84b3-03dc-43c3-9f08-a533b7043223","Type":"ContainerStarted","Data":"408b5165a8c6f05f5683ef3b9ca39e90b631993f1f086cc647a7ec41c29542ff"}
Sep 17 16:03:55.330516 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:55.330470    2582 generic.go:356] "Generic (PLEG): container finished" podID="a76b84b3-03dc-43c3-9f08-a533b7043223" containerID="2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966" exitCode=0
Sep 17 16:03:55.330898 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:55.330555    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" event={"ID":"a76b84b3-03dc-43c3-9f08-a533b7043223","Type":"ContainerDied","Data":"2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966"}
Sep 17 16:03:56.338274 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:56.338242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" event={"ID":"a76b84b3-03dc-43c3-9f08-a533b7043223","Type":"ContainerStarted","Data":"b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b"}
Sep 17 16:03:56.363799 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:56.363747    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" podStartSLOduration=2.958894118 podStartE2EDuration="5.36373148s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.404837362s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:03:56.361997654 +0000 UTC m=+1515.143685004" watchObservedRunningTime="2026-09-17 16:03:56.36373148 +0000 UTC m=+1515.145418825"
Sep 17 16:03:56.845104 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:56.845063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:03:58.932920 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:03:58.932864    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:04:01.845436 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:01.845388    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:04:01.859060 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:01.859029    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:04:02.381718 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:02.381685    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:04:08.933417 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:08.933316    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:04:18.933057 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:18.933011    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:04:28.942655 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:28.942623    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:04:28.950856 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:28.950827    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:04:43.692512 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:43.692464    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"]
Sep 17 16:04:45.644874 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:45.644841    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"]
Sep 17 16:04:45.655403 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:04:45.655361    2582 log.go:32] "ExecSync cmd from runtime service failed" err=<
Sep 17 16:04:45.655403 ip-10-0-139-98 kubenswrapper[2582]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Sep 17 16:04:45.655403 ip-10-0-139-98 kubenswrapper[2582]:         , stdout: , stderr: , exit code -1
Sep 17 16:04:45.655403 ip-10-0-139-98 kubenswrapper[2582]:  > containerID="b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b" cmd=["/bin/sleep","15"]
Sep 17 16:04:45.655689 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:45.655411    2582 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" message="" err=<
Sep 17 16:04:45.655689 ip-10-0-139-98 kubenswrapper[2582]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Sep 17 16:04:45.655689 ip-10-0-139-98 kubenswrapper[2582]:         , stdout: , stderr: , exit code -1
Sep 17 16:04:45.655689 ip-10-0-139-98 kubenswrapper[2582]:  >
Sep 17 16:04:45.655689 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:04:45.655424    2582 kuberuntime_container.go:755] "PreStop hook failed" err=<
Sep 17 16:04:45.655689 ip-10-0-139-98 kubenswrapper[2582]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Sep 17 16:04:45.655689 ip-10-0-139-98 kubenswrapper[2582]:         , stdout: , stderr: , exit code -1
Sep 17 16:04:45.655689 ip-10-0-139-98 kubenswrapper[2582]:  > pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" podUID="a76b84b3-03dc-43c3-9f08-a533b7043223" containerName="main" containerID="cri-o://b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b"
Sep 17 16:04:45.655689 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:45.655458    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" podUID="a76b84b3-03dc-43c3-9f08-a533b7043223" containerName="main" containerID="cri-o://b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b" gracePeriod=60
Sep 17 16:04:46.009657 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.009628    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:04:46.088084 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088046    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a76b84b3-03dc-43c3-9f08-a533b7043223-cabundle-cert\") pod \"a76b84b3-03dc-43c3-9f08-a533b7043223\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") "
Sep 17 16:04:46.088254 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088095    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-kserve-provision-location\") pod \"a76b84b3-03dc-43c3-9f08-a533b7043223\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") "
Sep 17 16:04:46.088254 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088117    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-model-cache\") pod \"a76b84b3-03dc-43c3-9f08-a533b7043223\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") "
Sep 17 16:04:46.088254 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088146    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76b84b3-03dc-43c3-9f08-a533b7043223-tls-certs\") pod \"a76b84b3-03dc-43c3-9f08-a533b7043223\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") "
Sep 17 16:04:46.088374 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088346    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-home\") pod \"a76b84b3-03dc-43c3-9f08-a533b7043223\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") "
Sep 17 16:04:46.088436 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088408    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-model-cache" (OuterVolumeSpecName: "model-cache") pod "a76b84b3-03dc-43c3-9f08-a533b7043223" (UID: "a76b84b3-03dc-43c3-9f08-a533b7043223"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:46.088521 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088437    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-dshm\") pod \"a76b84b3-03dc-43c3-9f08-a533b7043223\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") "
Sep 17 16:04:46.088521 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088468    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-tmp-dir\") pod \"a76b84b3-03dc-43c3-9f08-a533b7043223\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") "
Sep 17 16:04:46.088639 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088492    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a76b84b3-03dc-43c3-9f08-a533b7043223-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "a76b84b3-03dc-43c3-9f08-a533b7043223" (UID: "a76b84b3-03dc-43c3-9f08-a533b7043223"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:04:46.088639 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088531    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9x7p\" (UniqueName: \"kubernetes.io/projected/a76b84b3-03dc-43c3-9f08-a533b7043223-kube-api-access-w9x7p\") pod \"a76b84b3-03dc-43c3-9f08-a533b7043223\" (UID: \"a76b84b3-03dc-43c3-9f08-a533b7043223\") "
Sep 17 16:04:46.088741 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088642    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-home" (OuterVolumeSpecName: "home") pod "a76b84b3-03dc-43c3-9f08-a533b7043223" (UID: "a76b84b3-03dc-43c3-9f08-a533b7043223"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:46.088795 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088761    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a76b84b3-03dc-43c3-9f08-a533b7043223" (UID: "a76b84b3-03dc-43c3-9f08-a533b7043223"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:46.088869 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088849    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/a76b84b3-03dc-43c3-9f08-a533b7043223-cabundle-cert\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:46.088925 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088875    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-model-cache\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:46.088925 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088889    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-home\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:46.088925 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.088902    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-tmp-dir\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:46.090424 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.090401    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a76b84b3-03dc-43c3-9f08-a533b7043223-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a76b84b3-03dc-43c3-9f08-a533b7043223" (UID: "a76b84b3-03dc-43c3-9f08-a533b7043223"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:04:46.090570 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.090550    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a76b84b3-03dc-43c3-9f08-a533b7043223-kube-api-access-w9x7p" (OuterVolumeSpecName: "kube-api-access-w9x7p") pod "a76b84b3-03dc-43c3-9f08-a533b7043223" (UID: "a76b84b3-03dc-43c3-9f08-a533b7043223"). InnerVolumeSpecName "kube-api-access-w9x7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:04:46.090945 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.090918    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-dshm" (OuterVolumeSpecName: "dshm") pod "a76b84b3-03dc-43c3-9f08-a533b7043223" (UID: "a76b84b3-03dc-43c3-9f08-a533b7043223"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:46.107743 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.107708    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a76b84b3-03dc-43c3-9f08-a533b7043223" (UID: "a76b84b3-03dc-43c3-9f08-a533b7043223"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:46.189367 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.189275    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-dshm\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:46.189367 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.189308    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9x7p\" (UniqueName: \"kubernetes.io/projected/a76b84b3-03dc-43c3-9f08-a533b7043223-kube-api-access-w9x7p\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:46.189367 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.189318    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a76b84b3-03dc-43c3-9f08-a533b7043223-kserve-provision-location\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:46.189367 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.189328    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a76b84b3-03dc-43c3-9f08-a533b7043223-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:46.588606 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.588566    2582 generic.go:356] "Generic (PLEG): container finished" podID="a76b84b3-03dc-43c3-9f08-a533b7043223" containerID="b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b" exitCode=0
Sep 17 16:04:46.588777 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.588619    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"
Sep 17 16:04:46.588777 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.588631    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" event={"ID":"a76b84b3-03dc-43c3-9f08-a533b7043223","Type":"ContainerDied","Data":"b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b"}
Sep 17 16:04:46.588777 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.588708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p" event={"ID":"a76b84b3-03dc-43c3-9f08-a533b7043223","Type":"ContainerDied","Data":"408b5165a8c6f05f5683ef3b9ca39e90b631993f1f086cc647a7ec41c29542ff"}
Sep 17 16:04:46.588777 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.588731    2582 scope.go:117] "RemoveContainer" containerID="b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b"
Sep 17 16:04:46.598690 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.598667    2582 scope.go:117] "RemoveContainer" containerID="2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966"
Sep 17 16:04:46.607051 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.607030    2582 scope.go:117] "RemoveContainer" containerID="b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b"
Sep 17 16:04:46.607391 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:04:46.607368    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b\": container with ID starting with b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b not found: ID does not exist" containerID="b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b"
Sep 17 16:04:46.607493 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.607399    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b"} err="failed to get container status \"b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b\": rpc error: code = NotFound desc = could not find container \"b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b\": container with ID starting with b54b5c85e58eddf8d6e7c8d45abb19fdc473233a78cce1491f9519f840101c5b not found: ID does not exist"
Sep 17 16:04:46.607493 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.607419    2582 scope.go:117] "RemoveContainer" containerID="2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966"
Sep 17 16:04:46.607726 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:04:46.607708    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966\": container with ID starting with 2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966 not found: ID does not exist" containerID="2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966"
Sep 17 16:04:46.607776 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.607733    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966"} err="failed to get container status \"2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966\": rpc error: code = NotFound desc = could not find container \"2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966\": container with ID starting with 2d598fcb9565abab9aef85a9bc5b8cd02cab9c7a9ce1102f9742c3b24e383966 not found: ID does not exist"
Sep 17 16:04:46.611996 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.611969    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"]
Sep 17 16:04:46.616708 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:46.616681    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-312caf2d/tokenizer-migration-path-test-kserve-5994fd5b86-lnw5p"]
Sep 17 16:04:47.651706 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:47.651671    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a76b84b3-03dc-43c3-9f08-a533b7043223" path="/var/lib/kubelet/pods/a76b84b3-03dc-43c3-9f08-a533b7043223/volumes"
Sep 17 16:04:58.715676 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:58.715637    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" containerID="cri-o://fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17" gracePeriod=45
Sep 17 16:04:58.943327 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:58.943274    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.32:8000/health\": dial tcp 10.133.0.32:8000: connect: connection refused"
Sep 17 16:04:59.458168 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.458136    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:04:59.509921 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.509848    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-dshm\") pod \"27f737c1-86e8-4237-8f2b-5300ce06448d\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") "
Sep 17 16:04:59.509921 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.509898    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/27f737c1-86e8-4237-8f2b-5300ce06448d-cabundle-cert\") pod \"27f737c1-86e8-4237-8f2b-5300ce06448d\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") "
Sep 17 16:04:59.510129 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.509930    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-kserve-provision-location\") pod \"27f737c1-86e8-4237-8f2b-5300ce06448d\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") "
Sep 17 16:04:59.510129 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.509948    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnwlz\" (UniqueName: \"kubernetes.io/projected/27f737c1-86e8-4237-8f2b-5300ce06448d-kube-api-access-hnwlz\") pod \"27f737c1-86e8-4237-8f2b-5300ce06448d\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") "
Sep 17 16:04:59.510129 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.509972    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-tmp-dir\") pod \"27f737c1-86e8-4237-8f2b-5300ce06448d\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") "
Sep 17 16:04:59.510129 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.510007    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27f737c1-86e8-4237-8f2b-5300ce06448d-tls-certs\") pod \"27f737c1-86e8-4237-8f2b-5300ce06448d\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") "
Sep 17 16:04:59.510129 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.510088    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-model-cache\") pod \"27f737c1-86e8-4237-8f2b-5300ce06448d\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") "
Sep 17 16:04:59.510129 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.510117    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-home\") pod \"27f737c1-86e8-4237-8f2b-5300ce06448d\" (UID: \"27f737c1-86e8-4237-8f2b-5300ce06448d\") "
Sep 17 16:04:59.510431 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.510366    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f737c1-86e8-4237-8f2b-5300ce06448d-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "27f737c1-86e8-4237-8f2b-5300ce06448d" (UID: "27f737c1-86e8-4237-8f2b-5300ce06448d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:04:59.510583 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.510562    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-model-cache" (OuterVolumeSpecName: "model-cache") pod "27f737c1-86e8-4237-8f2b-5300ce06448d" (UID: "27f737c1-86e8-4237-8f2b-5300ce06448d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:59.511006 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.510984    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-home" (OuterVolumeSpecName: "home") pod "27f737c1-86e8-4237-8f2b-5300ce06448d" (UID: "27f737c1-86e8-4237-8f2b-5300ce06448d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:59.512657 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.512629    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-dshm" (OuterVolumeSpecName: "dshm") pod "27f737c1-86e8-4237-8f2b-5300ce06448d" (UID: "27f737c1-86e8-4237-8f2b-5300ce06448d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:59.512767 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.512662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27f737c1-86e8-4237-8f2b-5300ce06448d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27f737c1-86e8-4237-8f2b-5300ce06448d" (UID: "27f737c1-86e8-4237-8f2b-5300ce06448d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:04:59.512833 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.512783    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f737c1-86e8-4237-8f2b-5300ce06448d-kube-api-access-hnwlz" (OuterVolumeSpecName: "kube-api-access-hnwlz") pod "27f737c1-86e8-4237-8f2b-5300ce06448d" (UID: "27f737c1-86e8-4237-8f2b-5300ce06448d"). InnerVolumeSpecName "kube-api-access-hnwlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:04:59.528204 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.528175    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "27f737c1-86e8-4237-8f2b-5300ce06448d" (UID: "27f737c1-86e8-4237-8f2b-5300ce06448d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:59.530899 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.530874    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "27f737c1-86e8-4237-8f2b-5300ce06448d" (UID: "27f737c1-86e8-4237-8f2b-5300ce06448d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:04:59.611305 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.611267    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-model-cache\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:59.611305 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.611298    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-home\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:59.611305 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.611306    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-dshm\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:59.611305 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.611314    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/27f737c1-86e8-4237-8f2b-5300ce06448d-cabundle-cert\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:59.611595 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.611323    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-kserve-provision-location\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:59.611595 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.611333    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnwlz\" (UniqueName: \"kubernetes.io/projected/27f737c1-86e8-4237-8f2b-5300ce06448d-kube-api-access-hnwlz\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:59.611595 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.611343    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27f737c1-86e8-4237-8f2b-5300ce06448d-tmp-dir\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:59.611595 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.611351    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27f737c1-86e8-4237-8f2b-5300ce06448d-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:04:59.652874 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.652834    2582 generic.go:356] "Generic (PLEG): container finished" podID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerID="fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17" exitCode=0
Sep 17 16:04:59.652874 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.652870    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"
Sep 17 16:04:59.653081 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.652903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" event={"ID":"27f737c1-86e8-4237-8f2b-5300ce06448d","Type":"ContainerDied","Data":"fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17"}
Sep 17 16:04:59.653081 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.652950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm" event={"ID":"27f737c1-86e8-4237-8f2b-5300ce06448d","Type":"ContainerDied","Data":"14ede90be4e678a3e0fc9ed19432bb6e1910333ca2d57cb5d045562d999bd2e0"}
Sep 17 16:04:59.653081 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.652971    2582 scope.go:117] "RemoveContainer" containerID="fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17"
Sep 17 16:04:59.662529 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.662510    2582 scope.go:117] "RemoveContainer" containerID="5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6"
Sep 17 16:04:59.670372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.670351    2582 scope.go:117] "RemoveContainer" containerID="fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17"
Sep 17 16:04:59.670669 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:04:59.670650    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17\": container with ID starting with fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17 not found: ID does not exist" containerID="fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17"
Sep 17 16:04:59.670744 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.670680    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17"} err="failed to get container status \"fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17\": rpc error: code = NotFound desc = could not find container \"fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17\": container with ID starting with fadc4163ef27737b833a42c06fe20045b929d0980970087f2abd761f9a891a17 not found: ID does not exist"
Sep 17 16:04:59.670744 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.670705    2582 scope.go:117] "RemoveContainer" containerID="5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6"
Sep 17 16:04:59.670974 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:04:59.670956    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6\": container with ID starting with 5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6 not found: ID does not exist" containerID="5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6"
Sep 17 16:04:59.671027 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.670982    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6"} err="failed to get container status \"5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6\": rpc error: code = NotFound desc = could not find container \"5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6\": container with ID starting with 5986da3c93a8f7316038aaac10928d6eb6a1a3bc25f9851341db2ff2b6accba6 not found: ID does not exist"
Sep 17 16:04:59.695587 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.695555    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"]
Sep 17 16:04:59.698906 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:04:59.698876    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-auth-invalid-token-rejected-e7cfa2c6/auth-invalid-token-test-kserve-7bfbc967dc-kpbhm"]
Sep 17 16:05:01.651069 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:05:01.651037    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" path="/var/lib/kubelet/pods/27f737c1-86e8-4237-8f2b-5300ce06448d/volumes"
Sep 17 16:06:24.291161 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291129    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"]
Sep 17 16:06:24.291623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291490    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a76b84b3-03dc-43c3-9f08-a533b7043223" containerName="main"
Sep 17 16:06:24.291623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291515    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76b84b3-03dc-43c3-9f08-a533b7043223" containerName="main"
Sep 17 16:06:24.291623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291528    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main"
Sep 17 16:06:24.291623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291534    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main"
Sep 17 16:06:24.291623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291547    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="storage-initializer"
Sep 17 16:06:24.291623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291556    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="storage-initializer"
Sep 17 16:06:24.291623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291567    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a76b84b3-03dc-43c3-9f08-a533b7043223" containerName="storage-initializer"
Sep 17 16:06:24.291623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291573    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a76b84b3-03dc-43c3-9f08-a533b7043223" containerName="storage-initializer"
Sep 17 16:06:24.291623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291626    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a76b84b3-03dc-43c3-9f08-a533b7043223" containerName="main"
Sep 17 16:06:24.291910 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.291642    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="27f737c1-86e8-4237-8f2b-5300ce06448d" containerName="main"
Sep 17 16:06:24.294774 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.294757    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.297761 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.297732    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"seaweedfs-s3-creds\""
Sep 17 16:06:24.297905 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.297733    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"openshift-service-ca.crt\""
Sep 17 16:06:24.297905 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.297884    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:06:24.298134 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.298113    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"kube-root-ca.crt\""
Sep 17 16:06:24.299081 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.299062    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"default-dockercfg-fcrqx\""
Sep 17 16:06:24.301299 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.301278    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-kserve-self-signed-certs\""
Sep 17 16:06:24.307350 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.307326    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"]
Sep 17 16:06:24.350355 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.350320    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-home\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.350355 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.350356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-kserve-provision-location\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.350638 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.350383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-dshm\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.350638 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.350416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-tmp-dir\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.350638 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.350432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9e1aefc-5b18-477a-babe-e339d2692e8b-cabundle-cert\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.350638 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.350449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-model-cache\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.350638 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.350472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48wgz\" (UniqueName: \"kubernetes.io/projected/d9e1aefc-5b18-477a-babe-e339d2692e8b-kube-api-access-48wgz\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.350638 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.350489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1aefc-5b18-477a-babe-e339d2692e8b-tls-certs\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451340 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-home\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451340 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451344    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-kserve-provision-location\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451987 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451374    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-dshm\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451987 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-tmp-dir\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451987 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9e1aefc-5b18-477a-babe-e339d2692e8b-cabundle-cert\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451987 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-model-cache\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451987 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wgz\" (UniqueName: \"kubernetes.io/projected/d9e1aefc-5b18-477a-babe-e339d2692e8b-kube-api-access-48wgz\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451987 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1aefc-5b18-477a-babe-e339d2692e8b-tls-certs\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451987 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451777    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-kserve-provision-location\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451987 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-home\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.451987 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.451928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-model-cache\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.452298 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.452004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-tmp-dir\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.452298 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.452154    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9e1aefc-5b18-477a-babe-e339d2692e8b-cabundle-cert\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.453897 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.453871    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-dshm\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.454070 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.454052    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1aefc-5b18-477a-babe-e339d2692e8b-tls-certs\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.461018 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.460990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48wgz\" (UniqueName: \"kubernetes.io/projected/d9e1aefc-5b18-477a-babe-e339d2692e8b-kube-api-access-48wgz\") pod \"tokenizer-template-args-test-kserve-6dd775764b-pqns2\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.561378 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.561289    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"]
Sep 17 16:06:24.565888 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.565860    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:06:24.568522 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.568473    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-0eb24714\"/\"tokenizer-template-args-test-epp-sa-dockercfg-qfzvm\""
Sep 17 16:06:24.577586 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.577554    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"]
Sep 17 16:06:24.605570 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.605532    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:24.654023 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.653984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31ac52b8-d5e1-455a-80e6-36d853bff2c8-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl\" (UID: \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:06:24.654646 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.654321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np5v7\" (UniqueName: \"kubernetes.io/projected/31ac52b8-d5e1-455a-80e6-36d853bff2c8-kube-api-access-np5v7\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl\" (UID: \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:06:24.755117 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.755082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31ac52b8-d5e1-455a-80e6-36d853bff2c8-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl\" (UID: \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:06:24.755117 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.755122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np5v7\" (UniqueName: \"kubernetes.io/projected/31ac52b8-d5e1-455a-80e6-36d853bff2c8-kube-api-access-np5v7\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl\" (UID: \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:06:24.757699 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.757676    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31ac52b8-d5e1-455a-80e6-36d853bff2c8-tls-certs\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl\" (UID: \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:06:24.764019 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.763982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np5v7\" (UniqueName: \"kubernetes.io/projected/31ac52b8-d5e1-455a-80e6-36d853bff2c8-kube-api-access-np5v7\") pod \"tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl\" (UID: \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\") " pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:06:24.878855 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.878813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:06:24.884575 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:24.884547    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"]
Sep 17 16:06:24.889584 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:06:24.889558    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e1aefc_5b18_477a_babe_e339d2692e8b.slice/crio-0f72742d07328d6a735a9c61ccf5b5f5c18e38348f4f743115a7830d74b94eb6 WatchSource:0}: Error finding container 0f72742d07328d6a735a9c61ccf5b5f5c18e38348f4f743115a7830d74b94eb6: Status 404 returned error can't find the container with id 0f72742d07328d6a735a9c61ccf5b5f5c18e38348f4f743115a7830d74b94eb6
Sep 17 16:06:25.053158 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:25.053115    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" event={"ID":"d9e1aefc-5b18-477a-babe-e339d2692e8b","Type":"ContainerStarted","Data":"8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7"}
Sep 17 16:06:25.053360 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:25.053199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" event={"ID":"d9e1aefc-5b18-477a-babe-e339d2692e8b","Type":"ContainerStarted","Data":"0f72742d07328d6a735a9c61ccf5b5f5c18e38348f4f743115a7830d74b94eb6"}
Sep 17 16:06:25.156356 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:25.156235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"]
Sep 17 16:06:25.159311 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:06:25.159271    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ac52b8_d5e1_455a_80e6_36d853bff2c8.slice/crio-2a6a7d0d9479fa2a070daa2f4c174eee744556d5c037588733bff530db21e71f WatchSource:0}: Error finding container 2a6a7d0d9479fa2a070daa2f4c174eee744556d5c037588733bff530db21e71f: Status 404 returned error can't find the container with id 2a6a7d0d9479fa2a070daa2f4c174eee744556d5c037588733bff530db21e71f
Sep 17 16:06:25.161366 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:25.161349    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:06:26.058809 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:26.058772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" event={"ID":"31ac52b8-d5e1-455a-80e6-36d853bff2c8","Type":"ContainerStarted","Data":"2a6a7d0d9479fa2a070daa2f4c174eee744556d5c037588733bff530db21e71f"}
Sep 17 16:06:28.071001 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:28.070902    2582 generic.go:356] "Generic (PLEG): container finished" podID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerID="8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7" exitCode=0
Sep 17 16:06:28.071001 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:28.070978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" event={"ID":"d9e1aefc-5b18-477a-babe-e339d2692e8b","Type":"ContainerDied","Data":"8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7"}
Sep 17 16:06:29.076898 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:29.076855    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" event={"ID":"31ac52b8-d5e1-455a-80e6-36d853bff2c8","Type":"ContainerStarted","Data":"dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec"}
Sep 17 16:06:29.077386 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:29.076926    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:06:29.078596 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:29.078572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" event={"ID":"d9e1aefc-5b18-477a-babe-e339d2692e8b","Type":"ContainerStarted","Data":"60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090"}
Sep 17 16:06:29.099445 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:29.099391    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" podStartSLOduration=2.073944643 podStartE2EDuration="5.09937046s" totalImagesPullingTime="3.025425817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:06:29.097852781 +0000 UTC m=+1667.879540119" watchObservedRunningTime="2026-09-17 16:06:29.09937046 +0000 UTC m=+1667.881057797"
Sep 17 16:06:29.124380 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:29.124327    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" podStartSLOduration=2.607785106 podStartE2EDuration="5.124311857s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.516526751s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:06:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:06:29.122241899 +0000 UTC m=+1667.903929260" watchObservedRunningTime="2026-09-17 16:06:29.124311857 +0000 UTC m=+1667.905999194"
Sep 17 16:06:29.605980 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:29.605925    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:34.606253 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:34.606206    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:34.618877 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:34.618842    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:06:35.117438 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:06:35.117406    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:07:00.085057 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:00.085021    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:07:02.091604 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.091574    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"]
Sep 17 16:07:02.102518 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:07:02.102462    2582 log.go:32] "ExecSync cmd from runtime service failed" err=<
Sep 17 16:07:02.102518 ip-10-0-139-98 kubenswrapper[2582]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Sep 17 16:07:02.102518 ip-10-0-139-98 kubenswrapper[2582]:         , stdout: , stderr: , exit code -1
Sep 17 16:07:02.102518 ip-10-0-139-98 kubenswrapper[2582]:  > containerID="60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090" cmd=["/bin/sleep","15"]
Sep 17 16:07:02.102805 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.102551    2582 handlers.go:82] "Exec lifecycle hook for Container in Pod failed" execCommand=["/bin/sleep","15"] containerName="main" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" message="" err=<
Sep 17 16:07:02.102805 ip-10-0-139-98 kubenswrapper[2582]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Sep 17 16:07:02.102805 ip-10-0-139-98 kubenswrapper[2582]:         , stdout: , stderr: , exit code -1
Sep 17 16:07:02.102805 ip-10-0-139-98 kubenswrapper[2582]:  >
Sep 17 16:07:02.102805 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:07:02.102571    2582 kuberuntime_container.go:755] "PreStop hook failed" err=<
Sep 17 16:07:02.102805 ip-10-0-139-98 kubenswrapper[2582]:         rpc error: code = Unknown desc = command error: executable file `/bin/sleep` not found: No such file or directory
Sep 17 16:07:02.102805 ip-10-0-139-98 kubenswrapper[2582]:         , stdout: , stderr: , exit code -1
Sep 17 16:07:02.102805 ip-10-0-139-98 kubenswrapper[2582]:  > pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" podUID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerName="main" containerID="cri-o://60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090"
Sep 17 16:07:02.102805 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.102617    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" podUID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerName="main" containerID="cri-o://60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090" gracePeriod=60
Sep 17 16:07:02.106239 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.106204    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" podUID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.34:8000/health\": dial tcp 10.133.0.34:8000: connect: connection refused"
Sep 17 16:07:02.125486 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.125442    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"]
Sep 17 16:07:02.458150 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.458123    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:07:02.511476 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511436    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48wgz\" (UniqueName: \"kubernetes.io/projected/d9e1aefc-5b18-477a-babe-e339d2692e8b-kube-api-access-48wgz\") pod \"d9e1aefc-5b18-477a-babe-e339d2692e8b\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") "
Sep 17 16:07:02.511687 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511523    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-home\") pod \"d9e1aefc-5b18-477a-babe-e339d2692e8b\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") "
Sep 17 16:07:02.511687 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511581    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1aefc-5b18-477a-babe-e339d2692e8b-tls-certs\") pod \"d9e1aefc-5b18-477a-babe-e339d2692e8b\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") "
Sep 17 16:07:02.511687 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511608    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-tmp-dir\") pod \"d9e1aefc-5b18-477a-babe-e339d2692e8b\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") "
Sep 17 16:07:02.511687 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511638    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-model-cache\") pod \"d9e1aefc-5b18-477a-babe-e339d2692e8b\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") "
Sep 17 16:07:02.511687 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511673    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-dshm\") pod \"d9e1aefc-5b18-477a-babe-e339d2692e8b\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") "
Sep 17 16:07:02.511982 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511747    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-kserve-provision-location\") pod \"d9e1aefc-5b18-477a-babe-e339d2692e8b\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") "
Sep 17 16:07:02.511982 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511776    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9e1aefc-5b18-477a-babe-e339d2692e8b-cabundle-cert\") pod \"d9e1aefc-5b18-477a-babe-e339d2692e8b\" (UID: \"d9e1aefc-5b18-477a-babe-e339d2692e8b\") "
Sep 17 16:07:02.511982 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511831    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-home" (OuterVolumeSpecName: "home") pod "d9e1aefc-5b18-477a-babe-e339d2692e8b" (UID: "d9e1aefc-5b18-477a-babe-e339d2692e8b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:07:02.511982 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.511912    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d9e1aefc-5b18-477a-babe-e339d2692e8b" (UID: "d9e1aefc-5b18-477a-babe-e339d2692e8b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:07:02.512241 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.512210    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-model-cache" (OuterVolumeSpecName: "model-cache") pod "d9e1aefc-5b18-477a-babe-e339d2692e8b" (UID: "d9e1aefc-5b18-477a-babe-e339d2692e8b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:07:02.512640 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.512239    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9e1aefc-5b18-477a-babe-e339d2692e8b-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d9e1aefc-5b18-477a-babe-e339d2692e8b" (UID: "d9e1aefc-5b18-477a-babe-e339d2692e8b"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:07:02.512640 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.512532    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-tmp-dir\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:02.512640 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.512564    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-model-cache\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:02.512640 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.512578    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d9e1aefc-5b18-477a-babe-e339d2692e8b-cabundle-cert\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:02.512640 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.512590    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-home\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:02.514532 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.514475    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9e1aefc-5b18-477a-babe-e339d2692e8b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d9e1aefc-5b18-477a-babe-e339d2692e8b" (UID: "d9e1aefc-5b18-477a-babe-e339d2692e8b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:07:02.514532 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.514484    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9e1aefc-5b18-477a-babe-e339d2692e8b-kube-api-access-48wgz" (OuterVolumeSpecName: "kube-api-access-48wgz") pod "d9e1aefc-5b18-477a-babe-e339d2692e8b" (UID: "d9e1aefc-5b18-477a-babe-e339d2692e8b"). InnerVolumeSpecName "kube-api-access-48wgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:07:02.514694 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.514611    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-dshm" (OuterVolumeSpecName: "dshm") pod "d9e1aefc-5b18-477a-babe-e339d2692e8b" (UID: "d9e1aefc-5b18-477a-babe-e339d2692e8b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:07:02.538286 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.538240    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d9e1aefc-5b18-477a-babe-e339d2692e8b" (UID: "d9e1aefc-5b18-477a-babe-e339d2692e8b"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:07:02.613245 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.613209    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9e1aefc-5b18-477a-babe-e339d2692e8b-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:02.613245 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.613239    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-dshm\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:02.613245 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.613252    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9e1aefc-5b18-477a-babe-e339d2692e8b-kserve-provision-location\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:02.613431 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:02.613261    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48wgz\" (UniqueName: \"kubernetes.io/projected/d9e1aefc-5b18-477a-babe-e339d2692e8b-kube-api-access-48wgz\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:03.241137 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.241104    2582 generic.go:356] "Generic (PLEG): container finished" podID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerID="60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090" exitCode=0
Sep 17 16:07:03.241642 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.241156    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"
Sep 17 16:07:03.241642 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.241181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" event={"ID":"d9e1aefc-5b18-477a-babe-e339d2692e8b","Type":"ContainerDied","Data":"60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090"}
Sep 17 16:07:03.241642 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.241251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2" event={"ID":"d9e1aefc-5b18-477a-babe-e339d2692e8b","Type":"ContainerDied","Data":"0f72742d07328d6a735a9c61ccf5b5f5c18e38348f4f743115a7830d74b94eb6"}
Sep 17 16:07:03.241642 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.241290    2582 scope.go:117] "RemoveContainer" containerID="60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090"
Sep 17 16:07:03.250778 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.250760    2582 scope.go:117] "RemoveContainer" containerID="8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7"
Sep 17 16:07:03.259093 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.259072    2582 scope.go:117] "RemoveContainer" containerID="60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090"
Sep 17 16:07:03.259430 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:07:03.259411    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090\": container with ID starting with 60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090 not found: ID does not exist" containerID="60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090"
Sep 17 16:07:03.259484 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.259441    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090"} err="failed to get container status \"60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090\": rpc error: code = NotFound desc = could not find container \"60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090\": container with ID starting with 60a2ecee73d41ee61a73f3e78cb93dfbc1e45f34251028c33c1d598397e5f090 not found: ID does not exist"
Sep 17 16:07:03.259484 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.259458    2582 scope.go:117] "RemoveContainer" containerID="8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7"
Sep 17 16:07:03.259742 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:07:03.259726    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7\": container with ID starting with 8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7 not found: ID does not exist" containerID="8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7"
Sep 17 16:07:03.259786 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.259746    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7"} err="failed to get container status \"8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7\": rpc error: code = NotFound desc = could not find container \"8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7\": container with ID starting with 8eb62edbe43c2fe177062470602ec7b1e9b5d8ba2af6e659ddebf9130a7452d7 not found: ID does not exist"
Sep 17 16:07:03.269803 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.269772    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"]
Sep 17 16:07:03.277278 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.277249    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-6dd775764b-pqns2"]
Sep 17 16:07:03.651402 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:03.651366    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9e1aefc-5b18-477a-babe-e339d2692e8b" path="/var/lib/kubelet/pods/d9e1aefc-5b18-477a-babe-e339d2692e8b/volumes"
Sep 17 16:07:10.085512 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:10.085461    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" podUID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:07:17.145354 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:17.145308    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" podUID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" containerName="main" containerID="cri-o://dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec" gracePeriod=45
Sep 17 16:07:20.084990 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:20.084952    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" podUID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:07:30.085576 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:30.085533    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" podUID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:07:30.086005 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:30.085653    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:07:40.085590 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:40.085547    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" podUID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:07:47.402071 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.402041    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:07:47.412106 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.412029    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31ac52b8-d5e1-455a-80e6-36d853bff2c8-tls-certs\") pod \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\" (UID: \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\") "
Sep 17 16:07:47.412106 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.412103    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np5v7\" (UniqueName: \"kubernetes.io/projected/31ac52b8-d5e1-455a-80e6-36d853bff2c8-kube-api-access-np5v7\") pod \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\" (UID: \"31ac52b8-d5e1-455a-80e6-36d853bff2c8\") "
Sep 17 16:07:47.414273 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.414237    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ac52b8-d5e1-455a-80e6-36d853bff2c8-kube-api-access-np5v7" (OuterVolumeSpecName: "kube-api-access-np5v7") pod "31ac52b8-d5e1-455a-80e6-36d853bff2c8" (UID: "31ac52b8-d5e1-455a-80e6-36d853bff2c8"). InnerVolumeSpecName "kube-api-access-np5v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:07:47.414273 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.414255    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ac52b8-d5e1-455a-80e6-36d853bff2c8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "31ac52b8-d5e1-455a-80e6-36d853bff2c8" (UID: "31ac52b8-d5e1-455a-80e6-36d853bff2c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:07:47.444237 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.444200    2582 generic.go:356] "Generic (PLEG): container finished" podID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" containerID="dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec" exitCode=0
Sep 17 16:07:47.444437 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.444259    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"
Sep 17 16:07:47.444437 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.444280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" event={"ID":"31ac52b8-d5e1-455a-80e6-36d853bff2c8","Type":"ContainerDied","Data":"dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec"}
Sep 17 16:07:47.444437 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.444333    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl" event={"ID":"31ac52b8-d5e1-455a-80e6-36d853bff2c8","Type":"ContainerDied","Data":"2a6a7d0d9479fa2a070daa2f4c174eee744556d5c037588733bff530db21e71f"}
Sep 17 16:07:47.444437 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.444357    2582 scope.go:117] "RemoveContainer" containerID="dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec"
Sep 17 16:07:47.455223 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.455198    2582 scope.go:117] "RemoveContainer" containerID="dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec"
Sep 17 16:07:47.455604 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:07:47.455572    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec\": container with ID starting with dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec not found: ID does not exist" containerID="dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec"
Sep 17 16:07:47.455706 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.455614    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec"} err="failed to get container status \"dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec\": rpc error: code = NotFound desc = could not find container \"dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec\": container with ID starting with dc61a63a66ac638b0e59138d3961b026ffc2f4d74e7dffd813f85e22062b74ec not found: ID does not exist"
Sep 17 16:07:47.469965 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.469933    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"]
Sep 17 16:07:47.473743 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.473712    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-0eb24714/tokenizer-template-args-test-kserve-router-scheduler-8cd7d8vzpl"]
Sep 17 16:07:47.513261 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.513223    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31ac52b8-d5e1-455a-80e6-36d853bff2c8-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:47.513261 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.513255    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np5v7\" (UniqueName: \"kubernetes.io/projected/31ac52b8-d5e1-455a-80e6-36d853bff2c8-kube-api-access-np5v7\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:07:47.651583 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:07:47.651546    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" path="/var/lib/kubelet/pods/31ac52b8-d5e1-455a-80e6-36d853bff2c8/volumes"
Sep 17 16:08:41.758890 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:08:41.758857    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:08:41.761390 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:08:41.761365    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:11:07.708580 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.708547    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"]
Sep 17 16:11:07.709030 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.708868    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" containerName="main"
Sep 17 16:11:07.709030 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.708879    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" containerName="main"
Sep 17 16:11:07.709030 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.708898    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerName="main"
Sep 17 16:11:07.709030 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.708904    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerName="main"
Sep 17 16:11:07.709030 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.708913    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerName="storage-initializer"
Sep 17 16:11:07.709030 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.708918    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerName="storage-initializer"
Sep 17 16:11:07.709030 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.708965    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ac52b8-d5e1-455a-80e6-36d853bff2c8" containerName="main"
Sep 17 16:11:07.709030 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.708973    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9e1aefc-5b18-477a-babe-e339d2692e8b" containerName="main"
Sep 17 16:11:07.712005 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.711988    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.714749 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.714729    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"kube-root-ca.crt\""
Sep 17 16:11:07.715855 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.715837    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"openshift-service-ca.crt\""
Sep 17 16:11:07.715956 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.715930    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"default-dockercfg-p8fv4\""
Sep 17 16:11:07.716106 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.716065    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"seaweedfs-s3-creds\""
Sep 17 16:11:07.716106 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.716079    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:11:07.716242 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.716155    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs\""
Sep 17 16:11:07.728757 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.728726    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"]
Sep 17 16:11:07.803911 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.803858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae0b762-0e40-4717-bc60-c174cfad17d4-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.803911 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.803920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5jcv\" (UniqueName: \"kubernetes.io/projected/6ae0b762-0e40-4717-bc60-c174cfad17d4-kube-api-access-n5jcv\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.804181 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.803998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-home\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.804181 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.804021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.804181 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.804054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6ae0b762-0e40-4717-bc60-c174cfad17d4-cabundle-cert\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.804181 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.804075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.804181 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.804095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.804181 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.804114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-dshm\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905281 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae0b762-0e40-4717-bc60-c174cfad17d4-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905281 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5jcv\" (UniqueName: \"kubernetes.io/projected/6ae0b762-0e40-4717-bc60-c174cfad17d4-kube-api-access-n5jcv\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905592 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-home\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905592 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905592 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905371    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6ae0b762-0e40-4717-bc60-c174cfad17d4-cabundle-cert\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905592 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905592 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905416    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905890 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-dshm\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905890 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905849    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-home\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905994 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905884    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.905994 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.905918    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.906096 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.906052    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.906367 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.906349    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6ae0b762-0e40-4717-bc60-c174cfad17d4-cabundle-cert\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.907747 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.907727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-dshm\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.908118 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.908100    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae0b762-0e40-4717-bc60-c174cfad17d4-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:07.913508 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:07.913470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5jcv\" (UniqueName: \"kubernetes.io/projected/6ae0b762-0e40-4717-bc60-c174cfad17d4-kube-api-access-n5jcv\") pod \"llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") " pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:08.022770 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:08.022667    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:08.307133 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:08.307103    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"]
Sep 17 16:11:08.309683 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:11:08.309632    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae0b762_0e40_4717_bc60_c174cfad17d4.slice/crio-985bfc9623b0ef9187c6a39cc8e5ec0bc4eceacf7b98274a879236cffa92ae40 WatchSource:0}: Error finding container 985bfc9623b0ef9187c6a39cc8e5ec0bc4eceacf7b98274a879236cffa92ae40: Status 404 returned error can't find the container with id 985bfc9623b0ef9187c6a39cc8e5ec0bc4eceacf7b98274a879236cffa92ae40
Sep 17 16:11:08.359848 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:08.359818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" event={"ID":"6ae0b762-0e40-4717-bc60-c174cfad17d4","Type":"ContainerStarted","Data":"985bfc9623b0ef9187c6a39cc8e5ec0bc4eceacf7b98274a879236cffa92ae40"}
Sep 17 16:11:09.371714 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:09.371671    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" event={"ID":"6ae0b762-0e40-4717-bc60-c174cfad17d4","Type":"ContainerStarted","Data":"97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a"}
Sep 17 16:11:11.383241 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:11.383208    2582 generic.go:356] "Generic (PLEG): container finished" podID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerID="97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a" exitCode=0
Sep 17 16:11:11.383741 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:11.383278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" event={"ID":"6ae0b762-0e40-4717-bc60-c174cfad17d4","Type":"ContainerDied","Data":"97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a"}
Sep 17 16:11:12.390908 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:12.390868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" event={"ID":"6ae0b762-0e40-4717-bc60-c174cfad17d4","Type":"ContainerStarted","Data":"0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95"}
Sep 17 16:11:12.418750 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:12.418688    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podStartSLOduration=3.089101604 podStartE2EDuration="5.418668209s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.329566605s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:11:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:11:12.416777643 +0000 UTC m=+1951.198464973" watchObservedRunningTime="2026-09-17 16:11:12.418668209 +0000 UTC m=+1951.200355547"
Sep 17 16:11:13.023419 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:13.023381    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:18.023659 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:18.023612    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:11:18.025454 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:18.025418    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:11:28.023922 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:28.023868    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:11:38.023437 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:38.023375    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:11:48.024111 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:48.024061    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:11:58.023224 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:11:58.023172    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:12:08.023775 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:12:08.023735    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:12:18.023358 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:12:18.023310    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:12:28.023440 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:12:28.023382    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:12:38.023726 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:12:38.023678    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:12:48.024036 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:12:48.023989    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:12:58.023705 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:12:58.023654    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": dial tcp 10.133.0.36:8000: connect: connection refused"
Sep 17 16:13:08.033206 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:08.033128    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:13:08.045211 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:08.045182    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:13:23.289580 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:23.289543    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"]
Sep 17 16:13:38.311724 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:38.311660    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" containerID="cri-o://0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95" gracePeriod=45
Sep 17 16:13:39.053817 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.053792    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:13:39.103049 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.103014    2582 generic.go:356] "Generic (PLEG): container finished" podID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerID="0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95" exitCode=0
Sep 17 16:13:39.103244 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.103071    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"
Sep 17 16:13:39.103244 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.103080    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" event={"ID":"6ae0b762-0e40-4717-bc60-c174cfad17d4","Type":"ContainerDied","Data":"0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95"}
Sep 17 16:13:39.103244 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.103134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" event={"ID":"6ae0b762-0e40-4717-bc60-c174cfad17d4","Type":"ContainerDied","Data":"985bfc9623b0ef9187c6a39cc8e5ec0bc4eceacf7b98274a879236cffa92ae40"}
Sep 17 16:13:39.103244 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.103162    2582 scope.go:117] "RemoveContainer" containerID="0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95"
Sep 17 16:13:39.113962 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.113942    2582 scope.go:117] "RemoveContainer" containerID="97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a"
Sep 17 16:13:39.121579 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.121558    2582 scope.go:117] "RemoveContainer" containerID="0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95"
Sep 17 16:13:39.121851 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:13:39.121833    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95\": container with ID starting with 0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95 not found: ID does not exist" containerID="0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95"
Sep 17 16:13:39.121905 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.121860    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95"} err="failed to get container status \"0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95\": rpc error: code = NotFound desc = could not find container \"0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95\": container with ID starting with 0cc01e69532e1ff879dca3b8403417df9fb6293bd67956d670122a8094178c95 not found: ID does not exist"
Sep 17 16:13:39.121905 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.121876    2582 scope.go:117] "RemoveContainer" containerID="97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a"
Sep 17 16:13:39.122139 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:13:39.122121    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a\": container with ID starting with 97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a not found: ID does not exist" containerID="97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a"
Sep 17 16:13:39.122193 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.122146    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a"} err="failed to get container status \"97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a\": rpc error: code = NotFound desc = could not find container \"97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a\": container with ID starting with 97078247769b1ee34a44a73b04701be17d39b68ad391128b659045420358ef0a not found: ID does not exist"
Sep 17 16:13:39.196674 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.196632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-home\") pod \"6ae0b762-0e40-4717-bc60-c174cfad17d4\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") "
Sep 17 16:13:39.196813 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.196716    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6ae0b762-0e40-4717-bc60-c174cfad17d4-cabundle-cert\") pod \"6ae0b762-0e40-4717-bc60-c174cfad17d4\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") "
Sep 17 16:13:39.196813 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.196734    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-model-cache\") pod \"6ae0b762-0e40-4717-bc60-c174cfad17d4\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") "
Sep 17 16:13:39.196813 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.196772    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5jcv\" (UniqueName: \"kubernetes.io/projected/6ae0b762-0e40-4717-bc60-c174cfad17d4-kube-api-access-n5jcv\") pod \"6ae0b762-0e40-4717-bc60-c174cfad17d4\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") "
Sep 17 16:13:39.196813 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.196792    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae0b762-0e40-4717-bc60-c174cfad17d4-tls-certs\") pod \"6ae0b762-0e40-4717-bc60-c174cfad17d4\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") "
Sep 17 16:13:39.196977 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.196925    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-tmp-dir\") pod \"6ae0b762-0e40-4717-bc60-c174cfad17d4\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") "
Sep 17 16:13:39.197032 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.196982    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-dshm\") pod \"6ae0b762-0e40-4717-bc60-c174cfad17d4\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") "
Sep 17 16:13:39.197091 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.197029    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-kserve-provision-location\") pod \"6ae0b762-0e40-4717-bc60-c174cfad17d4\" (UID: \"6ae0b762-0e40-4717-bc60-c174cfad17d4\") "
Sep 17 16:13:39.197091 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.197063    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ae0b762-0e40-4717-bc60-c174cfad17d4" (UID: "6ae0b762-0e40-4717-bc60-c174cfad17d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:13:39.197227 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.197124    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ae0b762-0e40-4717-bc60-c174cfad17d4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "6ae0b762-0e40-4717-bc60-c174cfad17d4" (UID: "6ae0b762-0e40-4717-bc60-c174cfad17d4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:13:39.197372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.197344    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6ae0b762-0e40-4717-bc60-c174cfad17d4-cabundle-cert\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:13:39.197372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.197366    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-model-cache\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:13:39.197517 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.197443    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-home" (OuterVolumeSpecName: "home") pod "6ae0b762-0e40-4717-bc60-c174cfad17d4" (UID: "6ae0b762-0e40-4717-bc60-c174cfad17d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:13:39.199746 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.199718    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-dshm" (OuterVolumeSpecName: "dshm") pod "6ae0b762-0e40-4717-bc60-c174cfad17d4" (UID: "6ae0b762-0e40-4717-bc60-c174cfad17d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:13:39.199746 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.199724    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ae0b762-0e40-4717-bc60-c174cfad17d4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ae0b762-0e40-4717-bc60-c174cfad17d4" (UID: "6ae0b762-0e40-4717-bc60-c174cfad17d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:13:39.199888 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.199820    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ae0b762-0e40-4717-bc60-c174cfad17d4-kube-api-access-n5jcv" (OuterVolumeSpecName: "kube-api-access-n5jcv") pod "6ae0b762-0e40-4717-bc60-c174cfad17d4" (UID: "6ae0b762-0e40-4717-bc60-c174cfad17d4"). InnerVolumeSpecName "kube-api-access-n5jcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:13:39.209003 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.208975    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ae0b762-0e40-4717-bc60-c174cfad17d4" (UID: "6ae0b762-0e40-4717-bc60-c174cfad17d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:13:39.219372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.219346    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6ae0b762-0e40-4717-bc60-c174cfad17d4" (UID: "6ae0b762-0e40-4717-bc60-c174cfad17d4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:13:39.298824 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.298784    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5jcv\" (UniqueName: \"kubernetes.io/projected/6ae0b762-0e40-4717-bc60-c174cfad17d4-kube-api-access-n5jcv\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:13:39.298824 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.298818    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ae0b762-0e40-4717-bc60-c174cfad17d4-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:13:39.298824 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.298830    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-tmp-dir\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:13:39.299069 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.298837    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-dshm\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:13:39.299069 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.298846    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-kserve-provision-location\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:13:39.299069 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.298853    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ae0b762-0e40-4717-bc60-c174cfad17d4-home\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:13:39.432903 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.432857    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"]
Sep 17 16:13:39.437380 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.437353    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh"]
Sep 17 16:13:39.650793 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:39.650760    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" path="/var/lib/kubelet/pods/6ae0b762-0e40-4717-bc60-c174cfad17d4/volumes"
Sep 17 16:13:40.034052 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:40.034004    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-079cb970/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-7f9c6c849-x9fhh" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.36:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 17 16:13:41.791524 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:41.791472    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:13:41.794799 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:41.794781    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:13:52.507715 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.507682    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"]
Sep 17 16:13:52.508091 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.508047    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main"
Sep 17 16:13:52.508091 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.508060    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main"
Sep 17 16:13:52.508091 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.508078    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="storage-initializer"
Sep 17 16:13:52.508091 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.508084    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="storage-initializer"
Sep 17 16:13:52.508227 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.508137    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ae0b762-0e40-4717-bc60-c174cfad17d4" containerName="main"
Sep 17 16:13:52.511293 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.511276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:13:52.511854 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.511826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482e159b-adee-48be-9fac-25cd0f69503e-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9\" (UID: \"482e159b-adee-48be-9fac-25cd0f69503e\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:13:52.512001 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.511864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55gtx\" (UniqueName: \"kubernetes.io/projected/482e159b-adee-48be-9fac-25cd0f69503e-kube-api-access-55gtx\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9\" (UID: \"482e159b-adee-48be-9fac-25cd0f69503e\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:13:52.515751 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.515728    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs\""
Sep 17 16:13:52.515869 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.515848    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"openshift-service-ca.crt\""
Sep 17 16:13:52.515951 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.515924    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"default-dockercfg-kkjx7\""
Sep 17 16:13:52.516058 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.516042    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa-dockercfg-4xckh\""
Sep 17 16:13:52.516120 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.516085    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62fead0b\"/\"kube-root-ca.crt\""
Sep 17 16:13:52.524782 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.524760    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"]
Sep 17 16:13:52.612220 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.612182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482e159b-adee-48be-9fac-25cd0f69503e-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9\" (UID: \"482e159b-adee-48be-9fac-25cd0f69503e\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:13:52.612220 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.612223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55gtx\" (UniqueName: \"kubernetes.io/projected/482e159b-adee-48be-9fac-25cd0f69503e-kube-api-access-55gtx\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9\" (UID: \"482e159b-adee-48be-9fac-25cd0f69503e\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:13:52.614753 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.614722    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482e159b-adee-48be-9fac-25cd0f69503e-tls-certs\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9\" (UID: \"482e159b-adee-48be-9fac-25cd0f69503e\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:13:52.625880 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.625851    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55gtx\" (UniqueName: \"kubernetes.io/projected/482e159b-adee-48be-9fac-25cd0f69503e-kube-api-access-55gtx\") pod \"llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9\" (UID: \"482e159b-adee-48be-9fac-25cd0f69503e\") " pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:13:52.822079 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:52.821993    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:13:53.112587 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:53.112557    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"]
Sep 17 16:13:53.115946 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:13:53.115914    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482e159b_adee_48be_9fac_25cd0f69503e.slice/crio-8ab5194d9bfa42f28485b3d20989864a79fefd74601ad88ebd2b7c03d654daeb WatchSource:0}: Error finding container 8ab5194d9bfa42f28485b3d20989864a79fefd74601ad88ebd2b7c03d654daeb: Status 404 returned error can't find the container with id 8ab5194d9bfa42f28485b3d20989864a79fefd74601ad88ebd2b7c03d654daeb
Sep 17 16:13:53.165837 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:53.165812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" event={"ID":"482e159b-adee-48be-9fac-25cd0f69503e","Type":"ContainerStarted","Data":"8ab5194d9bfa42f28485b3d20989864a79fefd74601ad88ebd2b7c03d654daeb"}
Sep 17 16:13:54.172334 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:54.172290    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" event={"ID":"482e159b-adee-48be-9fac-25cd0f69503e","Type":"ContainerStarted","Data":"af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc"}
Sep 17 16:13:54.172761 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:54.172387    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:13:54.192890 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:13:54.192839    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" podStartSLOduration=2.192824018 podStartE2EDuration="2.192824018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:13:54.191380487 +0000 UTC m=+2112.973067815" watchObservedRunningTime="2026-09-17 16:13:54.192824018 +0000 UTC m=+2112.974511354"
Sep 17 16:14:25.178357 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:14:25.178323    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:15:37.030151 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:15:37.030112    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"]
Sep 17 16:15:45.178356 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:15:45.178313    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" podUID="482e159b-adee-48be-9fac-25cd0f69503e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:15:52.049577 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:15:52.049528    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" podUID="482e159b-adee-48be-9fac-25cd0f69503e" containerName="main" containerID="cri-o://af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc" gracePeriod=45
Sep 17 16:15:55.178823 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:15:55.178782    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" podUID="482e159b-adee-48be-9fac-25cd0f69503e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:16:05.178601 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:05.178517    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" podUID="482e159b-adee-48be-9fac-25cd0f69503e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:16:05.178993 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:05.178617    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:16:15.178732 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:15.178689    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" podUID="482e159b-adee-48be-9fac-25cd0f69503e" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:16:22.305327 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.305299    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:16:22.313375 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.313310    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55gtx\" (UniqueName: \"kubernetes.io/projected/482e159b-adee-48be-9fac-25cd0f69503e-kube-api-access-55gtx\") pod \"482e159b-adee-48be-9fac-25cd0f69503e\" (UID: \"482e159b-adee-48be-9fac-25cd0f69503e\") "
Sep 17 16:16:22.313526 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.313386    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482e159b-adee-48be-9fac-25cd0f69503e-tls-certs\") pod \"482e159b-adee-48be-9fac-25cd0f69503e\" (UID: \"482e159b-adee-48be-9fac-25cd0f69503e\") "
Sep 17 16:16:22.315508 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.315469    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/482e159b-adee-48be-9fac-25cd0f69503e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "482e159b-adee-48be-9fac-25cd0f69503e" (UID: "482e159b-adee-48be-9fac-25cd0f69503e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:16:22.315623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.315546    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/482e159b-adee-48be-9fac-25cd0f69503e-kube-api-access-55gtx" (OuterVolumeSpecName: "kube-api-access-55gtx") pod "482e159b-adee-48be-9fac-25cd0f69503e" (UID: "482e159b-adee-48be-9fac-25cd0f69503e"). InnerVolumeSpecName "kube-api-access-55gtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:16:22.414079 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.414042    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55gtx\" (UniqueName: \"kubernetes.io/projected/482e159b-adee-48be-9fac-25cd0f69503e-kube-api-access-55gtx\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:16:22.414079 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.414073    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/482e159b-adee-48be-9fac-25cd0f69503e-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:16:22.840701 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.840665    2582 generic.go:356] "Generic (PLEG): container finished" podID="482e159b-adee-48be-9fac-25cd0f69503e" containerID="af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc" exitCode=0
Sep 17 16:16:22.840884 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.840711    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"
Sep 17 16:16:22.840884 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.840746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" event={"ID":"482e159b-adee-48be-9fac-25cd0f69503e","Type":"ContainerDied","Data":"af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc"}
Sep 17 16:16:22.840884 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.840796    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9" event={"ID":"482e159b-adee-48be-9fac-25cd0f69503e","Type":"ContainerDied","Data":"8ab5194d9bfa42f28485b3d20989864a79fefd74601ad88ebd2b7c03d654daeb"}
Sep 17 16:16:22.840884 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.840817    2582 scope.go:117] "RemoveContainer" containerID="af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc"
Sep 17 16:16:22.849737 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.849722    2582 scope.go:117] "RemoveContainer" containerID="af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc"
Sep 17 16:16:22.850016 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:16:22.849994    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc\": container with ID starting with af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc not found: ID does not exist" containerID="af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc"
Sep 17 16:16:22.850084 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.850024    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc"} err="failed to get container status \"af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc\": rpc error: code = NotFound desc = could not find container \"af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc\": container with ID starting with af314bfed4f9a4ef265469365128db3590a7a0fe96be4a4e65db137c3889c4cc not found: ID does not exist"
Sep 17 16:16:22.862978 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.862951    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"]
Sep 17 16:16:22.869070 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:22.869047    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62fead0b/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schekksr9"]
Sep 17 16:16:23.651979 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:16:23.651946    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="482e159b-adee-48be-9fac-25cd0f69503e" path="/var/lib/kubelet/pods/482e159b-adee-48be-9fac-25cd0f69503e/volumes"
Sep 17 16:18:41.824544 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:18:41.824436    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:18:41.829761 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:18:41.829739    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:20:12.037557 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.037519    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"]
Sep 17 16:20:12.038024 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.038004    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="482e159b-adee-48be-9fac-25cd0f69503e" containerName="main"
Sep 17 16:20:12.038076 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.038028    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="482e159b-adee-48be-9fac-25cd0f69503e" containerName="main"
Sep 17 16:20:12.038151 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.038138    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="482e159b-adee-48be-9fac-25cd0f69503e" containerName="main"
Sep 17 16:20:12.041043 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.041027    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:20:12.043704 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.043687    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"openshift-service-ca.crt\""
Sep 17 16:20:12.044810 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.044793    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa-dockercfg-74xws\""
Sep 17 16:20:12.044895 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.044856    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs\""
Sep 17 16:20:12.045035 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.045019    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"kube-root-ca.crt\""
Sep 17 16:20:12.045217 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.045200    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"default-dockercfg-2vsbs\""
Sep 17 16:20:12.050208 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.050185    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"]
Sep 17 16:20:12.074074 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.074047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm\" (UID: \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:20:12.074074 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.074075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jdz9\" (UniqueName: \"kubernetes.io/projected/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-kube-api-access-8jdz9\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm\" (UID: \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:20:12.174629 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.174601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm\" (UID: \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:20:12.174782 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.174635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jdz9\" (UniqueName: \"kubernetes.io/projected/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-kube-api-access-8jdz9\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm\" (UID: \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:20:12.177275 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.177252    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm\" (UID: \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:20:12.184178 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.184151    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jdz9\" (UniqueName: \"kubernetes.io/projected/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-kube-api-access-8jdz9\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm\" (UID: \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:20:12.351946 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.351918    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:20:12.624644 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.624619    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"]
Sep 17 16:20:12.626851 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:20:12.626825    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a6ddd1_9c43_4e29_9eb2_198545d67e40.slice/crio-6a2886e1509a8efc14d85b31ed7e651bfac092d902b20ad0c62803cc2dd66cda WatchSource:0}: Error finding container 6a2886e1509a8efc14d85b31ed7e651bfac092d902b20ad0c62803cc2dd66cda: Status 404 returned error can't find the container with id 6a2886e1509a8efc14d85b31ed7e651bfac092d902b20ad0c62803cc2dd66cda
Sep 17 16:20:12.856119 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.856077    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" event={"ID":"a1a6ddd1-9c43-4e29-9eb2-198545d67e40","Type":"ContainerStarted","Data":"8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378"}
Sep 17 16:20:12.856306 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.856144    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" event={"ID":"a1a6ddd1-9c43-4e29-9eb2-198545d67e40","Type":"ContainerStarted","Data":"6a2886e1509a8efc14d85b31ed7e651bfac092d902b20ad0c62803cc2dd66cda"}
Sep 17 16:20:12.856306 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.856186    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:20:12.873305 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:12.873256    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" podStartSLOduration=0.873236998 podStartE2EDuration="873.236998ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:12.872852966 +0000 UTC m=+2491.654540308" watchObservedRunningTime="2026-09-17 16:20:12.873236998 +0000 UTC m=+2491.654924333"
Sep 17 16:20:43.863041 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:20:43.862953    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:21:33.811425 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:21:33.811392    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"]
Sep 17 16:21:33.862354 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:21:33.862314    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:21:43.862746 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:21:43.862704    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:21:48.831419 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:21:48.831361    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerName="main" containerID="cri-o://8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378" gracePeriod=45
Sep 17 16:21:53.862170 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:21:53.862120    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:21:53.862672 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:21:53.862237    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:22:03.862851 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:03.862809    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:22:13.862262 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:13.862219    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:22:19.075210 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.075183    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:22:19.129430 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.129346    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jdz9\" (UniqueName: \"kubernetes.io/projected/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-kube-api-access-8jdz9\") pod \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\" (UID: \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\") "
Sep 17 16:22:19.129430 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.129406    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-tls-certs\") pod \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\" (UID: \"a1a6ddd1-9c43-4e29-9eb2-198545d67e40\") "
Sep 17 16:22:19.131623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.131593    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-kube-api-access-8jdz9" (OuterVolumeSpecName: "kube-api-access-8jdz9") pod "a1a6ddd1-9c43-4e29-9eb2-198545d67e40" (UID: "a1a6ddd1-9c43-4e29-9eb2-198545d67e40"). InnerVolumeSpecName "kube-api-access-8jdz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:22:19.131623 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.131603    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a1a6ddd1-9c43-4e29-9eb2-198545d67e40" (UID: "a1a6ddd1-9c43-4e29-9eb2-198545d67e40"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:22:19.230292 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.230240    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jdz9\" (UniqueName: \"kubernetes.io/projected/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-kube-api-access-8jdz9\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:22:19.230292 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.230285    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1a6ddd1-9c43-4e29-9eb2-198545d67e40-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:22:19.426327 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.426235    2582 generic.go:356] "Generic (PLEG): container finished" podID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerID="8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378" exitCode=0
Sep 17 16:22:19.426327 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.426284    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"
Sep 17 16:22:19.426528 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.426323    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" event={"ID":"a1a6ddd1-9c43-4e29-9eb2-198545d67e40","Type":"ContainerDied","Data":"8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378"}
Sep 17 16:22:19.426528 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.426415    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm" event={"ID":"a1a6ddd1-9c43-4e29-9eb2-198545d67e40","Type":"ContainerDied","Data":"6a2886e1509a8efc14d85b31ed7e651bfac092d902b20ad0c62803cc2dd66cda"}
Sep 17 16:22:19.426528 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.426444    2582 scope.go:117] "RemoveContainer" containerID="8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378"
Sep 17 16:22:19.435967 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.435950    2582 scope.go:117] "RemoveContainer" containerID="8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378"
Sep 17 16:22:19.436213 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:22:19.436199    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378\": container with ID starting with 8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378 not found: ID does not exist" containerID="8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378"
Sep 17 16:22:19.436254 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.436221    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378"} err="failed to get container status \"8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378\": rpc error: code = NotFound desc = could not find container \"8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378\": container with ID starting with 8a55aaed1892ec5ec1ebf8dc50bd1ea1a9dbc5876e363601be764fa45cd95378 not found: ID does not exist"
Sep 17 16:22:19.449291 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.449268    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"]
Sep 17 16:22:19.455548 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.455525    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schek2dtm"]
Sep 17 16:22:19.651063 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:22:19.651029    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" path="/var/lib/kubelet/pods/a1a6ddd1-9c43-4e29-9eb2-198545d67e40/volumes"
Sep 17 16:23:41.856705 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:23:41.856679    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:23:41.862350 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:23:41.862327    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:25:24.614941 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.614904    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"]
Sep 17 16:25:24.617606 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.615905    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerName="main"
Sep 17 16:25:24.617606 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.615940    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerName="main"
Sep 17 16:25:24.617606 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.616177    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a6ddd1-9c43-4e29-9eb2-198545d67e40" containerName="main"
Sep 17 16:25:24.620733 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.620690    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.626750 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.626717    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"default-dockercfg-2sg2q\""
Sep 17 16:25:24.627574 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.627552    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"kube-root-ca.crt\""
Sep 17 16:25:24.627711 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.627585    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs\""
Sep 17 16:25:24.627711 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.627648    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"seaweedfs-s3-creds\""
Sep 17 16:25:24.627816 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.627764    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"openshift-service-ca.crt\""
Sep 17 16:25:24.628582 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.628245    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-62876e81\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 16:25:24.640791 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.640756    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"]
Sep 17 16:25:24.727264 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.727223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.727264 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.727262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99krv\" (UniqueName: \"kubernetes.io/projected/16d2f503-0111-47dd-a426-0eec7d36ea42-kube-api-access-99krv\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.727486 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.727285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-dshm\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.727486 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.727302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/16d2f503-0111-47dd-a426-0eec7d36ea42-cabundle-cert\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.727486 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.727363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16d2f503-0111-47dd-a426-0eec7d36ea42-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.727486 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.727381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.727486 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.727399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.727741 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.727642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-home\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.828766 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.828715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16d2f503-0111-47dd-a426-0eec7d36ea42-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.828766 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.828770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829036 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.828796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829036 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.828873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-home\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829036 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.828917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829036 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.828941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99krv\" (UniqueName: \"kubernetes.io/projected/16d2f503-0111-47dd-a426-0eec7d36ea42-kube-api-access-99krv\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829036 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.828976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-dshm\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829036 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.829000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/16d2f503-0111-47dd-a426-0eec7d36ea42-cabundle-cert\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829341 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.829262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829461 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.829444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829551 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.829520    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829626 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.829581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-home\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.829999 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.829973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/16d2f503-0111-47dd-a426-0eec7d36ea42-cabundle-cert\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.831267 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.831244    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-dshm\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.831608 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.831592    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16d2f503-0111-47dd-a426-0eec7d36ea42-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.840791 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.840765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99krv\" (UniqueName: \"kubernetes.io/projected/16d2f503-0111-47dd-a426-0eec7d36ea42-kube-api-access-99krv\") pod \"llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") " pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:24.931957 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:24.931852    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:25.231425 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:25.231379    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"]
Sep 17 16:25:25.233101 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:25:25.233069    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d2f503_0111_47dd_a426_0eec7d36ea42.slice/crio-f23ca9f3f0b49b65a4e34b6c3e2997abdbf98caa3115cc96aeaa043f63715b7f WatchSource:0}: Error finding container f23ca9f3f0b49b65a4e34b6c3e2997abdbf98caa3115cc96aeaa043f63715b7f: Status 404 returned error can't find the container with id f23ca9f3f0b49b65a4e34b6c3e2997abdbf98caa3115cc96aeaa043f63715b7f
Sep 17 16:25:25.265889 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:25.265852    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" event={"ID":"16d2f503-0111-47dd-a426-0eec7d36ea42","Type":"ContainerStarted","Data":"f23ca9f3f0b49b65a4e34b6c3e2997abdbf98caa3115cc96aeaa043f63715b7f"}
Sep 17 16:25:26.271943 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:26.271901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" event={"ID":"16d2f503-0111-47dd-a426-0eec7d36ea42","Type":"ContainerStarted","Data":"0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a"}
Sep 17 16:25:28.285543 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:28.285487    2582 generic.go:356] "Generic (PLEG): container finished" podID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerID="0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a" exitCode=0
Sep 17 16:25:28.286057 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:28.285572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" event={"ID":"16d2f503-0111-47dd-a426-0eec7d36ea42","Type":"ContainerDied","Data":"0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a"}
Sep 17 16:25:29.291845 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:29.291811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" event={"ID":"16d2f503-0111-47dd-a426-0eec7d36ea42","Type":"ContainerStarted","Data":"cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84"}
Sep 17 16:25:29.325658 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:29.325594    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podStartSLOduration=3.017254915 podStartE2EDuration="5.325570441s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.308315526s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:25:29.325213809 +0000 UTC m=+2808.106901145" watchObservedRunningTime="2026-09-17 16:25:29.325570441 +0000 UTC m=+2808.107257776"
Sep 17 16:25:34.932686 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:34.932642    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:34.933110 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:34.932713    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:25:34.934346 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:34.934317    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:25:44.932345 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:44.932283    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:25:54.932340 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:25:54.932297    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:26:04.932684 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:26:04.932626    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:26:14.932551 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:26:14.932488    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:26:24.933043 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:26:24.932993    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:26:34.933193 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:26:34.933094    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:26:44.932923 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:26:44.932879    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:26:54.932744 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:26:54.932696    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:27:04.932901 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:27:04.932854    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:27:14.932672 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:27:14.932619    2582 prober.go:120] "Probe failed" probeType="Startup" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/health\": dial tcp 10.133.0.39:8000: connect: connection refused"
Sep 17 16:27:24.942398 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:27:24.942358    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:27:24.950586 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:27:24.950559    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:27:54.208893 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:27:54.208848    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"]
Sep 17 16:28:09.231605 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:09.231516    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main" containerID="cri-o://cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84" gracePeriod=45
Sep 17 16:28:09.970652 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:09.970624    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:28:10.068518 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.068402    2582 generic.go:356] "Generic (PLEG): container finished" podID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerID="cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84" exitCode=0
Sep 17 16:28:10.068518 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.068456    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"
Sep 17 16:28:10.068518 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.068483    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" event={"ID":"16d2f503-0111-47dd-a426-0eec7d36ea42","Type":"ContainerDied","Data":"cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84"}
Sep 17 16:28:10.068764 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.068541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq" event={"ID":"16d2f503-0111-47dd-a426-0eec7d36ea42","Type":"ContainerDied","Data":"f23ca9f3f0b49b65a4e34b6c3e2997abdbf98caa3115cc96aeaa043f63715b7f"}
Sep 17 16:28:10.068764 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.068566    2582 scope.go:117] "RemoveContainer" containerID="cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84"
Sep 17 16:28:10.077105 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.077084    2582 scope.go:117] "RemoveContainer" containerID="0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a"
Sep 17 16:28:10.085258 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.085236    2582 scope.go:117] "RemoveContainer" containerID="cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84"
Sep 17 16:28:10.085563 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:28:10.085542    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84\": container with ID starting with cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84 not found: ID does not exist" containerID="cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84"
Sep 17 16:28:10.085657 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.085577    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84"} err="failed to get container status \"cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84\": rpc error: code = NotFound desc = could not find container \"cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84\": container with ID starting with cf1a96f2bb87bf4c9f0a605a55aa7818c92e7ef384a37a6cc59f93e18b579a84 not found: ID does not exist"
Sep 17 16:28:10.085657 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.085601    2582 scope.go:117] "RemoveContainer" containerID="0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a"
Sep 17 16:28:10.085890 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:28:10.085873    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a\": container with ID starting with 0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a not found: ID does not exist" containerID="0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a"
Sep 17 16:28:10.085929 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.085897    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a"} err="failed to get container status \"0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a\": rpc error: code = NotFound desc = could not find container \"0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a\": container with ID starting with 0ee0e331da59351242c14a701bf829c96fa6bc20bc4d6048d63b68409c20503a not found: ID does not exist"
Sep 17 16:28:10.110215 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110183    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-model-cache\") pod \"16d2f503-0111-47dd-a426-0eec7d36ea42\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") "
Sep 17 16:28:10.110372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110251    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-kserve-provision-location\") pod \"16d2f503-0111-47dd-a426-0eec7d36ea42\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") "
Sep 17 16:28:10.110372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110268    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-tmp-dir\") pod \"16d2f503-0111-47dd-a426-0eec7d36ea42\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") "
Sep 17 16:28:10.110372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110293    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16d2f503-0111-47dd-a426-0eec7d36ea42-tls-certs\") pod \"16d2f503-0111-47dd-a426-0eec7d36ea42\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") "
Sep 17 16:28:10.110372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110335    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99krv\" (UniqueName: \"kubernetes.io/projected/16d2f503-0111-47dd-a426-0eec7d36ea42-kube-api-access-99krv\") pod \"16d2f503-0111-47dd-a426-0eec7d36ea42\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") "
Sep 17 16:28:10.110372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110352    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-home\") pod \"16d2f503-0111-47dd-a426-0eec7d36ea42\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") "
Sep 17 16:28:10.110658 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110405    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-dshm\") pod \"16d2f503-0111-47dd-a426-0eec7d36ea42\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") "
Sep 17 16:28:10.110658 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110443    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/16d2f503-0111-47dd-a426-0eec7d36ea42-cabundle-cert\") pod \"16d2f503-0111-47dd-a426-0eec7d36ea42\" (UID: \"16d2f503-0111-47dd-a426-0eec7d36ea42\") "
Sep 17 16:28:10.110658 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110552    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-model-cache" (OuterVolumeSpecName: "model-cache") pod "16d2f503-0111-47dd-a426-0eec7d36ea42" (UID: "16d2f503-0111-47dd-a426-0eec7d36ea42"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:28:10.110817 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110793    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-model-cache\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:28:10.110905 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.110875    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16d2f503-0111-47dd-a426-0eec7d36ea42-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "16d2f503-0111-47dd-a426-0eec7d36ea42" (UID: "16d2f503-0111-47dd-a426-0eec7d36ea42"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:28:10.111088 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.111063    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-home" (OuterVolumeSpecName: "home") pod "16d2f503-0111-47dd-a426-0eec7d36ea42" (UID: "16d2f503-0111-47dd-a426-0eec7d36ea42"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:28:10.112845 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.112819    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-dshm" (OuterVolumeSpecName: "dshm") pod "16d2f503-0111-47dd-a426-0eec7d36ea42" (UID: "16d2f503-0111-47dd-a426-0eec7d36ea42"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:28:10.112956 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.112873    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16d2f503-0111-47dd-a426-0eec7d36ea42-kube-api-access-99krv" (OuterVolumeSpecName: "kube-api-access-99krv") pod "16d2f503-0111-47dd-a426-0eec7d36ea42" (UID: "16d2f503-0111-47dd-a426-0eec7d36ea42"). InnerVolumeSpecName "kube-api-access-99krv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:28:10.112956 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.112895    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16d2f503-0111-47dd-a426-0eec7d36ea42-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "16d2f503-0111-47dd-a426-0eec7d36ea42" (UID: "16d2f503-0111-47dd-a426-0eec7d36ea42"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:28:10.128527 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.128462    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "16d2f503-0111-47dd-a426-0eec7d36ea42" (UID: "16d2f503-0111-47dd-a426-0eec7d36ea42"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:28:10.138636 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.138605    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "16d2f503-0111-47dd-a426-0eec7d36ea42" (UID: "16d2f503-0111-47dd-a426-0eec7d36ea42"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:28:10.211687 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.211651    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99krv\" (UniqueName: \"kubernetes.io/projected/16d2f503-0111-47dd-a426-0eec7d36ea42-kube-api-access-99krv\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:28:10.211687 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.211684    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-home\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:28:10.211687 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.211694    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-dshm\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:28:10.211868 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.211702    2582 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/16d2f503-0111-47dd-a426-0eec7d36ea42-cabundle-cert\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:28:10.211868 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.211710    2582 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-kserve-provision-location\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:28:10.211868 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.211718    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16d2f503-0111-47dd-a426-0eec7d36ea42-tmp-dir\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:28:10.211868 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.211727    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16d2f503-0111-47dd-a426-0eec7d36ea42-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:28:10.404326 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.404283    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"]
Sep 17 16:28:10.410371 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:10.410337    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-62876e81/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-84vfrhq"]
Sep 17 16:28:11.651035 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:11.651000    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" path="/var/lib/kubelet/pods/16d2f503-0111-47dd-a426-0eec7d36ea42/volumes"
Sep 17 16:28:41.884144 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:41.884033    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:28:41.890841 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:41.890818    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:28:47.988290 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.988259    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"]
Sep 17 16:28:47.988949 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.988856    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="storage-initializer"
Sep 17 16:28:47.988949 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.988881    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="storage-initializer"
Sep 17 16:28:47.988949 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.988931    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main"
Sep 17 16:28:47.989143 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.988940    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main"
Sep 17 16:28:47.989143 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.989047    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="16d2f503-0111-47dd-a426-0eec7d36ea42" containerName="main"
Sep 17 16:28:47.994904 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.994880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:28:47.999552 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.999523    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"default-dockercfg-pwwxw\""
Sep 17 16:28:47.999714 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.999554    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"openshift-service-ca.crt\""
Sep 17 16:28:47.999714 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.999575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"kube-root-ca.crt\""
Sep 17 16:28:47.999714 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.999605    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"custom-route-timeout-pd-test-kserve-self-signed-certs\""
Sep 17 16:28:47.999714 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:47.999491    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-d73d44f4\"/\"custom-route-timeout-pd-test-epp-sa-dockercfg-h6sls\""
Sep 17 16:28:48.003361 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:48.003073    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"]
Sep 17 16:28:48.055142 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:48.055110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8ll6\" (UniqueName: \"kubernetes.io/projected/1fa3172c-3c15-4c22-8579-a96b149e4f5c-kube-api-access-p8ll6\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc\" (UID: \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:28:48.055142 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:48.055152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa3172c-3c15-4c22-8579-a96b149e4f5c-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc\" (UID: \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:28:48.156589 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:48.156553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8ll6\" (UniqueName: \"kubernetes.io/projected/1fa3172c-3c15-4c22-8579-a96b149e4f5c-kube-api-access-p8ll6\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc\" (UID: \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:28:48.156784 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:48.156596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa3172c-3c15-4c22-8579-a96b149e4f5c-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc\" (UID: \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:28:48.159079 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:48.159054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa3172c-3c15-4c22-8579-a96b149e4f5c-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc\" (UID: \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:28:48.167141 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:48.167117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8ll6\" (UniqueName: \"kubernetes.io/projected/1fa3172c-3c15-4c22-8579-a96b149e4f5c-kube-api-access-p8ll6\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc\" (UID: \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\") " pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:28:48.307584 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:48.307461    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:28:48.587720 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:48.587692    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"]
Sep 17 16:28:48.590140 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:28:48.590111    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa3172c_3c15_4c22_8579_a96b149e4f5c.slice/crio-d618ded39ff14e8921cbbb2433d81494349265f533d17cee0686576a469465c9 WatchSource:0}: Error finding container d618ded39ff14e8921cbbb2433d81494349265f533d17cee0686576a469465c9: Status 404 returned error can't find the container with id d618ded39ff14e8921cbbb2433d81494349265f533d17cee0686576a469465c9
Sep 17 16:28:49.253073 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:49.253039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" event={"ID":"1fa3172c-3c15-4c22-8579-a96b149e4f5c","Type":"ContainerStarted","Data":"c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401"}
Sep 17 16:28:49.253462 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:49.253090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" event={"ID":"1fa3172c-3c15-4c22-8579-a96b149e4f5c","Type":"ContainerStarted","Data":"d618ded39ff14e8921cbbb2433d81494349265f533d17cee0686576a469465c9"}
Sep 17 16:28:49.253462 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:49.253140    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:28:49.270136 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:28:49.270088    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" podStartSLOduration=2.270072861 podStartE2EDuration="2.270072861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:28:49.26921667 +0000 UTC m=+3008.050904009" watchObservedRunningTime="2026-09-17 16:28:49.270072861 +0000 UTC m=+3008.051760198"
Sep 17 16:29:20.259329 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:29:20.259299    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:31:07.978853 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:07.978765    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"]
Sep 17 16:31:10.260380 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:10.260335    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:31:20.259313 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:20.259269    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:31:22.997961 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:22.997912    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerName="main" containerID="cri-o://c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401" gracePeriod=45
Sep 17 16:31:30.259819 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:30.259777    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:31:30.260326 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:30.259883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:31:40.260136 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:40.260096    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:31:50.260299 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:50.260251    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:31:53.251167 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:53.251139    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:31:53.387246 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:53.387202    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8ll6\" (UniqueName: \"kubernetes.io/projected/1fa3172c-3c15-4c22-8579-a96b149e4f5c-kube-api-access-p8ll6\") pod \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\" (UID: \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\") "
Sep 17 16:31:53.387461 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:53.387300    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa3172c-3c15-4c22-8579-a96b149e4f5c-tls-certs\") pod \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\" (UID: \"1fa3172c-3c15-4c22-8579-a96b149e4f5c\") "
Sep 17 16:31:53.389685 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:53.389645    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa3172c-3c15-4c22-8579-a96b149e4f5c-kube-api-access-p8ll6" (OuterVolumeSpecName: "kube-api-access-p8ll6") pod "1fa3172c-3c15-4c22-8579-a96b149e4f5c" (UID: "1fa3172c-3c15-4c22-8579-a96b149e4f5c"). InnerVolumeSpecName "kube-api-access-p8ll6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:31:53.389685 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:53.389649    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fa3172c-3c15-4c22-8579-a96b149e4f5c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1fa3172c-3c15-4c22-8579-a96b149e4f5c" (UID: "1fa3172c-3c15-4c22-8579-a96b149e4f5c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:31:53.488599 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:53.488558    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa3172c-3c15-4c22-8579-a96b149e4f5c-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:31:53.488599 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:53.488593    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8ll6\" (UniqueName: \"kubernetes.io/projected/1fa3172c-3c15-4c22-8579-a96b149e4f5c-kube-api-access-p8ll6\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:31:54.088266 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:54.088230    2582 generic.go:356] "Generic (PLEG): container finished" podID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerID="c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401" exitCode=0
Sep 17 16:31:54.088435 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:54.088288    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"
Sep 17 16:31:54.088435 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:54.088310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" event={"ID":"1fa3172c-3c15-4c22-8579-a96b149e4f5c","Type":"ContainerDied","Data":"c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401"}
Sep 17 16:31:54.088435 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:54.088386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc" event={"ID":"1fa3172c-3c15-4c22-8579-a96b149e4f5c","Type":"ContainerDied","Data":"d618ded39ff14e8921cbbb2433d81494349265f533d17cee0686576a469465c9"}
Sep 17 16:31:54.088435 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:54.088408    2582 scope.go:117] "RemoveContainer" containerID="c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401"
Sep 17 16:31:54.096805 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:54.096784    2582 scope.go:117] "RemoveContainer" containerID="c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401"
Sep 17 16:31:54.097096 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:31:54.097064    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401\": container with ID starting with c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401 not found: ID does not exist" containerID="c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401"
Sep 17 16:31:54.097214 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:54.097100    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401"} err="failed to get container status \"c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401\": rpc error: code = NotFound desc = could not find container \"c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401\": container with ID starting with c6e4d40b00f57f868d044fdc70ffc96de22af07dd26795b9f1e7f81398fca401 not found: ID does not exist"
Sep 17 16:31:54.131243 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:54.131203    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"]
Sep 17 16:31:54.141779 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:54.141746    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-d73d44f4/custom-route-timeout-pd-test-kserve-router-scheduler-84c48wgqfc"]
Sep 17 16:31:55.652245 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:31:55.652209    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" path="/var/lib/kubelet/pods/1fa3172c-3c15-4c22-8579-a96b149e4f5c/volumes"
Sep 17 16:33:41.910904 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:33:41.910792    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:33:41.919365 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:33:41.919343    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:38:41.938051 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:38:41.937943    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:38:41.947944 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:38:41.947918    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:39:13.220551 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.220511    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"]
Sep 17 16:39:13.221149 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.220982    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerName="main"
Sep 17 16:39:13.221149 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.221001    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerName="main"
Sep 17 16:39:13.221149 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.221088    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa3172c-3c15-4c22-8579-a96b149e4f5c" containerName="main"
Sep 17 16:39:13.224077 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.224058    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:39:13.227983 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.227940    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"default-dockercfg-487d4\""
Sep 17 16:39:13.228125 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.227940    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"openshift-service-ca.crt\""
Sep 17 16:39:13.228125 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.228006    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"tls-verification-test-kserve-self-signed-certs\""
Sep 17 16:39:13.228125 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.227940    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"tls-verification-test-epp-sa-dockercfg-vf9zn\""
Sep 17 16:39:13.228125 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.227944    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-tls-resources-1d9e6e79\"/\"kube-root-ca.crt\""
Sep 17 16:39:13.234683 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.234658    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"]
Sep 17 16:39:13.276649 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.276604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjpx\" (UniqueName: \"kubernetes.io/projected/7c947f53-591f-4a41-9526-40194f32e945-kube-api-access-xjjpx\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g\" (UID: \"7c947f53-591f-4a41-9526-40194f32e945\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:39:13.276859 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.276695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c947f53-591f-4a41-9526-40194f32e945-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g\" (UID: \"7c947f53-591f-4a41-9526-40194f32e945\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:39:13.377559 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.377486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c947f53-591f-4a41-9526-40194f32e945-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g\" (UID: \"7c947f53-591f-4a41-9526-40194f32e945\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:39:13.377752 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.377583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjpx\" (UniqueName: \"kubernetes.io/projected/7c947f53-591f-4a41-9526-40194f32e945-kube-api-access-xjjpx\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g\" (UID: \"7c947f53-591f-4a41-9526-40194f32e945\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:39:13.380209 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.380183    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c947f53-591f-4a41-9526-40194f32e945-tls-certs\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g\" (UID: \"7c947f53-591f-4a41-9526-40194f32e945\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:39:13.387097 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.387058    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjpx\" (UniqueName: \"kubernetes.io/projected/7c947f53-591f-4a41-9526-40194f32e945-kube-api-access-xjjpx\") pod \"tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g\" (UID: \"7c947f53-591f-4a41-9526-40194f32e945\") " pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:39:13.535603 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.535474    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:39:13.826800 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:13.826715    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"]
Sep 17 16:39:13.830939 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:39:13.830910    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c947f53_591f_4a41_9526_40194f32e945.slice/crio-823011df3fd217d6cb8ebee6697bee3b17fd26c34cb49514565f0f1e2cba68bf WatchSource:0}: Error finding container 823011df3fd217d6cb8ebee6697bee3b17fd26c34cb49514565f0f1e2cba68bf: Status 404 returned error can't find the container with id 823011df3fd217d6cb8ebee6697bee3b17fd26c34cb49514565f0f1e2cba68bf
Sep 17 16:39:14.062650 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:14.062613    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" event={"ID":"7c947f53-591f-4a41-9526-40194f32e945","Type":"ContainerStarted","Data":"eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f"}
Sep 17 16:39:14.062837 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:14.062668    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" event={"ID":"7c947f53-591f-4a41-9526-40194f32e945","Type":"ContainerStarted","Data":"823011df3fd217d6cb8ebee6697bee3b17fd26c34cb49514565f0f1e2cba68bf"}
Sep 17 16:39:14.062837 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:14.062725    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:39:14.143966 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:14.143906    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" podStartSLOduration=1.143886414 podStartE2EDuration="1.143886414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:39:14.143274649 +0000 UTC m=+3632.924961985" watchObservedRunningTime="2026-09-17 16:39:14.143886414 +0000 UTC m=+3632.925573751"
Sep 17 16:39:45.069860 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:39:45.069825    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:41:17.869684 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:41:17.869647    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"]
Sep 17 16:41:25.069073 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:41:25.069029    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" podUID="7c947f53-591f-4a41-9526-40194f32e945" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:41:32.889555 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:41:32.889465    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" podUID="7c947f53-591f-4a41-9526-40194f32e945" containerName="main" containerID="cri-o://eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f" gracePeriod=45
Sep 17 16:41:35.069819 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:41:35.069730    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" podUID="7c947f53-591f-4a41-9526-40194f32e945" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:41:45.069417 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:41:45.069371    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" podUID="7c947f53-591f-4a41-9526-40194f32e945" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:41:45.069846 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:41:45.069481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:41:55.069361 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:41:55.069319    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" podUID="7c947f53-591f-4a41-9526-40194f32e945" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:42:03.152142 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.152113    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:42:03.283068 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.282975    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjjpx\" (UniqueName: \"kubernetes.io/projected/7c947f53-591f-4a41-9526-40194f32e945-kube-api-access-xjjpx\") pod \"7c947f53-591f-4a41-9526-40194f32e945\" (UID: \"7c947f53-591f-4a41-9526-40194f32e945\") "
Sep 17 16:42:03.283068 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.283056    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c947f53-591f-4a41-9526-40194f32e945-tls-certs\") pod \"7c947f53-591f-4a41-9526-40194f32e945\" (UID: \"7c947f53-591f-4a41-9526-40194f32e945\") "
Sep 17 16:42:03.285240 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.285211    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c947f53-591f-4a41-9526-40194f32e945-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c947f53-591f-4a41-9526-40194f32e945" (UID: "7c947f53-591f-4a41-9526-40194f32e945"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:42:03.285343 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.285237    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c947f53-591f-4a41-9526-40194f32e945-kube-api-access-xjjpx" (OuterVolumeSpecName: "kube-api-access-xjjpx") pod "7c947f53-591f-4a41-9526-40194f32e945" (UID: "7c947f53-591f-4a41-9526-40194f32e945"). InnerVolumeSpecName "kube-api-access-xjjpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:42:03.384339 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.384281    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjjpx\" (UniqueName: \"kubernetes.io/projected/7c947f53-591f-4a41-9526-40194f32e945-kube-api-access-xjjpx\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:42:03.384339 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.384330    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c947f53-591f-4a41-9526-40194f32e945-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:42:03.843944 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.843910    2582 generic.go:356] "Generic (PLEG): container finished" podID="7c947f53-591f-4a41-9526-40194f32e945" containerID="eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f" exitCode=0
Sep 17 16:42:03.844117 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.843960    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"
Sep 17 16:42:03.844117 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.843989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" event={"ID":"7c947f53-591f-4a41-9526-40194f32e945","Type":"ContainerDied","Data":"eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f"}
Sep 17 16:42:03.844117 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.844043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g" event={"ID":"7c947f53-591f-4a41-9526-40194f32e945","Type":"ContainerDied","Data":"823011df3fd217d6cb8ebee6697bee3b17fd26c34cb49514565f0f1e2cba68bf"}
Sep 17 16:42:03.844117 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.844067    2582 scope.go:117] "RemoveContainer" containerID="eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f"
Sep 17 16:42:03.852530 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.852491    2582 scope.go:117] "RemoveContainer" containerID="eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f"
Sep 17 16:42:03.852852 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:42:03.852831    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f\": container with ID starting with eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f not found: ID does not exist" containerID="eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f"
Sep 17 16:42:03.852908 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.852861    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f"} err="failed to get container status \"eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f\": rpc error: code = NotFound desc = could not find container \"eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f\": container with ID starting with eecb02e99c86865260431f85d2d3df2b3497f6bda62e956f24703bd9835dea8f not found: ID does not exist"
Sep 17 16:42:03.863808 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.863782    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"]
Sep 17 16:42:03.868854 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:03.868825    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-tls-resources-1d9e6e79/tls-verification-test-kserve-router-scheduler-77cd9c86c9-vqc6g"]
Sep 17 16:42:05.651134 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:42:05.651095    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c947f53-591f-4a41-9526-40194f32e945" path="/var/lib/kubelet/pods/7c947f53-591f-4a41-9526-40194f32e945/volumes"
Sep 17 16:43:41.966286 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:43:41.966171    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:43:41.976586 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:43:41.976562    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:44:26.215918 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.215882    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"]
Sep 17 16:44:26.216559 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.216243    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c947f53-591f-4a41-9526-40194f32e945" containerName="main"
Sep 17 16:44:26.216559 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.216256    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c947f53-591f-4a41-9526-40194f32e945" containerName="main"
Sep 17 16:44:26.216559 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.216326    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c947f53-591f-4a41-9526-40194f32e945" containerName="main"
Sep 17 16:44:26.218906 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.218884    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:44:26.222730 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.222701    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"default-dockercfg-hd5j4\""
Sep 17 16:44:26.222880 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.222855    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"openshift-service-ca.crt\""
Sep 17 16:44:26.222880 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.222837    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
Sep 17 16:44:26.223010 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.222848    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"kube-root-ca.crt\""
Sep 17 16:44:26.223010 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.222781    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-15d6126c\"/\"scheduler-configmap-ref-test-epp-sa-dockercfg-dg2g8\""
Sep 17 16:44:26.229973 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.229949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zm7n\" (UniqueName: \"kubernetes.io/projected/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-kube-api-access-6zm7n\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln\" (UID: \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:44:26.230099 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.229994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln\" (UID: \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:44:26.230712 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.230693    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"]
Sep 17 16:44:26.330482 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.330435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zm7n\" (UniqueName: \"kubernetes.io/projected/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-kube-api-access-6zm7n\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln\" (UID: \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:44:26.330684 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.330491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln\" (UID: \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:44:26.333169 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.333143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln\" (UID: \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:44:26.339754 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.339732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zm7n\" (UniqueName: \"kubernetes.io/projected/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-kube-api-access-6zm7n\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln\" (UID: \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\") " pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:44:26.530021 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.529923    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:44:26.807272 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:26.807246    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"]
Sep 17 16:44:26.809909 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:44:26.809881    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2476b2f2_3776_4bf6_be8a_9ad2196fab6c.slice/crio-93726e21de861e4d89cc001bd464da7077e8fa057dde9995b60fcb48e919312a WatchSource:0}: Error finding container 93726e21de861e4d89cc001bd464da7077e8fa057dde9995b60fcb48e919312a: Status 404 returned error can't find the container with id 93726e21de861e4d89cc001bd464da7077e8fa057dde9995b60fcb48e919312a
Sep 17 16:44:27.479351 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:27.479310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" event={"ID":"2476b2f2-3776-4bf6-be8a-9ad2196fab6c","Type":"ContainerStarted","Data":"c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b"}
Sep 17 16:44:27.479883 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:27.479371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" event={"ID":"2476b2f2-3776-4bf6-be8a-9ad2196fab6c","Type":"ContainerStarted","Data":"93726e21de861e4d89cc001bd464da7077e8fa057dde9995b60fcb48e919312a"}
Sep 17 16:44:27.479883 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:27.479423    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:44:27.498478 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:27.498414    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" podStartSLOduration=1.498397952 podStartE2EDuration="1.498397952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:44:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:27.496787239 +0000 UTC m=+3946.278474577" watchObservedRunningTime="2026-09-17 16:44:27.498397952 +0000 UTC m=+3946.280085289"
Sep 17 16:44:58.485867 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:44:58.485833    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:45:00.310427 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:00.310391    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"]
Sep 17 16:45:08.485195 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:08.485156    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" podUID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:45:15.336677 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:15.336611    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" podUID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" containerName="main" containerID="cri-o://c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b" gracePeriod=45
Sep 17 16:45:18.486110 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:18.486060    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" podUID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:45:28.485868 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:28.485825    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" podUID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:45:28.486270 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:28.485935    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:45:38.485191 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:38.485150    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" podUID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Sep 17 16:45:45.589232 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.589202    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:45:45.726238 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.726148    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zm7n\" (UniqueName: \"kubernetes.io/projected/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-kube-api-access-6zm7n\") pod \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\" (UID: \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\") "
Sep 17 16:45:45.726238 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.726210    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-tls-certs\") pod \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\" (UID: \"2476b2f2-3776-4bf6-be8a-9ad2196fab6c\") "
Sep 17 16:45:45.728436 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.728402    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-kube-api-access-6zm7n" (OuterVolumeSpecName: "kube-api-access-6zm7n") pod "2476b2f2-3776-4bf6-be8a-9ad2196fab6c" (UID: "2476b2f2-3776-4bf6-be8a-9ad2196fab6c"). InnerVolumeSpecName "kube-api-access-6zm7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:45:45.728590 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.728467    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2476b2f2-3776-4bf6-be8a-9ad2196fab6c" (UID: "2476b2f2-3776-4bf6-be8a-9ad2196fab6c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:45:45.827004 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.826970    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-tls-certs\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:45:45.827004 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.827000    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zm7n\" (UniqueName: \"kubernetes.io/projected/2476b2f2-3776-4bf6-be8a-9ad2196fab6c-kube-api-access-6zm7n\") on node \"ip-10-0-139-98.ec2.internal\" DevicePath \"\""
Sep 17 16:45:45.831868 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.831841    2582 generic.go:356] "Generic (PLEG): container finished" podID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" containerID="c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b" exitCode=0
Sep 17 16:45:45.831994 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.831882    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"
Sep 17 16:45:45.831994 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.831903    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" event={"ID":"2476b2f2-3776-4bf6-be8a-9ad2196fab6c","Type":"ContainerDied","Data":"c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b"}
Sep 17 16:45:45.831994 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.831950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln" event={"ID":"2476b2f2-3776-4bf6-be8a-9ad2196fab6c","Type":"ContainerDied","Data":"93726e21de861e4d89cc001bd464da7077e8fa057dde9995b60fcb48e919312a"}
Sep 17 16:45:45.831994 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.831970    2582 scope.go:117] "RemoveContainer" containerID="c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b"
Sep 17 16:45:45.843753 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.843732    2582 scope.go:117] "RemoveContainer" containerID="c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b"
Sep 17 16:45:45.844091 ip-10-0-139-98 kubenswrapper[2582]: E0917 16:45:45.844071    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b\": container with ID starting with c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b not found: ID does not exist" containerID="c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b"
Sep 17 16:45:45.844151 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.844101    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b"} err="failed to get container status \"c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b\": rpc error: code = NotFound desc = could not find container \"c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b\": container with ID starting with c5e2b9ec07baa1824bd00eed7dc3de61dca9a9742d43bd0c6376c8f62c6d7d5b not found: ID does not exist"
Sep 17 16:45:45.856368 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.856337    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"]
Sep 17 16:45:45.860631 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:45.860607    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-15d6126c/scheduler-configmap-ref-test-kserve-router-scheduler-566c9vtkln"]
Sep 17 16:45:47.650926 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:45:47.650888    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" path="/var/lib/kubelet/pods/2476b2f2-3776-4bf6-be8a-9ad2196fab6c/volumes"
Sep 17 16:47:56.728709 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:47:56.728678    2582 ???:1] "http: TLS handshake error from 10.0.135.243:45408: EOF"
Sep 17 16:47:56.812391 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:47:56.812357    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jgqwq_4b84ac7f-48e0-4feb-8753-3814ed307ae4/discovery/0.log"
Sep 17 16:47:57.739386 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:47:57.739349    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jgqwq_4b84ac7f-48e0-4feb-8753-3814ed307ae4/discovery/0.log"
Sep 17 16:47:59.066068 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:47:59.066035    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65dc8f76f5-69q8j_3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9/manager/0.log"
Sep 17 16:47:59.102365 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:47:59.102334    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-lbsqr_45ceaaed-8076-40f4-8d73-6981a7000e33/kuadrant-console-plugin/0.log"
Sep 17 16:48:04.858030 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:04.857992    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gr2d7_c3d650b9-e1ae-4f43-9f9e-47febc1e2384/global-pull-secret-syncer/0.log"
Sep 17 16:48:05.113737 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:05.113652    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tpr4v_003573b1-53df-4aaa-af7d-b9a29faa710e/konnectivity-agent/0.log"
Sep 17 16:48:05.199822 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:05.199788    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-98.ec2.internal_c2394f2888c8dc0f48381d6308cf0747/haproxy/0.log"
Sep 17 16:48:09.926330 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:09.926297    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65dc8f76f5-69q8j_3bf06ac4-b8bd-4cc7-a03b-24e3d9a14bd9/manager/0.log"
Sep 17 16:48:09.960605 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:09.960573    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-lbsqr_45ceaaed-8076-40f4-8d73-6981a7000e33/kuadrant-console-plugin/0.log"
Sep 17 16:48:11.893918 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:11.893890    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-rn7qn_d90707b6-3ea2-451f-ae71-37d1c2fbf114/kube-state-metrics/0.log"
Sep 17 16:48:11.924975 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:11.924896    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-rn7qn_d90707b6-3ea2-451f-ae71-37d1c2fbf114/kube-rbac-proxy-main/0.log"
Sep 17 16:48:11.954643 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:11.954615    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-rn7qn_d90707b6-3ea2-451f-ae71-37d1c2fbf114/kube-rbac-proxy-self/0.log"
Sep 17 16:48:12.094021 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.093990    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k6l42_8039d0d6-99cd-43b4-b88e-31b81d9a1494/node-exporter/0.log"
Sep 17 16:48:12.146593 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.146564    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k6l42_8039d0d6-99cd-43b4-b88e-31b81d9a1494/kube-rbac-proxy/0.log"
Sep 17 16:48:12.194091 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.194015    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k6l42_8039d0d6-99cd-43b4-b88e-31b81d9a1494/init-textfile/0.log"
Sep 17 16:48:12.696552 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.696521    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-n5kvp_23e2edfd-f23a-48b4-929a-cd05307c5edf/kube-rbac-proxy-main/0.log"
Sep 17 16:48:12.751622 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.751595    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-n5kvp_23e2edfd-f23a-48b4-929a-cd05307c5edf/kube-rbac-proxy-self/0.log"
Sep 17 16:48:12.796864 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.796795    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-n5kvp_23e2edfd-f23a-48b4-929a-cd05307c5edf/openshift-state-metrics/0.log"
Sep 17 16:48:12.852971 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.852939    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_427eaec3-7379-4721-bf20-a13c1c9b743a/prometheus/0.log"
Sep 17 16:48:12.879033 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.879006    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_427eaec3-7379-4721-bf20-a13c1c9b743a/config-reloader/0.log"
Sep 17 16:48:12.912149 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.912122    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_427eaec3-7379-4721-bf20-a13c1c9b743a/thanos-sidecar/0.log"
Sep 17 16:48:12.940377 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.940351    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_427eaec3-7379-4721-bf20-a13c1c9b743a/kube-rbac-proxy-web/0.log"
Sep 17 16:48:12.967161 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.967131    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_427eaec3-7379-4721-bf20-a13c1c9b743a/kube-rbac-proxy/0.log"
Sep 17 16:48:12.994372 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:12.994347    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_427eaec3-7379-4721-bf20-a13c1c9b743a/kube-rbac-proxy-thanos/0.log"
Sep 17 16:48:13.027232 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:13.027207    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_427eaec3-7379-4721-bf20-a13c1c9b743a/init-config-reloader/0.log"
Sep 17 16:48:13.143889 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:13.143860    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-xzx7f_ed2df3b9-f8cd-4eb3-a447-1700049b83c5/prometheus-operator-admission-webhook/0.log"
Sep 17 16:48:14.716140 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.716110    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-8tsqf_09eb77a8-df29-403b-8065-3b908e2d8f8d/networking-console-plugin/0.log"
Sep 17 16:48:14.944102 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.944062    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"]
Sep 17 16:48:14.944494 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.944477    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" containerName="main"
Sep 17 16:48:14.944494 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.944511    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" containerName="main"
Sep 17 16:48:14.944673 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.944603    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2476b2f2-3776-4bf6-be8a-9ad2196fab6c" containerName="main"
Sep 17 16:48:14.947751 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.947729    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:14.952415 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.952388    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-przwd\"/\"openshift-service-ca.crt\""
Sep 17 16:48:14.952549 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.952421    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-przwd\"/\"kube-root-ca.crt\""
Sep 17 16:48:14.953513 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.953484    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-przwd\"/\"default-dockercfg-gx5hg\""
Sep 17 16:48:14.972924 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:14.972846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"]
Sep 17 16:48:15.051532 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.051466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz6hg\" (UniqueName: \"kubernetes.io/projected/fc287ad9-e474-426e-9c64-4c66af93e45e-kube-api-access-pz6hg\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.051726 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.051544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-lib-modules\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.051726 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.051569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-podres\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.051726 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.051667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-sys\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.051726 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.051695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-proc\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.152160 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.152109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz6hg\" (UniqueName: \"kubernetes.io/projected/fc287ad9-e474-426e-9c64-4c66af93e45e-kube-api-access-pz6hg\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.152160 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.152162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-lib-modules\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.152408 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.152180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-podres\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.152408 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.152240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-sys\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.152408 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.152255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-proc\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.152408 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.152341    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-proc\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.152408 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.152341    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-sys\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.152408 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.152341    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-lib-modules\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.152408 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.152367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fc287ad9-e474-426e-9c64-4c66af93e45e-podres\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.161970 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.161943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz6hg\" (UniqueName: \"kubernetes.io/projected/fc287ad9-e474-426e-9c64-4c66af93e45e-kube-api-access-pz6hg\") pod \"perf-node-gather-daemonset-wtx6z\" (UID: \"fc287ad9-e474-426e-9c64-4c66af93e45e\") " pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.257895 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.257789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:15.464546 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.464480    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/2.log"
Sep 17 16:48:15.468814 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.468791    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-2wxrd_e0d41a6d-2b76-4fcb-a16d-424b7cfeaf22/console-operator/3.log"
Sep 17 16:48:15.539603 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:15.539386    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"]
Sep 17 16:48:15.542402 ip-10-0-139-98 kubenswrapper[2582]: W0917 16:48:15.542374    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc287ad9_e474_426e_9c64_4c66af93e45e.slice/crio-a12631b9d1062f22a84b52e4cb9d091483b7e468b79ae7659fee8e0137340ff3 WatchSource:0}: Error finding container a12631b9d1062f22a84b52e4cb9d091483b7e468b79ae7659fee8e0137340ff3: Status 404 returned error can't find the container with id a12631b9d1062f22a84b52e4cb9d091483b7e468b79ae7659fee8e0137340ff3
Sep 17 16:48:16.094291 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:16.094261    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-hlj6t_284c37c1-300d-4177-951c-d6418a04e2e2/download-server/0.log"
Sep 17 16:48:16.500960 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:16.500858    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z" event={"ID":"fc287ad9-e474-426e-9c64-4c66af93e45e","Type":"ContainerStarted","Data":"ca45d24782fa4ae0b83df3b173507dced585a063a84a0459e63c5e425dc29c25"}
Sep 17 16:48:16.501145 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:16.501017    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:16.501145 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:16.501064    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z" event={"ID":"fc287ad9-e474-426e-9c64-4c66af93e45e","Type":"ContainerStarted","Data":"a12631b9d1062f22a84b52e4cb9d091483b7e468b79ae7659fee8e0137340ff3"}
Sep 17 16:48:16.519826 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:16.519773    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z" podStartSLOduration=2.519755086 podStartE2EDuration="2.519755086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:48:16.519599019 +0000 UTC m=+4175.301286358" watchObservedRunningTime="2026-09-17 16:48:16.519755086 +0000 UTC m=+4175.301442451"
Sep 17 16:48:16.728071 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:16.728039    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-cxtv5_05328d82-b3e8-4769-b757-8dd85c904a62/volume-data-source-validator/0.log"
Sep 17 16:48:17.888119 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:17.888088    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8lsq_d4f9338a-7afd-40ed-a0f1-9590c3dd9922/dns/0.log"
Sep 17 16:48:17.914666 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:17.914642    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j8lsq_d4f9338a-7afd-40ed-a0f1-9590c3dd9922/kube-rbac-proxy/0.log"
Sep 17 16:48:18.009352 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:18.009322    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cpc7l_77bf9c98-b78e-40a0-b0fe-13ed68e9a31c/dns-node-resolver/0.log"
Sep 17 16:48:18.684657 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:18.684628    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69ccd54795-ckwx2_3c3287e0-00da-48be-a130-d83129515f62/registry/0.log"
Sep 17 16:48:18.808676 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:18.808648    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-45g96_1c2c3550-1ef1-47e3-a106-b211bcb731ec/node-ca/0.log"
Sep 17 16:48:20.014068 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:20.014025    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jgqwq_4b84ac7f-48e0-4feb-8753-3814ed307ae4/discovery/0.log"
Sep 17 16:48:20.685719 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:20.685694    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6j8lj_4d6b81c3-e9ce-4806-be6a-4baed8d7b876/serve-healthcheck-canary/0.log"
Sep 17 16:48:21.383266 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:21.383236    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-lcq4t_c64be236-027b-4f49-baa0-64c6025619e7/insights-operator/0.log"
Sep 17 16:48:21.384206 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:21.384190    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-lcq4t_c64be236-027b-4f49-baa0-64c6025619e7/insights-operator/1.log"
Sep 17 16:48:21.594834 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:21.594808    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk94n_e0c2575e-edf3-4945-95a2-ab07f2cd022f/kube-rbac-proxy/0.log"
Sep 17 16:48:21.620240 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:21.620212    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk94n_e0c2575e-edf3-4945-95a2-ab07f2cd022f/exporter/0.log"
Sep 17 16:48:21.654891 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:21.654819    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk94n_e0c2575e-edf3-4945-95a2-ab07f2cd022f/extractor/0.log"
Sep 17 16:48:22.515795 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:22.515764    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-przwd/perf-node-gather-daemonset-wtx6z"
Sep 17 16:48:25.018071 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:25.018036    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jgqwq_4b84ac7f-48e0-4feb-8753-3814ed307ae4/discovery/0.log"
Sep 17 16:48:25.150413 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:25.150377    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65f7746b69-9kkmr_e94c4095-b900-4eb7-8859-94740a8aa4ca/manager/0.log"
Sep 17 16:48:26.171269 ip-10-0-139-98 kubenswrapper[2582]: I0917 16:48:26.171231    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jgqwq_4b84ac7f-48e0-4feb-8753-3814ed307ae4/discovery/0.log"