Sep 17 17:33:57.244267 ip-10-0-134-49 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 17:34:00.591338 ip-10-0-134-49 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:34:00.591338 ip-10-0-134-49 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 17:34:00.591338 ip-10-0-134-49 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:34:00.591338 ip-10-0-134-49 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 17:34:00.591338 ip-10-0-134-49 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:34:00.592403 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.591482    2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 17:34:00.595250 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595229    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:00.595250 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595246    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:00.595250 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595251    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:00.595250 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595257    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595262    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595266    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595270    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595274    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595279    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595282    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595286    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595290    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595295    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595298    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595302    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595306    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595310    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595317    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595324    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595329    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595333    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595337    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:00.595500 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595341    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595345    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595349    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595354    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595357    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595361    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595370    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595375    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595380    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595385    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595390    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595394    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595399    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595403    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595408    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595413    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595417    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595422    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595426    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:00.596356 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595431    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595435    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595439    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595444    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595449    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595453    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595459    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595465    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595469    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595485    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595490    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595494    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595499    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595502    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595507    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595511    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595516    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595520    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595524    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595528    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:00.597187 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595532    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595536    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595539    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595544    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595548    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595552    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595556    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595560    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595567    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595572    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595577    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595582    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595587    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595591    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595595    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595599    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595604    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595608    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595612    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:00.598028 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595616    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595620    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595624    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595630    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595635    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595639    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595643    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595648    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595652    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595656    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595660    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595664    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595668    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595673    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595677    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595681    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595685    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595690    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.595694    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596892    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:00.598814 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596902    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596908    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596913    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596918    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596922    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596927    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596931    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596935    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596939    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596944    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596948    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596969    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596974    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596977    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596981    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596986    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596992    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.596997    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597001    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597005    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:00.599410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597009    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597013    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597017    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597022    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597026    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597030    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597035    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597039    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597043    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597048    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597052    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597056    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597064    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597069    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597073    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597078    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597082    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597086    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597093    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:00.599911 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597100    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597105    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597109    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597114    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597118    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597122    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597126    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597130    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597135    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597140    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597144    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597149    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597153    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597157    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597162    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597166    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597170    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597174    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597178    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:00.600395 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597182    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597186    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597190    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597194    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597198    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597202    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597208    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597213    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597217    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597221    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597247    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597253    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597257    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597264    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597270    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597275    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597279    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597284    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597288    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:00.600875 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597294    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597298    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597303    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597307    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597314    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597320    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597325    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597329    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597334    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597338    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597343    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597348    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597352    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597356    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597361    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597366    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597370    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597375    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597380    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597386    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:00.601355 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.597391    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598330    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598346    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598352    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598357    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598361    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598366    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598370    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598374    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598379    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598383    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598394    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598399    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598403    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598407    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598411    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598415    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598419    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598424    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598428    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:00.601841 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598432    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598437    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598441    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598445    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598456    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598462    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598467    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598471    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598475    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598480    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598484    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598488    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598493    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598497    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598504    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598509    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598519    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598523    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598528    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:00.602411 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598532    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598536    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598540    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598544    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598549    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598553    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598557    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598562    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598567    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598571    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598580    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598585    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598590    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598594    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598599    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598603    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598607    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598612    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598616    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598620    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:00.602882 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598625    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598629    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598638    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598643    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598647    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598654    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598658    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598667    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598673    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598677    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598682    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598687    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598691    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598695    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598700    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598710    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598715    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598719    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598724    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598728    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:00.603389 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598732    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598736    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598740    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598744    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598749    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598753    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598757    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598766    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598770    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598779    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598786    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598791    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598795    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598800    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598806    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598811    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598816    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598821    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598831    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:00.603927 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598839    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.598843    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599213    2586 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599270    2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599278    2586 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599283    2586 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599288    2586 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599291    2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599296    2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599300    2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599303    2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599306    2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599310    2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599313    2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599317    2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599320    2586 flags.go:64] FLAG: --cgroup-root=""
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599323    2586 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599326    2586 flags.go:64] FLAG: --client-ca-file=""
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599329    2586 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599332    2586 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599337    2586 flags.go:64] FLAG: --cluster-domain=""
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599340    2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599343    2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599347    2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 17:34:00.604400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599350    2586 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599354    2586 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599357    2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599361    2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599365    2586 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599368    2586 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599371    2586 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599375    2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599378    2586 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599381    2586 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599385    2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599388    2586 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599391    2586 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599394    2586 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599397    2586 flags.go:64] FLAG: --enable-server="true"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599400    2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599406    2586 flags.go:64] FLAG: --event-burst="100"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599409    2586 flags.go:64] FLAG: --event-qps="50"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599412    2586 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599415    2586 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599418    2586 flags.go:64] FLAG: --eviction-hard=""
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599422    2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599425    2586 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599428    2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599431    2586 flags.go:64] FLAG: --eviction-soft=""
Sep 17 17:34:00.605002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599435    2586 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599437    2586 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599440    2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599443    2586 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599447    2586 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599450    2586 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599453    2586 flags.go:64] FLAG: --feature-gates=""
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599457    2586 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599460    2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599463    2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599467    2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599470    2586 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599474    2586 flags.go:64] FLAG: --help="false"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599477    2586 flags.go:64] FLAG: --hostname-override="ip-10-0-134-49.ec2.internal"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599480    2586 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599483    2586 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599486    2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599491    2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599494    2586 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599497    2586 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599500    2586 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599503    2586 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599506    2586 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 17:34:00.605629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599509    2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599512    2586 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599515    2586 flags.go:64] FLAG: --kube-reserved=""
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599517    2586 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599520    2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599523    2586 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599526    2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599529    2586 flags.go:64] FLAG: --lock-file=""
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599532    2586 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599535    2586 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599538    2586 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599543    2586 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599546    2586 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599550    2586 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599553    2586 flags.go:64] FLAG: --logging-format="text"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599556    2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599560    2586 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599562    2586 flags.go:64] FLAG: --manifest-url=""
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599566    2586 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599570    2586 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599574    2586 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599578    2586 flags.go:64] FLAG: --max-pods="110"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599581    2586 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599587    2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599590    2586 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 17:34:00.606253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599593    2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599596    2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599599    2586 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599602    2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599611    2586 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599614    2586 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599617    2586 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599620    2586 flags.go:64] FLAG: --pod-cidr=""
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599623    2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599628    2586 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599632    2586 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599635    2586 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599638    2586 flags.go:64] FLAG: --port="10250"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599641    2586 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599644    2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c7e0beed4da79f39"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599647    2586 flags.go:64] FLAG: --qos-reserved=""
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599650    2586 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599653    2586 flags.go:64] FLAG: --register-node="true"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599656    2586 flags.go:64] FLAG: --register-with-taints=""
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599659    2586 flags.go:64] FLAG: --registry-burst="10"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599662    2586 flags.go:64] FLAG: --registry-qps="5"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599666    2586 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599669    2586 flags.go:64] FLAG: --reserved-memory=""
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599672    2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599675    2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 17:34:00.606871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599678    2586 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599681    2586 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599684    2586 flags.go:64] FLAG: --runonce="false"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599686    2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599689    2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599692    2586 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599697    2586 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599700    2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599703    2586 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599706    2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599709    2586 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599712    2586 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599715    2586 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599718    2586 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599721    2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599724    2586 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599727    2586 flags.go:64] FLAG: --system-cgroups=""
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599730    2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599736    2586 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599739    2586 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599741    2586 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599746    2586 flags.go:64] FLAG: --tls-min-version=""
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599749    2586 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599752    2586 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599755    2586 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 17:34:00.607530 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599757    2586 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599761    2586 flags.go:64] FLAG: --v="2"
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599765    2586 flags.go:64] FLAG: --version="false"
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599769    2586 flags.go:64] FLAG: --vmodule=""
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599773    2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.599776    2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599896    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599902    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599906    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599909    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599913    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599917    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599919    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599924    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599927    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599930    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599933    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599936    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599938    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599941    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599944    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:00.608163 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599947    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599964    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599970    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599974    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599979    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599982    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599984    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599987    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599990    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599992    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599995    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.599998    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600001    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600005    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600009    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600014    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600018    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600021    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600025    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600028    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:00.608665 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600030    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600033    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600036    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600038    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600044    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600047    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600050    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600053    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600056    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600058    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600061    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600063    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600066    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600069    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600071    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600074    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600078    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600082    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600084    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:00.609171 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600087    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600090    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600092    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600095    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600098    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600100    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600103    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600106    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600108    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600111    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600114    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600118    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600121    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600123    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600126    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600128    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600131    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600135    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600137    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600140    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:00.609655 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600142    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600145    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600148    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600150    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600153    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600155    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600158    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600162    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600166    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600169    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600172    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600174    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600177    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600179    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600182    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600185    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600188    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600190    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600193    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:00.610318 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600195    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600198    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600201    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600203    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600208    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.600211    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.600216    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.607012    2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.607027    2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.607047    2586 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.607053    2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607119    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607124    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607127    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607131    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:00.610823 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607134    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607137    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607139    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607142    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607145    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607147    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607152    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607155    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607158    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607161    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607164    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607168    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607171    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607174    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607177    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607180    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607183    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607186    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607188    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:00.611226 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607191    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607194    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607196    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607199    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607201    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607204    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607209    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607213    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607216    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607220    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607222    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607225    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607228    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607230    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607233    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607235    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607238    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607241    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607243    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607246    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:00.611686 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607248    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607251    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607254    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607256    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607259    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607261    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607264    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607267    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607269    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607272    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607275    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607277    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607280    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607282    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607285    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607287    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607290    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607292    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607296    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607299    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:00.612178 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607301    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607304    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607307    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607309    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607312    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607314    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607317    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607320    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607322    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607325    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607327    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607330    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607333    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607335    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607338    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607340    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607343    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607346    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607348    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:00.612679 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607351    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607353    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607356    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607358    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607361    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607364    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607366    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607369    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607372    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607374    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607377    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607380    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607383    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607387    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607389    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607392    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:00.613215 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607396    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.607401    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607513    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607517    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607520    2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607523    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607526    2586 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607529    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607532    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607535    2586 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607538    2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607540    2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607543    2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607546    2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607548    2586 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:34:00.613609 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607551    2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607553    2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607556    2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607558    2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607562    2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607566    2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607569    2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607572    2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607574    2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607577    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607580    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607583    2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607586    2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607589    2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607593    2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607597    2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607600    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607603    2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607606    2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:34:00.613987 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607609    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607611    2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607614    2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607617    2586 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607620    2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607622    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607625    2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607627    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607630    2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607632    2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607635    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607637    2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607640    2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607642    2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607645    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607648    2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607650    2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607652    2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607655    2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607657    2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:34:00.614459 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607660    2586 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607662    2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607665    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607667    2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607670    2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607672    2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607675    2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607678    2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607681    2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607684    2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607686    2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607689    2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607691    2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607694    2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607696    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607699    2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607701    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607704    2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607706    2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607709    2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:34:00.614935 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607711    2586 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607714    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607717    2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607719    2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607722    2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607724    2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607728    2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607731    2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607735    2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607737    2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607740    2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607743    2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607745    2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607748    2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607750    2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607753    2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607756    2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607758    2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607761    2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607764    2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:34:00.615432 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607766    2586 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607769    2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607772    2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607774    2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607777    2586 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607779    2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:00.607782    2586 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.607786    2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.607907    2586 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.610006    2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.610945    2586 server.go:1019] "Starting client certificate rotation"
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.611057    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.611087    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:34:00.616212 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.613530    2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:34:00.616540 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.615420    2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:34:00.621340 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.621326    2586 log.go:25] "Validated CRI v1 runtime API"
Sep 17 17:34:00.622902 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.622889    2586 log.go:25] "Validated CRI v1 image API"
Sep 17 17:34:00.626583 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.623691    2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 17:34:00.626583 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.626080    2586 fs.go:135] Filesystem UUIDs: map[78335657-8a6f-4044-a71d-7c0fb0c04a71:/dev/nvme0n1p3 79504727-a83a-4ea4-bc14-e3c57aad692d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 17 17:34:00.626583 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.626095    2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 17:34:00.632564 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.632414    2586 manager.go:216] Machine: {Timestamp:2026-09-17 17:34:00.631802329 +0000 UTC m=+1.959235422 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099030 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f044fadb643cff7c07209b9bc9dda SystemUUID:ec2f044f-adb6-43cf-f7c0-7209b9bc9dda BootID:ddbd0e37-857f-4828-80fa-a71b1685b805 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e9:4d:21:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e9:4d:21:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:87:37:82:d0:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 17:34:00.632564 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.632558    2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 17:34:00.632707 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.632662    2586 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 17:34:00.634287 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.634250    2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 17:34:00.634420 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.634290    2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 17:34:00.635033 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.635023    2586 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 17:34:00.635064 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.635035    2586 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 17:34:00.635064 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.635043    2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:34:00.635064 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.635055    2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:34:00.635147 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.635125    2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 17:34:00.639237 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.639226    2586 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:34:00.639343 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.639334    2586 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 17:34:00.639372 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.639367    2586 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 17:34:00.639402 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.639377    2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 17:34:00.639402 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.639388    2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 17:34:00.639402 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.639397    2586 kubelet.go:398] "Adding apiserver pod source"
Sep 17 17:34:00.639492 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.639406    2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 17:34:00.639752 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.639740    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:34:00.639801 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.639759    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:34:00.642408 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.641714    2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 17:34:00.644896 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.644881    2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 17:34:00.644979 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.644912    2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 17:34:00.645370 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.645354    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:34:00.646067 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646055    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 17:34:00.646114 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646072    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 17:34:00.646114 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646079    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 17:34:00.646114 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646084    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 17:34:00.646114 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646097    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 17:34:00.646114 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646106    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 17:34:00.646240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646119    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 17:34:00.646240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646124    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 17:34:00.646240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646131    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 17:34:00.646240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646137    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 17:34:00.646240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646146    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 17:34:00.646240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646151    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 17:34:00.646240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646177    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 17:34:00.646240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.646182    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 17:34:00.650004 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.649987    2586 server.go:1268] "Started kubelet"
Sep 17 17:34:00.650099 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.650060    2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 17:34:00.650099 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.650069    2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 17:34:00.650168 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.650110    2586 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 17:34:00.650721 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.650695    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 17:34:00.650800 ip-10-0-134-49 systemd[1]: Started Kubernetes Kubelet.
Sep 17 17:34:00.651258 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.650765    2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 17:34:00.651258 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.650854    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 17:34:00.651425 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.651410    2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 17:34:00.651977 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.651942    2586 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 17:34:00.656013 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.655983    2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 17:34:00.657569 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.657551    2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 17:34:00.657569 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.657562    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 17:34:00.657739 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.657712    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:00.682030 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.681809    2586 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 17:34:00.682156 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.682035    2586 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 17:34:00.682228 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.682184    2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 17:34:00.683282 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.683254    2586 factory.go:55] Registering systemd factory
Sep 17 17:34:00.683282 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.683277    2586 factory.go:223] Registration of the systemd container factory successfully
Sep 17 17:34:00.683414 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.683266    2586 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 17:34:00.683414 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.683346    2586 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 17:34:00.683712 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.683695    2586 factory.go:153] Registering CRI-O factory
Sep 17 17:34:00.683814 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.683804    2586 factory.go:223] Registration of the crio container factory successfully
Sep 17 17:34:00.683993 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.683982    2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 17:34:00.684108 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.683996    2586 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 17:34:00.684165 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.684097    2586 factory.go:103] Registering Raw factory
Sep 17 17:34:00.684165 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.684142    2586 manager.go:1196] Started watching for new ooms in manager
Sep 17 17:34:00.684298 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.684201    2586 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 17:34:00.684913 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.684898    2586 manager.go:349] Starting recovery of all containers
Sep 17 17:34:00.684989 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.684932    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7x57"
Sep 17 17:34:00.694968 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.694930    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7x57"
Sep 17 17:34:00.696094 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.696076    2586 manager.go:354] Recovery completed
Sep 17 17:34:00.698086 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.697162    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-49.ec2.internal.18d62c254d60a914  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-49.ec2.internal,UID:ip-10-0-134-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-49.ec2.internal,},FirstTimestamp:2026-09-17 17:34:00.649943316 +0000 UTC m=+1.977376410,LastTimestamp:2026-09-17 17:34:00.649943316 +0000 UTC m=+1.977376410,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-49.ec2.internal,}"
Sep 17 17:34:00.700536 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.700522    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:00.702264 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.702249    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:00.702340 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.702289    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:00.702340 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.702304    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:00.702894 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.702878    2586 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 17:34:00.702894 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.702892    2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 17:34:00.703072 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.702908    2586 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:34:00.703072 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.702884    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:00.703708 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.703691    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:00.703786 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.703718    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:00.703786 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.703732    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:00.704924 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.704910    2586 policy_none.go:49] "None policy: Start"
Sep 17 17:34:00.704924 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.704927    2586 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 17:34:00.705028 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.704936    2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 17:34:00.706768 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.706757    2586 policy_none.go:47] "Start"
Sep 17 17:34:00.740690 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.740675    2586 manager.go:337] "Starting Device Plugin manager"
Sep 17 17:34:00.757935 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.740720    2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 17:34:00.757935 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.740732    2586 server.go:87] "Starting device plugin registration server"
Sep 17 17:34:00.757935 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.740977    2586 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 17:34:00.757935 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.741000    2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 17:34:00.757935 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.741167    2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 17:34:00.757935 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.741239    2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 17:34:00.757935 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.741248    2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 17:34:00.757935 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.741707    2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 17:34:00.757935 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.741759    2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:00.810105 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.810066    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 17:34:00.811338 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.811318    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 17:34:00.811403 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.811385    2586 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 17:34:00.811453 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.811413    2586 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 17:34:00.811505 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.811460    2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 17:34:00.815213 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.815190    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:00.842656 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.842597    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:00.843583 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.843564    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:00.843689 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.843600    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:00.843689 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.843615    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:00.843689 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.843647    2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-49.ec2.internal"
Sep 17 17:34:00.856242 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.856217    2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-49.ec2.internal"
Sep 17 17:34:00.856363 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.856246    2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-49.ec2.internal\": node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:00.869227 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.869203    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:00.912291 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.912262    2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal"]
Sep 17 17:34:00.912426 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.912334    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:00.913372 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.913357    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:00.913433 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.913388    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:00.913433 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.913400    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:00.915706 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.915693    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:00.915839 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.915825    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:00.915897 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.915857    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:00.916498 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.916483    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:00.916498 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.916490    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:00.916648 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.916509    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:00.916648 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.916514    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:00.916648 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.916519    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:00.916648 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.916528    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:00.918696 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.918680    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:00.918776 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.918712    2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:34:00.919499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.919473    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:34:00.919499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.919493    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:34:00.919607 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.919503    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:34:00.932537 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.932514    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-49.ec2.internal\" not found" node="ip-10-0-134-49.ec2.internal"
Sep 17 17:34:00.936332 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.936312    2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-49.ec2.internal\" not found" node="ip-10-0-134-49.ec2.internal"
Sep 17 17:34:00.970255 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:00.970236    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:00.984965 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.984928    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aee03eb97d597f7e86718fd7ff3b97b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"aee03eb97d597f7e86718fd7ff3b97b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:00.985037 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.984970    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aee03eb97d597f7e86718fd7ff3b97b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"aee03eb97d597f7e86718fd7ff3b97b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:00.985424 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:00.985322    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/834198684fe123bac38328944a6fc1ae-config\") pod \"kube-apiserver-proxy-ip-10-0-134-49.ec2.internal\" (UID: \"834198684fe123bac38328944a6fc1ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:01.070865 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.070835    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:01.085886 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.085861    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aee03eb97d597f7e86718fd7ff3b97b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"aee03eb97d597f7e86718fd7ff3b97b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:01.085989 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.085890    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aee03eb97d597f7e86718fd7ff3b97b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"aee03eb97d597f7e86718fd7ff3b97b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:01.085989 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.085913    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/834198684fe123bac38328944a6fc1ae-config\") pod \"kube-apiserver-proxy-ip-10-0-134-49.ec2.internal\" (UID: \"834198684fe123bac38328944a6fc1ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:01.086069 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.086006    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aee03eb97d597f7e86718fd7ff3b97b2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"aee03eb97d597f7e86718fd7ff3b97b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:01.086069 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.086005    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aee03eb97d597f7e86718fd7ff3b97b2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal\" (UID: \"aee03eb97d597f7e86718fd7ff3b97b2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:01.086069 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.086056    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/834198684fe123bac38328944a6fc1ae-config\") pod \"kube-apiserver-proxy-ip-10-0-134-49.ec2.internal\" (UID: \"834198684fe123bac38328944a6fc1ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:01.171469 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.171405    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:01.235866 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.235833    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:01.239774 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.239757    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:01.271527 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.271496    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:01.372059 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.372021    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:01.472662 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.472603    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:01.573367 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.573324    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:01.610800 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.610763    2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 17:34:01.611266 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.610938    2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 17:34:01.674258 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.674062    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:01.677976 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.677944    2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:01.699015 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.698981    2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:01.700968 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.700914    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:29:00 +0000 UTC" deadline="2028-04-13 14:29:19.063427811 +0000 UTC"
Sep 17 17:34:01.701080 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.700973    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13772h55m17.362460956s"
Sep 17 17:34:01.774372 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.774293    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:01.848142 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:01.848113    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee03eb97d597f7e86718fd7ff3b97b2.slice/crio-9ded5f150065033f86d16c9cb2aa8bff4c1fb0c7ccfcd8340471f895121b2cc0 WatchSource:0}: Error finding container 9ded5f150065033f86d16c9cb2aa8bff4c1fb0c7ccfcd8340471f895121b2cc0: Status 404 returned error can't find the container with id 9ded5f150065033f86d16c9cb2aa8bff4c1fb0c7ccfcd8340471f895121b2cc0
Sep 17 17:34:01.848510 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:01.848490    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834198684fe123bac38328944a6fc1ae.slice/crio-a77b796fdb2fabf5f8d2f0d30e47742fb1611a9a06bd5334466444cd7fd8e39b WatchSource:0}: Error finding container a77b796fdb2fabf5f8d2f0d30e47742fb1611a9a06bd5334466444cd7fd8e39b: Status 404 returned error can't find the container with id a77b796fdb2fabf5f8d2f0d30e47742fb1611a9a06bd5334466444cd7fd8e39b
Sep 17 17:34:01.853545 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:01.853528    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:34:01.874616 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.874591    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:01.975187 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:01.975164    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:02.075780 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.075707    2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-49.ec2.internal\" not found"
Sep 17 17:34:02.102307 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.102279    2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:02.157844 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.157802    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:02.172829 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.172803    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:34:02.173821 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.173805    2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal"
Sep 17 17:34:02.197443 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.197416    2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:34:02.640417 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.640386    2586 apiserver.go:52] "Watching apiserver"
Sep 17 17:34:02.648491 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.648464    2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 17:34:02.649026 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.649005    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pws9z","kube-system/konnectivity-agent-xjj6f","openshift-cluster-node-tuning-operator/tuned-hqpt6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal","openshift-multus/multus-additional-cni-plugins-v7xp5","openshift-multus/network-metrics-daemon-d5rkr","openshift-network-operator/iptables-alerter-svslh","kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq","openshift-dns/node-resolver-g9ckj","openshift-image-registry/node-ca-kkv5p","openshift-multus/multus-wvvrl","openshift-network-diagnostics/network-check-target-tk2m6","openshift-ovn-kubernetes/ovnkube-node-ksrc4"]
Sep 17 17:34:02.651613 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.651497    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.653944 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.653923    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.654615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.654458    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 17:34:02.654615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.654464    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l5bcg\""
Sep 17 17:34:02.654615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.654520    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 17:34:02.657319 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.656177    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.657319 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.656247    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 17:34:02.657319 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.656314    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 17:34:02.657319 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.656465    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 17:34:02.657319 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.656649    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z9cx6\""
Sep 17 17:34:02.658984 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.658926    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 17:34:02.659217 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.659193    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.660110 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.659936    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 17:34:02.660110 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.659942    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:34:02.660110 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.660075    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9rm4q\""
Sep 17 17:34:02.661448 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.661410    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.662890 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.662868    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 17:34:02.663695 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.663672    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 17:34:02.664281 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.664263    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 17:34:02.666654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.666082    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2t488\""
Sep 17 17:34:02.666654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.666144    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 17:34:02.666654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.666088    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 17:34:02.666654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.666085    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 17:34:02.666654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.666344    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 17:34:02.666654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.666626    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 17:34:02.666654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.666636    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:02.667181 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.666726    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:02.667181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.667027    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 17:34:02.667181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.667036    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8ncd2\""
Sep 17 17:34:02.667181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.667120    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 17:34:02.672769 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.672127    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.675145 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.674495    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 17:34:02.675145 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.674551    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 17:34:02.675145 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.674787    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9gm2l\""
Sep 17 17:34:02.675145 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.674794    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:02.675145 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.674870    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:02.675145 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.675009    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 17:34:02.677638 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.677613    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:02.680578 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.680178    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hs7rn\""
Sep 17 17:34:02.680578 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.680206    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.680578 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.680463    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 17:34:02.680753 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.680673    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 17:34:02.681080 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.680908    2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:34:02.682975 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.682811    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:02.682975 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.682928    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:02.683561 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.683275    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:34:02.683561 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.683360    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 17:34:02.683561 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.683386    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 17:34:02.683561 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.683454    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d986h\""
Sep 17 17:34:02.685869 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.685853    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.686478 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.686459    2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:34:02.688166 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.688132    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 17:34:02.688285 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.688271    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-btd7d\""
Sep 17 17:34:02.688528 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.688510    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 17:34:02.694417 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694327    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/604f5e26-05da-4f91-8248-26987e9682ac-cni-binary-copy\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.694417 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694363    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-multus-socket-dir-parent\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.694417 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694388    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/194c53c0-2f53-4d58-8774-9581748ac651-env-overrides\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.694643 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694458    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-run\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.694643 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694567    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-run-netns\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.694643 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694599    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-var-lib-cni-bin\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.694643 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694624    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-device-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.694840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694647    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:02.694840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694671    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-kubernetes\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.694840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694692    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-systemd\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.694840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694715    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-registration-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.694840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694736    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-systemd-units\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.694840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694775    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.694840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694798    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-system-cni-dir\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694844    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqljh\" (UniqueName: \"kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh\") pod \"network-check-target-tk2m6\" (UID: \"256f18d6-4ac7-48f0-b77d-65436ce0b37b\") " pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694870    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-var-lib-openvswitch\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694898    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-run-openvswitch\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694922    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-node-log\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694945    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.694982    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64eb3efe-305b-4efd-bcc1-1381b298e187-host\") pod \"node-ca-kkv5p\" (UID: \"64eb3efe-305b-4efd-bcc1-1381b298e187\") " pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695004    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64eb3efe-305b-4efd-bcc1-1381b298e187-serviceca\") pod \"node-ca-kkv5p\" (UID: \"64eb3efe-305b-4efd-bcc1-1381b298e187\") " pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695026    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/333ce5a7-0e31-40c2-9929-b855616daf6a-hosts-file\") pod \"node-resolver-g9ckj\" (UID: \"333ce5a7-0e31-40c2-9929-b855616daf6a\") " pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695047    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-var-lib-kubelet\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695068    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-etc-kubernetes\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695126    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-socket-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695156    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40d26571-4278-4f4d-8a25-c9c5657bf46b-konnectivity-ca\") pod \"konnectivity-agent-xjj6f\" (UID: \"40d26571-4278-4f4d-8a25-c9c5657bf46b\") " pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:02.695210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695208    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-kubelet\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695275    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-run-systemd\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695301    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/194c53c0-2f53-4d58-8774-9581748ac651-ovnkube-config\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695352    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96bhx\" (UniqueName: \"kubernetes.io/projected/53437e34-2e7d-4e34-a8b6-6886e50a8463-kube-api-access-96bhx\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695379    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-modprobe-d\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695418    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-multus-cni-dir\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695442    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-cnibin\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695467    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-multus-conf-dir\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695492    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-etc-openvswitch\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695534    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dc25d40-08c5-40a9-af7f-94ff0f1ddb32-host-slash\") pod \"iptables-alerter-svslh\" (UID: \"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32\") " pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695556    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-dbus\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695579    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-sysconfig\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695600    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-sysctl-d\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695623    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-hostroot\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695649    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-slash\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695712    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9ng5\" (UniqueName: \"kubernetes.io/projected/2dc25d40-08c5-40a9-af7f-94ff0f1ddb32-kube-api-access-x9ng5\") pod \"iptables-alerter-svslh\" (UID: \"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32\") " pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695742    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-kubelet-config\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:02.695889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695787    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-lib-modules\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695815    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-sys-fs\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695839    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-run-ovn\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695866    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-var-lib-kubelet\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695892    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch9h8\" (UniqueName: \"kubernetes.io/projected/9b70324b-83b2-41ee-a0cb-2d84257af56d-kube-api-access-ch9h8\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695915    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxxt8\" (UniqueName: \"kubernetes.io/projected/604f5e26-05da-4f91-8248-26987e9682ac-kube-api-access-xxxt8\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695937    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.695976    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40d26571-4278-4f4d-8a25-c9c5657bf46b-agent-certs\") pod \"konnectivity-agent-xjj6f\" (UID: \"40d26571-4278-4f4d-8a25-c9c5657bf46b\") " pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696002    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-log-socket\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696023    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-cni-bin\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696044    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wx9h\" (UniqueName: \"kubernetes.io/projected/333ce5a7-0e31-40c2-9929-b855616daf6a-kube-api-access-4wx9h\") pod \"node-resolver-g9ckj\" (UID: \"333ce5a7-0e31-40c2-9929-b855616daf6a\") " pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696068    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-run-k8s-cni-cncf-io\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696095    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-run-netns\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696118    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-cni-netd\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696147    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/194c53c0-2f53-4d58-8774-9581748ac651-ovnkube-script-lib\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696187    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:02.696655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696223    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333ce5a7-0e31-40c2-9929-b855616daf6a-tmp-dir\") pod \"node-resolver-g9ckj\" (UID: \"333ce5a7-0e31-40c2-9929-b855616daf6a\") " pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696282    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvh9b\" (UniqueName: \"kubernetes.io/projected/64eb3efe-305b-4efd-bcc1-1381b298e187-kube-api-access-bvh9b\") pod \"node-ca-kkv5p\" (UID: \"64eb3efe-305b-4efd-bcc1-1381b298e187\") " pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696335    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-sysctl-conf\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696385    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-sys\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696411    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-host\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696441    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b70324b-83b2-41ee-a0cb-2d84257af56d-tmp\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696499    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-run-multus-certs\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696525    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-tuned\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696555    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-var-lib-cni-multus\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696570    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/604f5e26-05da-4f91-8248-26987e9682ac-multus-daemon-config\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696583    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696596    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw7w2\" (UniqueName: \"kubernetes.io/projected/02283208-4f60-4962-a558-00e6236394bf-kube-api-access-kw7w2\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696627    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/194c53c0-2f53-4d58-8774-9581748ac651-ovn-node-metrics-cert\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696669    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2dc25d40-08c5-40a9-af7f-94ff0f1ddb32-iptables-alerter-script\") pod \"iptables-alerter-svslh\" (UID: \"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32\") " pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.697369 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.696701    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2db7g\" (UniqueName: \"kubernetes.io/projected/194c53c0-2f53-4d58-8774-9581748ac651-kube-api-access-2db7g\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.783222 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.783144    2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 17:34:02.797462 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797430    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333ce5a7-0e31-40c2-9929-b855616daf6a-tmp-dir\") pod \"node-resolver-g9ckj\" (UID: \"333ce5a7-0e31-40c2-9929-b855616daf6a\") " pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.797615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797471    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvh9b\" (UniqueName: \"kubernetes.io/projected/64eb3efe-305b-4efd-bcc1-1381b298e187-kube-api-access-bvh9b\") pod \"node-ca-kkv5p\" (UID: \"64eb3efe-305b-4efd-bcc1-1381b298e187\") " pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.797615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797498    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-sysctl-conf\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.797615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797523    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-sys\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.797615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797546    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-host\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.797615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797566    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b70324b-83b2-41ee-a0cb-2d84257af56d-tmp\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.797615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797592    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-run-multus-certs\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.797615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797615    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-tuned\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797638    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-var-lib-cni-multus\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797661    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/604f5e26-05da-4f91-8248-26987e9682ac-multus-daemon-config\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797685    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797706    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-run-multus-certs\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797711    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw7w2\" (UniqueName: \"kubernetes.io/projected/02283208-4f60-4962-a558-00e6236394bf-kube-api-access-kw7w2\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797741    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-sysctl-conf\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797766    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/194c53c0-2f53-4d58-8774-9581748ac651-ovn-node-metrics-cert\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797770    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-host\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797657    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-sys\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797823    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-var-lib-cni-multus\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797823    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/333ce5a7-0e31-40c2-9929-b855616daf6a-tmp-dir\") pod \"node-resolver-g9ckj\" (UID: \"333ce5a7-0e31-40c2-9929-b855616daf6a\") " pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797898    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.798011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.797987    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2dc25d40-08c5-40a9-af7f-94ff0f1ddb32-iptables-alerter-script\") pod \"iptables-alerter-svslh\" (UID: \"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32\") " pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798030    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2db7g\" (UniqueName: \"kubernetes.io/projected/194c53c0-2f53-4d58-8774-9581748ac651-kube-api-access-2db7g\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798060    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-cnibin\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798084    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn9ct\" (UniqueName: \"kubernetes.io/projected/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-kube-api-access-pn9ct\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798112    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/604f5e26-05da-4f91-8248-26987e9682ac-cni-binary-copy\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798106    2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798153    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-multus-socket-dir-parent\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798182    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/194c53c0-2f53-4d58-8774-9581748ac651-env-overrides\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798204    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-run\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798332    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-run\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798336    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-multus-socket-dir-parent\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798373    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-run-netns\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798400    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-var-lib-cni-bin\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798422    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-device-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.798449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798446    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798469    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-kubernetes\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798491    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-systemd\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798510    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-var-lib-cni-bin\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798516    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-registration-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798552    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/604f5e26-05da-4f91-8248-26987e9682ac-multus-daemon-config\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798565    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/604f5e26-05da-4f91-8248-26987e9682ac-cni-binary-copy\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798560    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-systemd-units\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798555    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-run-netns\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798587    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2dc25d40-08c5-40a9-af7f-94ff0f1ddb32-iptables-alerter-script\") pod \"iptables-alerter-svslh\" (UID: \"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32\") " pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798596    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-kubernetes\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798604    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798633    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-system-cni-dir\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798650    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-systemd-units\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798664    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqljh\" (UniqueName: \"kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh\") pod \"network-check-target-tk2m6\" (UID: \"256f18d6-4ac7-48f0-b77d-65436ce0b37b\") " pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.798668    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798694    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-registration-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798709    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-systemd\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.799071 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798711    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798708    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-var-lib-openvswitch\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798737    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-device-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798750    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-var-lib-openvswitch\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798756    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/194c53c0-2f53-4d58-8774-9581748ac651-env-overrides\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798777    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-run-openvswitch\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798800    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-node-log\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798804    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-system-cni-dir\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.798825    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs podName:53437e34-2e7d-4e34-a8b6-6886e50a8463 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:03.298804762 +0000 UTC m=+4.626237851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs") pod "network-metrics-daemon-d5rkr" (UID: "53437e34-2e7d-4e34-a8b6-6886e50a8463") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798835    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-node-log\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798844    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-run-openvswitch\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798857    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798882    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64eb3efe-305b-4efd-bcc1-1381b298e187-host\") pod \"node-ca-kkv5p\" (UID: \"64eb3efe-305b-4efd-bcc1-1381b298e187\") " pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798904    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64eb3efe-305b-4efd-bcc1-1381b298e187-serviceca\") pod \"node-ca-kkv5p\" (UID: \"64eb3efe-305b-4efd-bcc1-1381b298e187\") " pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798911    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798946    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/64eb3efe-305b-4efd-bcc1-1381b298e187-host\") pod \"node-ca-kkv5p\" (UID: \"64eb3efe-305b-4efd-bcc1-1381b298e187\") " pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798926    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/333ce5a7-0e31-40c2-9929-b855616daf6a-hosts-file\") pod \"node-resolver-g9ckj\" (UID: \"333ce5a7-0e31-40c2-9929-b855616daf6a\") " pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.799911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.798986    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/333ce5a7-0e31-40c2-9929-b855616daf6a-hosts-file\") pod \"node-resolver-g9ckj\" (UID: \"333ce5a7-0e31-40c2-9929-b855616daf6a\") " pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799013    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-var-lib-kubelet\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799039    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-etc-kubernetes\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799044    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-var-lib-kubelet\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799067    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799094    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-socket-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799121    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40d26571-4278-4f4d-8a25-c9c5657bf46b-konnectivity-ca\") pod \"konnectivity-agent-xjj6f\" (UID: \"40d26571-4278-4f4d-8a25-c9c5657bf46b\") " pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799176    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-socket-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799095    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-etc-kubernetes\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799190    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-kubelet\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799221    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-kubelet\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799223    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-run-systemd\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799251    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-run-systemd\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799254    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/194c53c0-2f53-4d58-8774-9581748ac651-ovnkube-config\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799290    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96bhx\" (UniqueName: \"kubernetes.io/projected/53437e34-2e7d-4e34-a8b6-6886e50a8463-kube-api-access-96bhx\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799326    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-system-cni-dir\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799338    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/64eb3efe-305b-4efd-bcc1-1381b298e187-serviceca\") pod \"node-ca-kkv5p\" (UID: \"64eb3efe-305b-4efd-bcc1-1381b298e187\") " pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.800843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799355    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-cni-binary-copy\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799381    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-modprobe-d\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799405    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-multus-cni-dir\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799428    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-cnibin\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799449    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-multus-conf-dir\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799472    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-etc-openvswitch\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799496    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dc25d40-08c5-40a9-af7f-94ff0f1ddb32-host-slash\") pod \"iptables-alerter-svslh\" (UID: \"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32\") " pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799524    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-dbus\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799628    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-multus-cni-dir\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799628    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-dbus\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799650    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-multus-conf-dir\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799664    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-sysconfig\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799670    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-modprobe-d\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799685    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/194c53c0-2f53-4d58-8774-9581748ac651-ovnkube-config\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799686    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40d26571-4278-4f4d-8a25-c9c5657bf46b-konnectivity-ca\") pod \"konnectivity-agent-xjj6f\" (UID: \"40d26571-4278-4f4d-8a25-c9c5657bf46b\") " pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799703    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-etc-openvswitch\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799708    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-sysconfig\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799703    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-sysctl-d\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.802543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799737    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dc25d40-08c5-40a9-af7f-94ff0f1ddb32-host-slash\") pod \"iptables-alerter-svslh\" (UID: \"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32\") " pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799738    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-cnibin\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799748    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-hostroot\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799774    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-slash\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799789    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-sysctl-d\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799799    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9ng5\" (UniqueName: \"kubernetes.io/projected/2dc25d40-08c5-40a9-af7f-94ff0f1ddb32-kube-api-access-x9ng5\") pod \"iptables-alerter-svslh\" (UID: \"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32\") " pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799818    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-hostroot\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799829    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-kubelet-config\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799854    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-lib-modules\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799847    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-slash\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799874    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-kubelet-config\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799890    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-sys-fs\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799917    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-run-ovn\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799929    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-sys-fs\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799939    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-lib-modules\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799944    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.799982    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-run-ovn\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800000    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-var-lib-kubelet\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.803499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800025    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch9h8\" (UniqueName: \"kubernetes.io/projected/9b70324b-83b2-41ee-a0cb-2d84257af56d-kube-api-access-ch9h8\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800049    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxxt8\" (UniqueName: \"kubernetes.io/projected/604f5e26-05da-4f91-8248-26987e9682ac-kube-api-access-xxxt8\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800072    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800095    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40d26571-4278-4f4d-8a25-c9c5657bf46b-agent-certs\") pod \"konnectivity-agent-xjj6f\" (UID: \"40d26571-4278-4f4d-8a25-c9c5657bf46b\") " pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800118    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-log-socket\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800104    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b70324b-83b2-41ee-a0cb-2d84257af56d-var-lib-kubelet\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800140    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-cni-bin\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800166    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wx9h\" (UniqueName: \"kubernetes.io/projected/333ce5a7-0e31-40c2-9929-b855616daf6a-kube-api-access-4wx9h\") pod \"node-resolver-g9ckj\" (UID: \"333ce5a7-0e31-40c2-9929-b855616daf6a\") " pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800172    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02283208-4f60-4962-a558-00e6236394bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800189    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-run-k8s-cni-cncf-io\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800213    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-run-netns\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800236    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-cni-netd\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800257    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-cni-bin\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800260    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/194c53c0-2f53-4d58-8774-9581748ac651-ovnkube-script-lib\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800294    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800324    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800362    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-log-socket\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.804349 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.800426    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:02.805148 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.800471    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret podName:0dcd31c7-6f39-4ed1-83b5-08dc2a872864 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:03.300457228 +0000 UTC m=+4.627890309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret") pod "global-pull-secret-syncer-pws9z" (UID: "0dcd31c7-6f39-4ed1-83b5-08dc2a872864") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:02.805148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800510    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/604f5e26-05da-4f91-8248-26987e9682ac-host-run-k8s-cni-cncf-io\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.805148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800660    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-run-netns\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.805148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800715    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/194c53c0-2f53-4d58-8774-9581748ac651-host-cni-netd\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.805148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.800749    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/194c53c0-2f53-4d58-8774-9581748ac651-ovnkube-script-lib\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.805148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.802106    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b70324b-83b2-41ee-a0cb-2d84257af56d-tmp\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.805148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.802212    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/194c53c0-2f53-4d58-8774-9581748ac651-ovn-node-metrics-cert\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.805148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.802462    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b70324b-83b2-41ee-a0cb-2d84257af56d-etc-tuned\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.805148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.803352    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40d26571-4278-4f4d-8a25-c9c5657bf46b-agent-certs\") pod \"konnectivity-agent-xjj6f\" (UID: \"40d26571-4278-4f4d-8a25-c9c5657bf46b\") " pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:02.805861 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.805844    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:02.805970 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.805866    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:02.805970 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.805878    2586 projected.go:196] Error preparing data for projected volume kube-api-access-zqljh for pod openshift-network-diagnostics/network-check-target-tk2m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:02.805970 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:02.805937    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh podName:256f18d6-4ac7-48f0-b77d-65436ce0b37b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:03.30592057 +0000 UTC m=+4.633353671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zqljh" (UniqueName: "kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh") pod "network-check-target-tk2m6" (UID: "256f18d6-4ac7-48f0-b77d-65436ce0b37b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:02.808301 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.808280    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw7w2\" (UniqueName: \"kubernetes.io/projected/02283208-4f60-4962-a558-00e6236394bf-kube-api-access-kw7w2\") pod \"aws-ebs-csi-driver-node-g6tkq\" (UID: \"02283208-4f60-4962-a558-00e6236394bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:02.808573 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.808539    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvh9b\" (UniqueName: \"kubernetes.io/projected/64eb3efe-305b-4efd-bcc1-1381b298e187-kube-api-access-bvh9b\") pod \"node-ca-kkv5p\" (UID: \"64eb3efe-305b-4efd-bcc1-1381b298e187\") " pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.808700 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.808582    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2db7g\" (UniqueName: \"kubernetes.io/projected/194c53c0-2f53-4d58-8774-9581748ac651-kube-api-access-2db7g\") pod \"ovnkube-node-ksrc4\" (UID: \"194c53c0-2f53-4d58-8774-9581748ac651\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.811131 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.811098    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch9h8\" (UniqueName: \"kubernetes.io/projected/9b70324b-83b2-41ee-a0cb-2d84257af56d-kube-api-access-ch9h8\") pod \"tuned-hqpt6\" (UID: \"9b70324b-83b2-41ee-a0cb-2d84257af56d\") " pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.811441 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.811420    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96bhx\" (UniqueName: \"kubernetes.io/projected/53437e34-2e7d-4e34-a8b6-6886e50a8463-kube-api-access-96bhx\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:02.815198 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.815175    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9ng5\" (UniqueName: \"kubernetes.io/projected/2dc25d40-08c5-40a9-af7f-94ff0f1ddb32-kube-api-access-x9ng5\") pod \"iptables-alerter-svslh\" (UID: \"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32\") " pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:02.815313 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.815175    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wx9h\" (UniqueName: \"kubernetes.io/projected/333ce5a7-0e31-40c2-9929-b855616daf6a-kube-api-access-4wx9h\") pod \"node-resolver-g9ckj\" (UID: \"333ce5a7-0e31-40c2-9929-b855616daf6a\") " pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.815706 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.815672    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxxt8\" (UniqueName: \"kubernetes.io/projected/604f5e26-05da-4f91-8248-26987e9682ac-kube-api-access-xxxt8\") pod \"multus-wvvrl\" (UID: \"604f5e26-05da-4f91-8248-26987e9682ac\") " pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:02.817124 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.817079    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" event={"ID":"834198684fe123bac38328944a6fc1ae","Type":"ContainerStarted","Data":"a77b796fdb2fabf5f8d2f0d30e47742fb1611a9a06bd5334466444cd7fd8e39b"}
Sep 17 17:34:02.818311 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.818288    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" event={"ID":"aee03eb97d597f7e86718fd7ff3b97b2","Type":"ContainerStarted","Data":"9ded5f150065033f86d16c9cb2aa8bff4c1fb0c7ccfcd8340471f895121b2cc0"}
Sep 17 17:34:02.823684 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.823662    2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7pcx"
Sep 17 17:34:02.839015 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.838981    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7pcx"
Sep 17 17:34:02.901029 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.900997    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901029 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901030    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-system-cni-dir\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901047    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-cni-binary-copy\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901081    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901112    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901108    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-system-cni-dir\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901164    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-cnibin\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901193    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn9ct\" (UniqueName: \"kubernetes.io/projected/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-kube-api-access-pn9ct\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901488 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901281    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901488 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901281    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-cnibin\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901682 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901661    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901766 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901712    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-cni-binary-copy\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.901766 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.901737    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.914088 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.914059    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn9ct\" (UniqueName: \"kubernetes.io/projected/8b6bcc9f-37b4-4bf3-8460-7182df774ca5-kube-api-access-pn9ct\") pod \"multus-additional-cni-plugins-v7xp5\" (UID: \"8b6bcc9f-37b4-4bf3-8460-7182df774ca5\") " pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:02.966005 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.965971    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g9ckj"
Sep 17 17:34:02.975137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.975107    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kkv5p"
Sep 17 17:34:02.987060 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.987030    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hqpt6"
Sep 17 17:34:02.991331 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.991309    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:02.999081 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:02.999048    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wvvrl"
Sep 17 17:34:03.005815 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.005790    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq"
Sep 17 17:34:03.015657 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.015629    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:03.023477 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.023452    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-svslh"
Sep 17 17:34:03.028729 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.028710    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v7xp5"
Sep 17 17:34:03.303702 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.303670    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:03.303874 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.303750    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:03.303874 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.303832    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:03.303874 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.303863    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:03.304023 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.303893    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs podName:53437e34-2e7d-4e34-a8b6-6886e50a8463 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:04.303877946 +0000 UTC m=+5.631311027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs") pod "network-metrics-daemon-d5rkr" (UID: "53437e34-2e7d-4e34-a8b6-6886e50a8463") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:03.304023 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.303911    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret podName:0dcd31c7-6f39-4ed1-83b5-08dc2a872864 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:04.303904482 +0000 UTC m=+5.631337564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret") pod "global-pull-secret-syncer-pws9z" (UID: "0dcd31c7-6f39-4ed1-83b5-08dc2a872864") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:03.404786 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.404757    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqljh\" (UniqueName: \"kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh\") pod \"network-check-target-tk2m6\" (UID: \"256f18d6-4ac7-48f0-b77d-65436ce0b37b\") " pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:03.404963 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.404873    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:03.404963 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.404889    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:03.404963 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.404899    2586 projected.go:196] Error preparing data for projected volume kube-api-access-zqljh for pod openshift-network-diagnostics/network-check-target-tk2m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:03.405126 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.404969    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh podName:256f18d6-4ac7-48f0-b77d-65436ce0b37b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:04.404938248 +0000 UTC m=+5.732371331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqljh" (UniqueName: "kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh") pod "network-check-target-tk2m6" (UID: "256f18d6-4ac7-48f0-b77d-65436ce0b37b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:03.768786 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:03.768637    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b70324b_83b2_41ee_a0cb_2d84257af56d.slice/crio-14e90f655c965640c35fd373e0362faf22b629dddf72f85b79f50a3dedeb8a29 WatchSource:0}: Error finding container 14e90f655c965640c35fd373e0362faf22b629dddf72f85b79f50a3dedeb8a29: Status 404 returned error can't find the container with id 14e90f655c965640c35fd373e0362faf22b629dddf72f85b79f50a3dedeb8a29
Sep 17 17:34:03.770621 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:03.770598    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333ce5a7_0e31_40c2_9929_b855616daf6a.slice/crio-93915bf498cf112ee840cf36cf3d8649198a1478483f89a5675763446a039a84 WatchSource:0}: Error finding container 93915bf498cf112ee840cf36cf3d8649198a1478483f89a5675763446a039a84: Status 404 returned error can't find the container with id 93915bf498cf112ee840cf36cf3d8649198a1478483f89a5675763446a039a84
Sep 17 17:34:03.771816 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:03.771790    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d26571_4278_4f4d_8a25_c9c5657bf46b.slice/crio-3a45a87ee746e3712c78e98302b0a9a2d5e6128d9e406ce8d25a0030a23a8c1e WatchSource:0}: Error finding container 3a45a87ee746e3712c78e98302b0a9a2d5e6128d9e406ce8d25a0030a23a8c1e: Status 404 returned error can't find the container with id 3a45a87ee746e3712c78e98302b0a9a2d5e6128d9e406ce8d25a0030a23a8c1e
Sep 17 17:34:03.792410 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:03.792381    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194c53c0_2f53_4d58_8774_9581748ac651.slice/crio-98197c0b72a288bd08bf4380007dd75d95aad14c09669d61325130e9ef47fdce WatchSource:0}: Error finding container 98197c0b72a288bd08bf4380007dd75d95aad14c09669d61325130e9ef47fdce: Status 404 returned error can't find the container with id 98197c0b72a288bd08bf4380007dd75d95aad14c09669d61325130e9ef47fdce
Sep 17 17:34:03.793660 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:03.793636    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc25d40_08c5_40a9_af7f_94ff0f1ddb32.slice/crio-a1037441d6497afd6ce1a49243f9b04ee86e6e36889c1a6fe63da0aef7c1a9fd WatchSource:0}: Error finding container a1037441d6497afd6ce1a49243f9b04ee86e6e36889c1a6fe63da0aef7c1a9fd: Status 404 returned error can't find the container with id a1037441d6497afd6ce1a49243f9b04ee86e6e36889c1a6fe63da0aef7c1a9fd
Sep 17 17:34:03.794462 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:03.794440    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64eb3efe_305b_4efd_bcc1_1381b298e187.slice/crio-b9013efbb17100920be1311fae3868c722a8cf3310c437eb378b0f403b18d724 WatchSource:0}: Error finding container b9013efbb17100920be1311fae3868c722a8cf3310c437eb378b0f403b18d724: Status 404 returned error can't find the container with id b9013efbb17100920be1311fae3868c722a8cf3310c437eb378b0f403b18d724
Sep 17 17:34:03.795426 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:03.795300    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02283208_4f60_4962_a558_00e6236394bf.slice/crio-e9ebf5c6ff70d8b655e93cb283e84379d91ea49ebacc6edafb4439fbbdf7612b WatchSource:0}: Error finding container e9ebf5c6ff70d8b655e93cb283e84379d91ea49ebacc6edafb4439fbbdf7612b: Status 404 returned error can't find the container with id e9ebf5c6ff70d8b655e93cb283e84379d91ea49ebacc6edafb4439fbbdf7612b
Sep 17 17:34:03.796474 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:03.796440    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604f5e26_05da_4f91_8248_26987e9682ac.slice/crio-d6459bc156da85269ea2d4f4097699b51af31a380be4ea01808714b4cb7ff331 WatchSource:0}: Error finding container d6459bc156da85269ea2d4f4097699b51af31a380be4ea01808714b4cb7ff331: Status 404 returned error can't find the container with id d6459bc156da85269ea2d4f4097699b51af31a380be4ea01808714b4cb7ff331
Sep 17 17:34:03.798607 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:03.798583    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6bcc9f_37b4_4bf3_8460_7182df774ca5.slice/crio-e2e16817a1796b1cf6aa9a37a6862741e48a27155b4f232c29fd39d4589486e3 WatchSource:0}: Error finding container e2e16817a1796b1cf6aa9a37a6862741e48a27155b4f232c29fd39d4589486e3: Status 404 returned error can't find the container with id e2e16817a1796b1cf6aa9a37a6862741e48a27155b4f232c29fd39d4589486e3
Sep 17 17:34:03.812168 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.812143    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:03.812262 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.812245    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:03.812302 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.812277    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:03.812336 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:03.812323    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:03.823559 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.823531    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-svslh" event={"ID":"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32","Type":"ContainerStarted","Data":"a1037441d6497afd6ce1a49243f9b04ee86e6e36889c1a6fe63da0aef7c1a9fd"}
Sep 17 17:34:03.828798 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.828771    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq" event={"ID":"02283208-4f60-4962-a558-00e6236394bf","Type":"ContainerStarted","Data":"e9ebf5c6ff70d8b655e93cb283e84379d91ea49ebacc6edafb4439fbbdf7612b"}
Sep 17 17:34:03.829966 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.829927    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kkv5p" event={"ID":"64eb3efe-305b-4efd-bcc1-1381b298e187","Type":"ContainerStarted","Data":"b9013efbb17100920be1311fae3868c722a8cf3310c437eb378b0f403b18d724"}
Sep 17 17:34:03.831204 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.831183    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjj6f" event={"ID":"40d26571-4278-4f4d-8a25-c9c5657bf46b","Type":"ContainerStarted","Data":"3a45a87ee746e3712c78e98302b0a9a2d5e6128d9e406ce8d25a0030a23a8c1e"}
Sep 17 17:34:03.832462 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.832440    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g9ckj" event={"ID":"333ce5a7-0e31-40c2-9929-b855616daf6a","Type":"ContainerStarted","Data":"93915bf498cf112ee840cf36cf3d8649198a1478483f89a5675763446a039a84"}
Sep 17 17:34:03.833565 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.833545    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hqpt6" event={"ID":"9b70324b-83b2-41ee-a0cb-2d84257af56d","Type":"ContainerStarted","Data":"14e90f655c965640c35fd373e0362faf22b629dddf72f85b79f50a3dedeb8a29"}
Sep 17 17:34:03.836167 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.836144    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7xp5" event={"ID":"8b6bcc9f-37b4-4bf3-8460-7182df774ca5","Type":"ContainerStarted","Data":"e2e16817a1796b1cf6aa9a37a6862741e48a27155b4f232c29fd39d4589486e3"}
Sep 17 17:34:03.838479 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.838423    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wvvrl" event={"ID":"604f5e26-05da-4f91-8248-26987e9682ac","Type":"ContainerStarted","Data":"d6459bc156da85269ea2d4f4097699b51af31a380be4ea01808714b4cb7ff331"}
Sep 17 17:34:03.840610 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.840594    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerStarted","Data":"98197c0b72a288bd08bf4380007dd75d95aad14c09669d61325130e9ef47fdce"}
Sep 17 17:34:03.843464 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.843443    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:02 +0000 UTC" deadline="2028-04-27 01:16:45.442930895 +0000 UTC"
Sep 17 17:34:03.843464 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:03.843464    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14095h42m41.599470254s"
Sep 17 17:34:04.310427 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.310346    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:04.310427 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.310406    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:04.310651 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:04.310545    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:04.310651 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:04.310606    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs podName:53437e34-2e7d-4e34-a8b6-6886e50a8463 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:06.310587139 +0000 UTC m=+7.638020225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs") pod "network-metrics-daemon-d5rkr" (UID: "53437e34-2e7d-4e34-a8b6-6886e50a8463") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:04.310766 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:04.310696    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:04.310766 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:04.310762    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret podName:0dcd31c7-6f39-4ed1-83b5-08dc2a872864 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:06.310743101 +0000 UTC m=+7.638176197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret") pod "global-pull-secret-syncer-pws9z" (UID: "0dcd31c7-6f39-4ed1-83b5-08dc2a872864") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:04.412192 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.411454    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqljh\" (UniqueName: \"kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh\") pod \"network-check-target-tk2m6\" (UID: \"256f18d6-4ac7-48f0-b77d-65436ce0b37b\") " pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:04.412192 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:04.411607    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:04.412192 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:04.411625    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:04.412192 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:04.411637    2586 projected.go:196] Error preparing data for projected volume kube-api-access-zqljh for pod openshift-network-diagnostics/network-check-target-tk2m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:04.412192 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:04.411694    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh podName:256f18d6-4ac7-48f0-b77d-65436ce0b37b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:06.41167605 +0000 UTC m=+7.739109148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqljh" (UniqueName: "kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh") pod "network-check-target-tk2m6" (UID: "256f18d6-4ac7-48f0-b77d-65436ce0b37b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:04.815075 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.815041    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:04.815759 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:04.815241    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:04.844655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.844595    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:29:02 +0000 UTC" deadline="2028-04-16 22:32:36.346357933 +0000 UTC"
Sep 17 17:34:04.844655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.844651    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13852h58m31.501710856s"
Sep 17 17:34:04.858779 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.858047    2586 generic.go:356] "Generic (PLEG): container finished" podID="aee03eb97d597f7e86718fd7ff3b97b2" containerID="9f77abc01291ef5faaf45ea111aad3a1bcf748571e9c3e8b86075489b1181bb0" exitCode=0
Sep 17 17:34:04.858779 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.858345    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" event={"ID":"aee03eb97d597f7e86718fd7ff3b97b2","Type":"ContainerDied","Data":"9f77abc01291ef5faaf45ea111aad3a1bcf748571e9c3e8b86075489b1181bb0"}
Sep 17 17:34:04.861174 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.861146    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" event={"ID":"834198684fe123bac38328944a6fc1ae","Type":"ContainerStarted","Data":"757e313c0e559f897525eef0baa5a5cde20ecdb93a96a8020964ce238a152a20"}
Sep 17 17:34:04.890092 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:04.889582    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-49.ec2.internal" podStartSLOduration=2.889561639 podStartE2EDuration="2.889561639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:04.888856626 +0000 UTC m=+6.216289731" watchObservedRunningTime="2026-09-17 17:34:04.889561639 +0000 UTC m=+6.216994744"
Sep 17 17:34:05.812042 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:05.811983    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:05.812213 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:05.812113    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:05.812529 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:05.812511    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:05.812631 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:05.812613    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:05.882344 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:05.882310    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" event={"ID":"aee03eb97d597f7e86718fd7ff3b97b2","Type":"ContainerStarted","Data":"c96eba83a22c2eb12fa409efa3e2e3ae078bdd8a4a0300e9e1cfb3e6de17fa3c"}
Sep 17 17:34:06.337086 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:06.337052    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:06.337273 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:06.337115    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:06.337346 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:06.337271    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:06.337407 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:06.337359    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs podName:53437e34-2e7d-4e34-a8b6-6886e50a8463 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:10.337337969 +0000 UTC m=+11.664771056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs") pod "network-metrics-daemon-d5rkr" (UID: "53437e34-2e7d-4e34-a8b6-6886e50a8463") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:06.337755 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:06.337736    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:06.337853 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:06.337788    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret podName:0dcd31c7-6f39-4ed1-83b5-08dc2a872864 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:10.337773418 +0000 UTC m=+11.665206505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret") pod "global-pull-secret-syncer-pws9z" (UID: "0dcd31c7-6f39-4ed1-83b5-08dc2a872864") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:06.438151 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:06.438115    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqljh\" (UniqueName: \"kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh\") pod \"network-check-target-tk2m6\" (UID: \"256f18d6-4ac7-48f0-b77d-65436ce0b37b\") " pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:06.438352 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:06.438336    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:06.438426 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:06.438362    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:06.438426 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:06.438375    2586 projected.go:196] Error preparing data for projected volume kube-api-access-zqljh for pod openshift-network-diagnostics/network-check-target-tk2m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:06.438532 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:06.438438    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh podName:256f18d6-4ac7-48f0-b77d-65436ce0b37b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:10.438419673 +0000 UTC m=+11.765852773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqljh" (UniqueName: "kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh") pod "network-check-target-tk2m6" (UID: "256f18d6-4ac7-48f0-b77d-65436ce0b37b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:06.813120 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:06.812543    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:06.813120 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:06.812705    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:07.813162 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:07.812411    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:07.813162 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:07.812544    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:07.813162 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:07.812946    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:07.813162 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:07.813051    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:08.812357 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:08.812320    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:08.812513 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:08.812483    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:09.812263 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:09.812221    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:09.812695 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:09.812353    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:09.812695 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:09.812537    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:09.812695 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:09.812631    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:10.373686 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:10.373648    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:10.373885 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:10.373710    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:10.373885 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:10.373808    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:10.373885 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:10.373841    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:10.373885 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:10.373887    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret podName:0dcd31c7-6f39-4ed1-83b5-08dc2a872864 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:18.373865811 +0000 UTC m=+19.701298896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret") pod "global-pull-secret-syncer-pws9z" (UID: "0dcd31c7-6f39-4ed1-83b5-08dc2a872864") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:10.374207 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:10.373908    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs podName:53437e34-2e7d-4e34-a8b6-6886e50a8463 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:18.373897179 +0000 UTC m=+19.701330265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs") pod "network-metrics-daemon-d5rkr" (UID: "53437e34-2e7d-4e34-a8b6-6886e50a8463") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:10.474879 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:10.474810    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqljh\" (UniqueName: \"kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh\") pod \"network-check-target-tk2m6\" (UID: \"256f18d6-4ac7-48f0-b77d-65436ce0b37b\") " pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:10.475057 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:10.475017    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:10.475057 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:10.475040    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:10.475057 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:10.475052    2586 projected.go:196] Error preparing data for projected volume kube-api-access-zqljh for pod openshift-network-diagnostics/network-check-target-tk2m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:10.475162 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:10.475112    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh podName:256f18d6-4ac7-48f0-b77d-65436ce0b37b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:18.475093861 +0000 UTC m=+19.802526968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqljh" (UniqueName: "kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh") pod "network-check-target-tk2m6" (UID: "256f18d6-4ac7-48f0-b77d-65436ce0b37b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:10.813112 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:10.812942    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:10.813112 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:10.813101    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:11.811831 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:11.811792    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:11.812027 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:11.811792    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:11.812027 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:11.811937    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:11.812027 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:11.811984    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:12.812268 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:12.812235    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:12.812721 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:12.812380    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:13.812538 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:13.812499    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:13.812936 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:13.812499    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:13.812936 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:13.812649    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:13.812936 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:13.812715    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:14.812693 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:14.812664    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:14.813143 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:14.812805    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:15.812472 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:15.812437    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:15.812667 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:15.812436    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:15.812667 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:15.812563    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:15.812667 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:15.812635    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:16.812482 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:16.812430    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:16.812675 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:16.812625    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:17.811896 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:17.811856    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:17.812375 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:17.811856    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:17.812375 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:17.811991    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:17.812375 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:17.812045    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:18.435013 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:18.434976    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:18.435192 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:18.435026    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:18.435192 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:18.435138    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:18.435305 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:18.435198    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:18.435305 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:18.435204    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs podName:53437e34-2e7d-4e34-a8b6-6886e50a8463 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:34.43518521 +0000 UTC m=+35.762618292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs") pod "network-metrics-daemon-d5rkr" (UID: "53437e34-2e7d-4e34-a8b6-6886e50a8463") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:34:18.435305 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:18.435276    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret podName:0dcd31c7-6f39-4ed1-83b5-08dc2a872864 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:34.43525765 +0000 UTC m=+35.762690748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret") pod "global-pull-secret-syncer-pws9z" (UID: "0dcd31c7-6f39-4ed1-83b5-08dc2a872864") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:34:18.535929 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:18.535893    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqljh\" (UniqueName: \"kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh\") pod \"network-check-target-tk2m6\" (UID: \"256f18d6-4ac7-48f0-b77d-65436ce0b37b\") " pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:18.536123 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:18.536090    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:34:18.536123 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:18.536115    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:34:18.536123 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:18.536125    2586 projected.go:196] Error preparing data for projected volume kube-api-access-zqljh for pod openshift-network-diagnostics/network-check-target-tk2m6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:18.536251 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:18.536181    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh podName:256f18d6-4ac7-48f0-b77d-65436ce0b37b nodeName:}" failed. No retries permitted until 2026-09-17 17:34:34.536165836 +0000 UTC m=+35.863598931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zqljh" (UniqueName: "kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh") pod "network-check-target-tk2m6" (UID: "256f18d6-4ac7-48f0-b77d-65436ce0b37b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:34:18.812552 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:18.812467    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:18.812999 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:18.812609    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:19.812661 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:19.812629    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:19.813048 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:19.812629    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:19.813048 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:19.812742    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:19.813048 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:19.812852    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:20.813014 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:20.812989    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:20.813355 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:20.813078    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:21.812679 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.812493    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:21.812893 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.812494    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:21.812893 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:21.812787    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:21.812893 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:21.812854    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:21.916643 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.916598    2586 generic.go:356] "Generic (PLEG): container finished" podID="8b6bcc9f-37b4-4bf3-8460-7182df774ca5" containerID="fd51b1bd84c48aec1c5bb8f8b9107e30f771830ad1c7228afbc21607941fd5b1" exitCode=0
Sep 17 17:34:21.916795 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.916696    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7xp5" event={"ID":"8b6bcc9f-37b4-4bf3-8460-7182df774ca5","Type":"ContainerDied","Data":"fd51b1bd84c48aec1c5bb8f8b9107e30f771830ad1c7228afbc21607941fd5b1"}
Sep 17 17:34:21.918745 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.918717    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wvvrl" event={"ID":"604f5e26-05da-4f91-8248-26987e9682ac","Type":"ContainerStarted","Data":"c0c2a168fdd497562123579c310fce745165ec1d63e83c05ac99803b52829f29"}
Sep 17 17:34:21.922256 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.922230    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:34:21.922672 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.922650    2586 generic.go:356] "Generic (PLEG): container finished" podID="194c53c0-2f53-4d58-8774-9581748ac651" containerID="4286d6b27fcecfa60a54f253ad9d4de73968cdb4ffad344bac96471f101343c9" exitCode=1
Sep 17 17:34:21.922773 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.922699    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerStarted","Data":"9dd8972f8a7eddae234aefba31944dc65b401e72e6c9dcba1cec72fb76f5aa1d"}
Sep 17 17:34:21.922836 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.922782    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerStarted","Data":"08a9f11a080f3b127e9978efba77b4aeb997c1c975e9f797bb18ca1fd8af16b9"}
Sep 17 17:34:21.922892 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.922835    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerStarted","Data":"c4a5974f13552232341fbc4f2c53a8f9981e18a67c6c70c1f669ad72aaaeea69"}
Sep 17 17:34:21.922892 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.922883    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerStarted","Data":"42894ec6abe385ae2f98b3a0000581a1e80670e937385841aea91475e7c03d2a"}
Sep 17 17:34:21.923011 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.922931    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerDied","Data":"4286d6b27fcecfa60a54f253ad9d4de73968cdb4ffad344bac96471f101343c9"}
Sep 17 17:34:21.923067 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.923009    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerStarted","Data":"4422e84ffcdef0f250bd77dac91e070f4bca0ee5bb1500e270bbc63530968421"}
Sep 17 17:34:21.924528 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.924507    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq" event={"ID":"02283208-4f60-4962-a558-00e6236394bf","Type":"ContainerStarted","Data":"f8b6e00bc70756f1b073aeffe9f8fdc06486cae518fe6986b59997c5b31c8d57"}
Sep 17 17:34:21.926095 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.926076    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kkv5p" event={"ID":"64eb3efe-305b-4efd-bcc1-1381b298e187","Type":"ContainerStarted","Data":"06442f0269aff32bcc042c7b3e1d40605782ecd77807e008d4fc6d66f9a916b1"}
Sep 17 17:34:21.927602 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.927582    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjj6f" event={"ID":"40d26571-4278-4f4d-8a25-c9c5657bf46b","Type":"ContainerStarted","Data":"5ecfe7379d1a57b94dbb7b94a65445059c4acfd28f7bbf71c4d95ee5fa0f2013"}
Sep 17 17:34:21.929189 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.929168    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g9ckj" event={"ID":"333ce5a7-0e31-40c2-9929-b855616daf6a","Type":"ContainerStarted","Data":"23b7a6aa85d5fd3957fa89d5bfae3c6d66519bb3ae79a20d5e7ec2e7440d1a01"}
Sep 17 17:34:21.930821 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.930800    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hqpt6" event={"ID":"9b70324b-83b2-41ee-a0cb-2d84257af56d","Type":"ContainerStarted","Data":"2445337e5cb45f749670a0806957b591a3d55c4c09005f2990d63c69010f5434"}
Sep 17 17:34:21.938639 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.938602    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-49.ec2.internal" podStartSLOduration=19.938588058 podStartE2EDuration="19.938588058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:05.897368774 +0000 UTC m=+7.224801879" watchObservedRunningTime="2026-09-17 17:34:21.938588058 +0000 UTC m=+23.266021162"
Sep 17 17:34:21.954787 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.954740    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xjj6f" podStartSLOduration=4.951818737 podStartE2EDuration="21.954724367s" totalImagesPullingTime="17.00290563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:21.954146769 +0000 UTC m=+23.281579875" watchObservedRunningTime="2026-09-17 17:34:21.954724367 +0000 UTC m=+23.282157468"
Sep 17 17:34:21.970930 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.970879    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g9ckj" podStartSLOduration=4.905100455 podStartE2EDuration="21.970861528s" totalImagesPullingTime="17.065761073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:21.970787745 +0000 UTC m=+23.298220850" watchObservedRunningTime="2026-09-17 17:34:21.970861528 +0000 UTC m=+23.298294623"
Sep 17 17:34:21.985688 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:21.985629    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kkv5p" podStartSLOduration=4.990528396 podStartE2EDuration="21.985608404s" totalImagesPullingTime="16.995080008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:21.985224796 +0000 UTC m=+23.312657900" watchObservedRunningTime="2026-09-17 17:34:21.985608404 +0000 UTC m=+23.313041511"
Sep 17 17:34:22.006230 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.004711    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hqpt6" podStartSLOduration=4.923887523 podStartE2EDuration="22.0046898s" totalImagesPullingTime="17.080802277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:22.003619874 +0000 UTC m=+23.331052981" watchObservedRunningTime="2026-09-17 17:34:22.0046898 +0000 UTC m=+23.332122907"
Sep 17 17:34:22.023004 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.022929    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wvvrl" podStartSLOduration=4.682895643 podStartE2EDuration="22.022913098s" totalImagesPullingTime="17.340017455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:22.02278294 +0000 UTC m=+23.350216044" watchObservedRunningTime="2026-09-17 17:34:22.022913098 +0000 UTC m=+23.350346201"
Sep 17 17:34:22.430837 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.430740    2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 17:34:22.754265 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.754034    2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:34:22.430755954Z","UUID":"61f1fff7-2ee5-4e47-94b5-01cbfec0c142","Handler":null,"Name":"","Endpoint":""}
Sep 17 17:34:22.755620 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.755592    2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 17:34:22.755750 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.755631    2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 17:34:22.812585 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.812551    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:22.812741 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:22.812698    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:22.935171 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.935136    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-svslh" event={"ID":"2dc25d40-08c5-40a9-af7f-94ff0f1ddb32","Type":"ContainerStarted","Data":"22a8565ae9a239b8ec8ea8747873121d6901b906259f9e912cdaabf3fc81fb1c"}
Sep 17 17:34:22.938142 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.938037    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq" event={"ID":"02283208-4f60-4962-a558-00e6236394bf","Type":"ContainerStarted","Data":"ca3f3b51565f9e9528919d29aecf1277321dd6870872a885e487fa7b49b721ce"}
Sep 17 17:34:22.952320 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:22.952267    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-svslh" podStartSLOduration=5.916152456 podStartE2EDuration="22.952251442s" totalImagesPullingTime="17.036098986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:22.95223239 +0000 UTC m=+24.279665494" watchObservedRunningTime="2026-09-17 17:34:22.952251442 +0000 UTC m=+24.279684545"
Sep 17 17:34:23.149929 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.149809    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:23.173205 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.173174    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:23.173773 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.173750    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:23.811706 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.811672    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:23.811890 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.811719    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:23.811890 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:23.811817    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:23.812029 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:23.811974    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:23.943919 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.943844    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:34:23.944430 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.944392    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerStarted","Data":"bdd5c8eac01a7ab875dd0ab22d19fbcec032dafc89753b9d7852b5fd8c24649d"}
Sep 17 17:34:23.946837 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.946765    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq" event={"ID":"02283208-4f60-4962-a558-00e6236394bf","Type":"ContainerStarted","Data":"915b9a857424c0821b261d72ef8f7564553683d5419832daa1116d807669f0c3"}
Sep 17 17:34:23.948388 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.948366    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xjj6f"
Sep 17 17:34:23.967617 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:23.967564    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g6tkq" podStartSLOduration=4.996141996 podStartE2EDuration="23.967548508s" totalImagesPullingTime="18.971406512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:23.967251074 +0000 UTC m=+25.294684180" watchObservedRunningTime="2026-09-17 17:34:23.967548508 +0000 UTC m=+25.294981634"
Sep 17 17:34:24.811699 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:24.811664    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:24.811879 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:24.811800    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:25.812132 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:25.812099    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:25.812591 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:25.812142    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:25.812591 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:25.812231    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:25.812591 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:25.812354    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:26.812739 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:26.812551    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:26.813317 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:26.812823    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:26.955442 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:26.955408    2586 generic.go:356] "Generic (PLEG): container finished" podID="8b6bcc9f-37b4-4bf3-8460-7182df774ca5" containerID="a0f713392408d87093e9c482083f56b8dddfcc21c7d70152d3623f6c5ebdec7a" exitCode=0
Sep 17 17:34:26.955590 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:26.955492    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7xp5" event={"ID":"8b6bcc9f-37b4-4bf3-8460-7182df774ca5","Type":"ContainerDied","Data":"a0f713392408d87093e9c482083f56b8dddfcc21c7d70152d3623f6c5ebdec7a"}
Sep 17 17:34:26.959140 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:26.959123    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:34:26.959475 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:26.959455    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerStarted","Data":"b9636dac9e9b51ff078ee54ecb5b3d234068081c62d57ace63bb9a9efcffbe4c"}
Sep 17 17:34:26.959746 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:26.959721    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:26.959801 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:26.959784    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:26.959895 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:26.959883    2586 scope.go:117] "RemoveContainer" containerID="4286d6b27fcecfa60a54f253ad9d4de73968cdb4ffad344bac96471f101343c9"
Sep 17 17:34:26.975048 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:26.975028    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:27.812715 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:27.812540    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:27.812842 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:27.812805    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:27.813314 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:27.812555    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:27.813314 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:27.813298    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:27.963801 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:27.963768    2586 generic.go:356] "Generic (PLEG): container finished" podID="8b6bcc9f-37b4-4bf3-8460-7182df774ca5" containerID="5148363a50ca9ddb8231dfefe7e5a96001b7e980a6eb553bf246114bc8a8c6f7" exitCode=0
Sep 17 17:34:27.963940 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:27.963855    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7xp5" event={"ID":"8b6bcc9f-37b4-4bf3-8460-7182df774ca5","Type":"ContainerDied","Data":"5148363a50ca9ddb8231dfefe7e5a96001b7e980a6eb553bf246114bc8a8c6f7"}
Sep 17 17:34:27.967776 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:27.967755    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:34:27.968211 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:27.968187    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" event={"ID":"194c53c0-2f53-4d58-8774-9581748ac651","Type":"ContainerStarted","Data":"62bec3581562dfd4408385a486fa1875444cd28a50eee3c48fc4930baebb3f2f"}
Sep 17 17:34:27.968438 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:27.968423    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:27.984193 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:27.984171    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:34:28.024127 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:28.024014    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d5rkr"]
Sep 17 17:34:28.024265 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:28.024170    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:28.024319 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:28.024281    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:28.030876 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:28.030852    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pws9z"]
Sep 17 17:34:28.031038 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:28.030944    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:28.031080 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:28.031036    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:28.033014 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:28.032947    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4" podStartSLOduration=10.954402428 podStartE2EDuration="28.032933048s" totalImagesPullingTime="17.07853062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:28.030766204 +0000 UTC m=+29.358199307" watchObservedRunningTime="2026-09-17 17:34:28.032933048 +0000 UTC m=+29.360366152"
Sep 17 17:34:28.033866 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:28.033848    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tk2m6"]
Sep 17 17:34:28.033980 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:28.033932    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:28.034055 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:28.034033    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:29.812061 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:29.812028    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:29.812444 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:29.812029    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:29.812444 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:29.812149    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:29.812444 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:29.812029    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:29.812444 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:29.812212    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:29.812444 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:29.812302    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:29.976282 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:29.976250    2586 generic.go:356] "Generic (PLEG): container finished" podID="8b6bcc9f-37b4-4bf3-8460-7182df774ca5" containerID="86129e8320eba1d6486bc960d7a40de43960c02b3b2eea171768c1464096ccbc" exitCode=0
Sep 17 17:34:29.976435 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:29.976332    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7xp5" event={"ID":"8b6bcc9f-37b4-4bf3-8460-7182df774ca5","Type":"ContainerDied","Data":"86129e8320eba1d6486bc960d7a40de43960c02b3b2eea171768c1464096ccbc"}
Sep 17 17:34:31.812482 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:31.812449    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:31.813016 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:31.812493    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:31.813016 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:31.812493    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:31.813016 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:31.812579    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:34:31.813016 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:31.812667    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tk2m6" podUID="256f18d6-4ac7-48f0-b77d-65436ce0b37b"
Sep 17 17:34:31.813016 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:31.812772    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pws9z" podUID="0dcd31c7-6f39-4ed1-83b5-08dc2a872864"
Sep 17 17:34:33.685607 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.685577    2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-49.ec2.internal" event="NodeReady"
Sep 17 17:34:33.686122 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.685748    2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 17:34:33.738832 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.738794    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5n874"]
Sep 17 17:34:33.761151 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.761114    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2vzr4"]
Sep 17 17:34:33.761305 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.761260    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.763750 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.763723    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 17:34:33.763887 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.763767    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 17:34:33.763887 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.763813    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vdp8v\""
Sep 17 17:34:33.780839 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.780809    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5n874"]
Sep 17 17:34:33.780991 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.780850    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2vzr4"]
Sep 17 17:34:33.780991 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.780890    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2vzr4"
Sep 17 17:34:33.783197 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.783169    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 17:34:33.783313 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.783206    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8mqcm\""
Sep 17 17:34:33.783313 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.783268    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 17:34:33.783426 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.783331    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 17:34:33.812272 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.812244    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:33.812272 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.812276    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:33.812484 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.812420    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:33.815217 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.815197    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7zxgv\""
Sep 17 17:34:33.815392 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.815255    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 17:34:33.815392 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.815302    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 17:34:33.815392 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.815338    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-745tx\""
Sep 17 17:34:33.815575 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.815405    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 17:34:33.815575 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.815490    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 17:34:33.844664 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.844633    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.844824 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.844703    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ceee1e7-8072-46f3-8122-49b19e223845-config-volume\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.844824 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.844734    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2gbz\" (UniqueName: \"kubernetes.io/projected/5ceee1e7-8072-46f3-8122-49b19e223845-kube-api-access-x2gbz\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.844936 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.844846    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ceee1e7-8072-46f3-8122-49b19e223845-tmp-dir\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.946126 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.946091    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h68sh\" (UniqueName: \"kubernetes.io/projected/8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e-kube-api-access-h68sh\") pod \"ingress-canary-2vzr4\" (UID: \"8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e\") " pod="openshift-ingress-canary/ingress-canary-2vzr4"
Sep 17 17:34:33.946292 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.946139    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ceee1e7-8072-46f3-8122-49b19e223845-tmp-dir\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.946292 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.946214    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.946402 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.946288    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ceee1e7-8072-46f3-8122-49b19e223845-config-volume\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.946402 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:33.946295    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:34:33.946402 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.946320    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2gbz\" (UniqueName: \"kubernetes.io/projected/5ceee1e7-8072-46f3-8122-49b19e223845-kube-api-access-x2gbz\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.946402 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.946336    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e-cert\") pod \"ingress-canary-2vzr4\" (UID: \"8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e\") " pod="openshift-ingress-canary/ingress-canary-2vzr4"
Sep 17 17:34:33.946402 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:33.946355    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls podName:5ceee1e7-8072-46f3-8122-49b19e223845 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:34.446340663 +0000 UTC m=+35.773773744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls") pod "dns-default-5n874" (UID: "5ceee1e7-8072-46f3-8122-49b19e223845") : secret "dns-default-metrics-tls" not found
Sep 17 17:34:33.946649 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.946475    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ceee1e7-8072-46f3-8122-49b19e223845-tmp-dir\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.946886 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.946871    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ceee1e7-8072-46f3-8122-49b19e223845-config-volume\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:33.959930 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:33.959908    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2gbz\" (UniqueName: \"kubernetes.io/projected/5ceee1e7-8072-46f3-8122-49b19e223845-kube-api-access-x2gbz\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:34.047500 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.047470    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e-cert\") pod \"ingress-canary-2vzr4\" (UID: \"8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e\") " pod="openshift-ingress-canary/ingress-canary-2vzr4"
Sep 17 17:34:34.047661 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.047513    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h68sh\" (UniqueName: \"kubernetes.io/projected/8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e-kube-api-access-h68sh\") pod \"ingress-canary-2vzr4\" (UID: \"8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e\") " pod="openshift-ingress-canary/ingress-canary-2vzr4"
Sep 17 17:34:34.049919 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.049899    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e-cert\") pod \"ingress-canary-2vzr4\" (UID: \"8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e\") " pod="openshift-ingress-canary/ingress-canary-2vzr4"
Sep 17 17:34:34.057021 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.056985    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h68sh\" (UniqueName: \"kubernetes.io/projected/8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e-kube-api-access-h68sh\") pod \"ingress-canary-2vzr4\" (UID: \"8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e\") " pod="openshift-ingress-canary/ingress-canary-2vzr4"
Sep 17 17:34:34.090614 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.090540    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2vzr4"
Sep 17 17:34:34.449966 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.449767    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:34.449966 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:34.449926    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:34:34.450186 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.449989    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:34.450186 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:34.450029    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls podName:5ceee1e7-8072-46f3-8122-49b19e223845 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:35.450012359 +0000 UTC m=+36.777445440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls") pod "dns-default-5n874" (UID: "5ceee1e7-8072-46f3-8122-49b19e223845") : secret "dns-default-metrics-tls" not found
Sep 17 17:34:34.450186 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.450061    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:34:34.450186 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:34.450140    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 17:34:34.450186 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:34.450169    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs podName:53437e34-2e7d-4e34-a8b6-6886e50a8463 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:06.45015904 +0000 UTC m=+67.777592121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs") pod "network-metrics-daemon-d5rkr" (UID: "53437e34-2e7d-4e34-a8b6-6886e50a8463") : secret "metrics-daemon-secret" not found
Sep 17 17:34:34.452470 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.452452    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dcd31c7-6f39-4ed1-83b5-08dc2a872864-original-pull-secret\") pod \"global-pull-secret-syncer-pws9z\" (UID: \"0dcd31c7-6f39-4ed1-83b5-08dc2a872864\") " pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:34.551129 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.551092    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqljh\" (UniqueName: \"kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh\") pod \"network-check-target-tk2m6\" (UID: \"256f18d6-4ac7-48f0-b77d-65436ce0b37b\") " pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:34.553470 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.553444    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqljh\" (UniqueName: \"kubernetes.io/projected/256f18d6-4ac7-48f0-b77d-65436ce0b37b-kube-api-access-zqljh\") pod \"network-check-target-tk2m6\" (UID: \"256f18d6-4ac7-48f0-b77d-65436ce0b37b\") " pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:34.560367 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.560344    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2vzr4"]
Sep 17 17:34:34.561247 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:34.561215    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdc8b8b_b61f_4bd7_9e3f_0bca2621323e.slice/crio-a1c9b2c0e9cbcbc5483c840a240422aa7eb9ef1d1708d386216f565f1f353622 WatchSource:0}: Error finding container a1c9b2c0e9cbcbc5483c840a240422aa7eb9ef1d1708d386216f565f1f353622: Status 404 returned error can't find the container with id a1c9b2c0e9cbcbc5483c840a240422aa7eb9ef1d1708d386216f565f1f353622
Sep 17 17:34:34.723589 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.723555    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:34.736859 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.736828    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pws9z"
Sep 17 17:34:34.990397 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.990308    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2vzr4" event={"ID":"8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e","Type":"ContainerStarted","Data":"a1c9b2c0e9cbcbc5483c840a240422aa7eb9ef1d1708d386216f565f1f353622"}
Sep 17 17:34:34.993564 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.993533    2586 generic.go:356] "Generic (PLEG): container finished" podID="8b6bcc9f-37b4-4bf3-8460-7182df774ca5" containerID="7b9d71d6ccbc253c147da203792bd0252fabad9f172c2126c0c392777bc20b00" exitCode=0
Sep 17 17:34:34.993706 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:34.993577    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7xp5" event={"ID":"8b6bcc9f-37b4-4bf3-8460-7182df774ca5","Type":"ContainerDied","Data":"7b9d71d6ccbc253c147da203792bd0252fabad9f172c2126c0c392777bc20b00"}
Sep 17 17:34:35.013277 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:35.013245    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tk2m6"]
Sep 17 17:34:35.018021 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:35.017944    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256f18d6_4ac7_48f0_b77d_65436ce0b37b.slice/crio-9b3aa677c4d3dbcf7deb1450d258f3636b15112a79e51eb6ecaff15a7e2e1765 WatchSource:0}: Error finding container 9b3aa677c4d3dbcf7deb1450d258f3636b15112a79e51eb6ecaff15a7e2e1765: Status 404 returned error can't find the container with id 9b3aa677c4d3dbcf7deb1450d258f3636b15112a79e51eb6ecaff15a7e2e1765
Sep 17 17:34:35.039693 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:35.039665    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pws9z"]
Sep 17 17:34:35.043388 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:34:35.043360    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dcd31c7_6f39_4ed1_83b5_08dc2a872864.slice/crio-92fe72426ec0b016969015e36e26ba15dc89899d628a36966dd792b1b1ab8b93 WatchSource:0}: Error finding container 92fe72426ec0b016969015e36e26ba15dc89899d628a36966dd792b1b1ab8b93: Status 404 returned error can't find the container with id 92fe72426ec0b016969015e36e26ba15dc89899d628a36966dd792b1b1ab8b93
Sep 17 17:34:35.458871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:35.458632    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:35.459048 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:35.458771    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:34:35.459048 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:35.459006    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls podName:5ceee1e7-8072-46f3-8122-49b19e223845 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:37.458983856 +0000 UTC m=+38.786416951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls") pod "dns-default-5n874" (UID: "5ceee1e7-8072-46f3-8122-49b19e223845") : secret "dns-default-metrics-tls" not found
Sep 17 17:34:35.998336 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:35.998298    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tk2m6" event={"ID":"256f18d6-4ac7-48f0-b77d-65436ce0b37b","Type":"ContainerStarted","Data":"9b3aa677c4d3dbcf7deb1450d258f3636b15112a79e51eb6ecaff15a7e2e1765"}
Sep 17 17:34:35.999735 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:35.999708    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pws9z" event={"ID":"0dcd31c7-6f39-4ed1-83b5-08dc2a872864","Type":"ContainerStarted","Data":"92fe72426ec0b016969015e36e26ba15dc89899d628a36966dd792b1b1ab8b93"}
Sep 17 17:34:36.003739 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:36.003687    2586 generic.go:356] "Generic (PLEG): container finished" podID="8b6bcc9f-37b4-4bf3-8460-7182df774ca5" containerID="3e19ba3ee8fa63e1f80f7a05a56c6f6268241ba64881e2a05311a6f0a6d7e14e" exitCode=0
Sep 17 17:34:36.003894 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:36.003752    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7xp5" event={"ID":"8b6bcc9f-37b4-4bf3-8460-7182df774ca5","Type":"ContainerDied","Data":"3e19ba3ee8fa63e1f80f7a05a56c6f6268241ba64881e2a05311a6f0a6d7e14e"}
Sep 17 17:34:37.012902 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:37.012814    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v7xp5" event={"ID":"8b6bcc9f-37b4-4bf3-8460-7182df774ca5","Type":"ContainerStarted","Data":"da9a7d67dac549ba7cf32350d4d9d490bfbd5ac3345311349af598bff605a64f"}
Sep 17 17:34:37.063015 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:37.062932    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v7xp5" podStartSLOduration=8.678431985 podStartE2EDuration="36.062909351s" totalImagesPullingTime="27.384477366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:37.061765527 +0000 UTC m=+38.389198630" watchObservedRunningTime="2026-09-17 17:34:37.062909351 +0000 UTC m=+38.390342456"
Sep 17 17:34:37.476667 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:37.476577    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:37.476844 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:37.476720    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:34:37.476844 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:37.476784    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls podName:5ceee1e7-8072-46f3-8122-49b19e223845 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:41.476769726 +0000 UTC m=+42.804202808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls") pod "dns-default-5n874" (UID: "5ceee1e7-8072-46f3-8122-49b19e223845") : secret "dns-default-metrics-tls" not found
Sep 17 17:34:38.019232 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:38.019190    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2vzr4" event={"ID":"8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e","Type":"ContainerStarted","Data":"70def2680ba8a94a9e5778ebf165b7bdf6a7cc7ed898325f4820b043ce5ab8cc"}
Sep 17 17:34:38.042609 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:38.041943    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2vzr4" podStartSLOduration=2.514169701 podStartE2EDuration="5.041921818s" totalImagesPullingTime="2.527752117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:38.041687919 +0000 UTC m=+39.369121025" watchObservedRunningTime="2026-09-17 17:34:38.041921818 +0000 UTC m=+39.369354930"
Sep 17 17:34:41.028693 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:41.028655    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tk2m6" event={"ID":"256f18d6-4ac7-48f0-b77d-65436ce0b37b","Type":"ContainerStarted","Data":"e14c6922a8f8471f6437caafa82f66ae72f1621fe7a475b1dcd221cc60450049"}
Sep 17 17:34:41.029188 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:41.028781    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:34:41.030236 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:41.030208    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pws9z" event={"ID":"0dcd31c7-6f39-4ed1-83b5-08dc2a872864","Type":"ContainerStarted","Data":"0d5d5ee44cfed6bf1f823e556488fa99676403fa75f7593a4cf65e7aa9031b13"}
Sep 17 17:34:41.051133 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:41.051090    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tk2m6" podStartSLOduration=35.888357595 podStartE2EDuration="41.051071819s" totalImagesPullingTime="5.162714224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:41.050804363 +0000 UTC m=+42.378237466" watchObservedRunningTime="2026-09-17 17:34:41.051071819 +0000 UTC m=+42.378504902"
Sep 17 17:34:41.071163 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:41.071117    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pws9z" podStartSLOduration=34.91989968 podStartE2EDuration="40.071102831s" totalImagesPullingTime="5.151203151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:34:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:34:41.070387399 +0000 UTC m=+42.397820500" watchObservedRunningTime="2026-09-17 17:34:41.071102831 +0000 UTC m=+42.398535935"
Sep 17 17:34:41.506069 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:41.506038    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:41.506232 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:41.506153    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:34:41.506232 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:41.506215    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls podName:5ceee1e7-8072-46f3-8122-49b19e223845 nodeName:}" failed. No retries permitted until 2026-09-17 17:34:49.506202213 +0000 UTC m=+50.833635299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls") pod "dns-default-5n874" (UID: "5ceee1e7-8072-46f3-8122-49b19e223845") : secret "dns-default-metrics-tls" not found
Sep 17 17:34:49.552986 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:49.552931    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:34:49.553386 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:49.553061    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:34:49.553386 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:34:49.553149    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls podName:5ceee1e7-8072-46f3-8122-49b19e223845 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:05.553134972 +0000 UTC m=+66.880568053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls") pod "dns-default-5n874" (UID: "5ceee1e7-8072-46f3-8122-49b19e223845") : secret "dns-default-metrics-tls" not found
Sep 17 17:34:59.994912 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:34:59.994881    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksrc4"
Sep 17 17:35:05.560493 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:35:05.560452    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:35:05.560987 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:35:05.560570    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:35:05.560987 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:35:05.560624    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls podName:5ceee1e7-8072-46f3-8122-49b19e223845 nodeName:}" failed. No retries permitted until 2026-09-17 17:35:37.560610165 +0000 UTC m=+98.888043247 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls") pod "dns-default-5n874" (UID: "5ceee1e7-8072-46f3-8122-49b19e223845") : secret "dns-default-metrics-tls" not found
Sep 17 17:35:06.466110 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:35:06.466075    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:35:06.466280 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:35:06.466205    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 17:35:06.466280 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:35:06.466266    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs podName:53437e34-2e7d-4e34-a8b6-6886e50a8463 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:10.46625185 +0000 UTC m=+131.793684932 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs") pod "network-metrics-daemon-d5rkr" (UID: "53437e34-2e7d-4e34-a8b6-6886e50a8463") : secret "metrics-daemon-secret" not found
Sep 17 17:35:12.035885 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:35:12.035848    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tk2m6"
Sep 17 17:35:37.569328 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:35:37.569278    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:35:37.569853 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:35:37.569455    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:35:37.569853 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:35:37.569521    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls podName:5ceee1e7-8072-46f3-8122-49b19e223845 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:41.569504174 +0000 UTC m=+162.896937256 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls") pod "dns-default-5n874" (UID: "5ceee1e7-8072-46f3-8122-49b19e223845") : secret "dns-default-metrics-tls" not found
Sep 17 17:36:10.484443 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:10.484405    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:36:10.484891 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:10.484518    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 17:36:10.484891 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:10.484582    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs podName:53437e34-2e7d-4e34-a8b6-6886e50a8463 nodeName:}" failed. No retries permitted until 2026-09-17 17:38:12.484568242 +0000 UTC m=+253.812001334 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs") pod "network-metrics-daemon-d5rkr" (UID: "53437e34-2e7d-4e34-a8b6-6886e50a8463") : secret "metrics-daemon-secret" not found
Sep 17 17:36:18.656284 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.656252    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4"]
Sep 17 17:36:18.658219 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.658204    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4"
Sep 17 17:36:18.661728 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.661673    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-m8nlf"]
Sep 17 17:36:18.661876 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.661693    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xckp2\""
Sep 17 17:36:18.663570 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.663551    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"]
Sep 17 17:36:18.663692 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.663681    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.665493 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.665473    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:18.666732 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.666708    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 17:36:18.666968 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.666940    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 17:36:18.667054 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.666968    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:36:18.667054 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.666968    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m5kbr\""
Sep 17 17:36:18.667263 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.667246    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 17:36:18.669333 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.669317    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 17 17:36:18.669438 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.669317    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:36:18.669943 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.669923    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 17 17:36:18.670054 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.669989    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-f8c65\""
Sep 17 17:36:18.671750 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.671732    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 17:36:18.679842 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.679815    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4"]
Sep 17 17:36:18.680814 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.680793    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"]
Sep 17 17:36:18.681693 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.681673    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-m8nlf"]
Sep 17 17:36:18.739416 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.739387    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24tgz\" (UniqueName: \"kubernetes.io/projected/ac40df94-f601-44c9-b2bd-84d1777f48c4-kube-api-access-24tgz\") pod \"network-check-source-7cbc45fddc-cchl4\" (UID: \"ac40df94-f601-44c9-b2bd-84d1777f48c4\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4"
Sep 17 17:36:18.739416 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.739419    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-serving-cert\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.739640 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.739438    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jwnb\" (UniqueName: \"kubernetes.io/projected/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-kube-api-access-7jwnb\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.739640 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.739485    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-config\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.739640 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.739504    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-trusted-ca\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.739640 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.739527    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlkvh\" (UniqueName: \"kubernetes.io/projected/a99cb909-d860-4aba-9b4d-61e57f7a53da-kube-api-access-tlkvh\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:18.739640 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.739576    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:18.752939 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.752907    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk"]
Sep 17 17:36:18.754894 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.754877    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk"
Sep 17 17:36:18.759440 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.759415    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:36:18.759566 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.759458    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 17:36:18.759625 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.759598    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-k4r4t\""
Sep 17 17:36:18.769464 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.769440    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk"]
Sep 17 17:36:18.840572 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.840536    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-config\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.840572 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.840575    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnvkq\" (UniqueName: \"kubernetes.io/projected/44aafdf2-ce1d-48b0-af0b-258a670bf634-kube-api-access-nnvkq\") pod \"volume-data-source-validator-5c4db8bdf9-575dk\" (UID: \"44aafdf2-ce1d-48b0-af0b-258a670bf634\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk"
Sep 17 17:36:18.840815 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.840611    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-trusted-ca\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.840815 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.840682    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlkvh\" (UniqueName: \"kubernetes.io/projected/a99cb909-d860-4aba-9b4d-61e57f7a53da-kube-api-access-tlkvh\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:18.840815 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.840729    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:18.840815 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.840749    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24tgz\" (UniqueName: \"kubernetes.io/projected/ac40df94-f601-44c9-b2bd-84d1777f48c4-kube-api-access-24tgz\") pod \"network-check-source-7cbc45fddc-cchl4\" (UID: \"ac40df94-f601-44c9-b2bd-84d1777f48c4\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4"
Sep 17 17:36:18.840815 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.840772    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-serving-cert\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.840815 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.840799    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jwnb\" (UniqueName: \"kubernetes.io/projected/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-kube-api-access-7jwnb\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.841089 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:18.840879    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:36:18.841089 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:18.840996    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls podName:a99cb909-d860-4aba-9b4d-61e57f7a53da nodeName:}" failed. No retries permitted until 2026-09-17 17:36:19.340973866 +0000 UTC m=+140.668406964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-j9djx" (UID: "a99cb909-d860-4aba-9b4d-61e57f7a53da") : secret "samples-operator-tls" not found
Sep 17 17:36:18.841434 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.841402    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-config\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.841541 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.841465    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-trusted-ca\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.844285 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.844267    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-serving-cert\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.853161 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.853139    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"]
Sep 17 17:36:18.854990 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.854971    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:18.856143 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.856121    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jwnb\" (UniqueName: \"kubernetes.io/projected/8cfa90e4-2193-4b0d-ae07-880f3dc27c4d-kube-api-access-7jwnb\") pod \"console-operator-fd4bb46c-m8nlf\" (UID: \"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d\") " pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:18.857418 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.857396    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8g7cd\""
Sep 17 17:36:18.857527 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.857436    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 17 17:36:18.857527 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.857453    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 17 17:36:18.857527 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.857481    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 17 17:36:18.857846 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.857824    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:36:18.858782 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.858761    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24tgz\" (UniqueName: \"kubernetes.io/projected/ac40df94-f601-44c9-b2bd-84d1777f48c4-kube-api-access-24tgz\") pod \"network-check-source-7cbc45fddc-cchl4\" (UID: \"ac40df94-f601-44c9-b2bd-84d1777f48c4\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4"
Sep 17 17:36:18.859527 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.859500    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlkvh\" (UniqueName: \"kubernetes.io/projected/a99cb909-d860-4aba-9b4d-61e57f7a53da-kube-api-access-tlkvh\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:18.860162 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.860143    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67bfd788fb-xgjzl"]
Sep 17 17:36:18.862154 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.862137    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:18.866223 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.866204    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 17:36:18.866367 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.866205    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-trqlz\""
Sep 17 17:36:18.866367 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.866293    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 17:36:18.866598 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.866579    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 17:36:18.868499 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.868482    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"]
Sep 17 17:36:18.871848 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.871824    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 17:36:18.879419 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.879397    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bfd788fb-xgjzl"]
Sep 17 17:36:18.941924 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.941831    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-image-registry-private-configuration\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:18.941924 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.941867    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:18.941924 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.941882    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-trusted-ca\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:18.941924 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.941898    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-installation-pull-secrets\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:18.942181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.941943    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz2fq\" (UniqueName: \"kubernetes.io/projected/f921a0f5-7305-48c6-a425-9ca3aa783087-kube-api-access-bz2fq\") pod \"kube-storage-version-migrator-operator-55889f7b47-vzdgh\" (UID: \"f921a0f5-7305-48c6-a425-9ca3aa783087\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:18.942181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.941991    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-certificates\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:18.942181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.942049    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-ca-trust-extracted\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:18.942181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.942079    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jspgx\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-kube-api-access-jspgx\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:18.942181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.942115    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-bound-sa-token\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:18.942181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.942131    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f921a0f5-7305-48c6-a425-9ca3aa783087-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-vzdgh\" (UID: \"f921a0f5-7305-48c6-a425-9ca3aa783087\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:18.942374 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.942227    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnvkq\" (UniqueName: \"kubernetes.io/projected/44aafdf2-ce1d-48b0-af0b-258a670bf634-kube-api-access-nnvkq\") pod \"volume-data-source-validator-5c4db8bdf9-575dk\" (UID: \"44aafdf2-ce1d-48b0-af0b-258a670bf634\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk"
Sep 17 17:36:18.942374 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.942254    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f921a0f5-7305-48c6-a425-9ca3aa783087-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-vzdgh\" (UID: \"f921a0f5-7305-48c6-a425-9ca3aa783087\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:18.956536 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.956506    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnvkq\" (UniqueName: \"kubernetes.io/projected/44aafdf2-ce1d-48b0-af0b-258a670bf634-kube-api-access-nnvkq\") pod \"volume-data-source-validator-5c4db8bdf9-575dk\" (UID: \"44aafdf2-ce1d-48b0-af0b-258a670bf634\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk"
Sep 17 17:36:18.969309 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.969283    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4"
Sep 17 17:36:18.976273 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:18.976242    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:19.043440 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043409    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-image-registry-private-configuration\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.043591 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043520    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.043591 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043540    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-trusted-ca\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.043591 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043555    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-installation-pull-secrets\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.043591 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043573    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz2fq\" (UniqueName: \"kubernetes.io/projected/f921a0f5-7305-48c6-a425-9ca3aa783087-kube-api-access-bz2fq\") pod \"kube-storage-version-migrator-operator-55889f7b47-vzdgh\" (UID: \"f921a0f5-7305-48c6-a425-9ca3aa783087\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:19.043591 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043591    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-certificates\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.043849 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043618    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-ca-trust-extracted\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.043849 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043633    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jspgx\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-kube-api-access-jspgx\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.043849 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043660    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-bound-sa-token\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.043849 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043677    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f921a0f5-7305-48c6-a425-9ca3aa783087-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-vzdgh\" (UID: \"f921a0f5-7305-48c6-a425-9ca3aa783087\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:19.043849 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.043715    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f921a0f5-7305-48c6-a425-9ca3aa783087-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-vzdgh\" (UID: \"f921a0f5-7305-48c6-a425-9ca3aa783087\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:19.044103 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:19.043898    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:36:19.044103 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:19.043916    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfd788fb-xgjzl: secret "image-registry-tls" not found
Sep 17 17:36:19.044103 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:19.044004    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls podName:1315d0ff-e41f-4a59-8942-8f17e7e40fb0 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:19.543982777 +0000 UTC m=+140.871415868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls") pod "image-registry-67bfd788fb-xgjzl" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0") : secret "image-registry-tls" not found
Sep 17 17:36:19.044263 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.044231    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-ca-trust-extracted\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.044448 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.044330    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f921a0f5-7305-48c6-a425-9ca3aa783087-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-vzdgh\" (UID: \"f921a0f5-7305-48c6-a425-9ca3aa783087\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:19.044729 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.044708    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-certificates\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.044813 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.044780    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-trusted-ca\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.046144 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.046119    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-image-registry-private-configuration\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.046547 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.046525    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f921a0f5-7305-48c6-a425-9ca3aa783087-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-vzdgh\" (UID: \"f921a0f5-7305-48c6-a425-9ca3aa783087\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:19.046773 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.046758    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-installation-pull-secrets\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.057294 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.057264    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz2fq\" (UniqueName: \"kubernetes.io/projected/f921a0f5-7305-48c6-a425-9ca3aa783087-kube-api-access-bz2fq\") pod \"kube-storage-version-migrator-operator-55889f7b47-vzdgh\" (UID: \"f921a0f5-7305-48c6-a425-9ca3aa783087\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:19.057397 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.057341    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jspgx\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-kube-api-access-jspgx\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.057397 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.057366    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-bound-sa-token\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.063176 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.063157    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk"
Sep 17 17:36:19.175482 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.175446    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"
Sep 17 17:36:19.243010 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.242978    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4"]
Sep 17 17:36:19.247907 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:19.247876    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac40df94_f601_44c9_b2bd_84d1777f48c4.slice/crio-b108679b2c97886cd6c9f83d7e66c77683674d1d7a4845fac3e28012180bf41f WatchSource:0}: Error finding container b108679b2c97886cd6c9f83d7e66c77683674d1d7a4845fac3e28012180bf41f: Status 404 returned error can't find the container with id b108679b2c97886cd6c9f83d7e66c77683674d1d7a4845fac3e28012180bf41f
Sep 17 17:36:19.251607 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.251579    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-m8nlf"]
Sep 17 17:36:19.254127 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:19.254044    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cfa90e4_2193_4b0d_ae07_880f3dc27c4d.slice/crio-15b6ca2b18e270406ff1b252c91f5c3e537cdac3196ba28518b929e08338f1fb WatchSource:0}: Error finding container 15b6ca2b18e270406ff1b252c91f5c3e537cdac3196ba28518b929e08338f1fb: Status 404 returned error can't find the container with id 15b6ca2b18e270406ff1b252c91f5c3e537cdac3196ba28518b929e08338f1fb
Sep 17 17:36:19.270081 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.270055    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4" event={"ID":"ac40df94-f601-44c9-b2bd-84d1777f48c4","Type":"ContainerStarted","Data":"b108679b2c97886cd6c9f83d7e66c77683674d1d7a4845fac3e28012180bf41f"}
Sep 17 17:36:19.271048 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.271029    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf" event={"ID":"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d","Type":"ContainerStarted","Data":"15b6ca2b18e270406ff1b252c91f5c3e537cdac3196ba28518b929e08338f1fb"}
Sep 17 17:36:19.332981 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.332934    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk"]
Sep 17 17:36:19.335888 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:19.335862    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44aafdf2_ce1d_48b0_af0b_258a670bf634.slice/crio-52b3bd3132c3853f5138b5326762761545ff168e38ddcc7e7fe0a74c37a419d6 WatchSource:0}: Error finding container 52b3bd3132c3853f5138b5326762761545ff168e38ddcc7e7fe0a74c37a419d6: Status 404 returned error can't find the container with id 52b3bd3132c3853f5138b5326762761545ff168e38ddcc7e7fe0a74c37a419d6
Sep 17 17:36:19.346714 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.346682    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:19.346828 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:19.346814    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:36:19.346885 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:19.346876    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls podName:a99cb909-d860-4aba-9b4d-61e57f7a53da nodeName:}" failed. No retries permitted until 2026-09-17 17:36:20.34685844 +0000 UTC m=+141.674291523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-j9djx" (UID: "a99cb909-d860-4aba-9b4d-61e57f7a53da") : secret "samples-operator-tls" not found
Sep 17 17:36:19.451556 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.451525    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh"]
Sep 17 17:36:19.454387 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:19.454360    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf921a0f5_7305_48c6_a425_9ca3aa783087.slice/crio-e49f02e7c1badbf17265eb9c59166c74bdc58fc1fea3f6fa5848531929e79773 WatchSource:0}: Error finding container e49f02e7c1badbf17265eb9c59166c74bdc58fc1fea3f6fa5848531929e79773: Status 404 returned error can't find the container with id e49f02e7c1badbf17265eb9c59166c74bdc58fc1fea3f6fa5848531929e79773
Sep 17 17:36:19.548362 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:19.548327    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:19.548534 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:19.548489    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:36:19.548534 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:19.548509    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfd788fb-xgjzl: secret "image-registry-tls" not found
Sep 17 17:36:19.548618 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:19.548565    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls podName:1315d0ff-e41f-4a59-8942-8f17e7e40fb0 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:20.548549572 +0000 UTC m=+141.875982654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls") pod "image-registry-67bfd788fb-xgjzl" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0") : secret "image-registry-tls" not found
Sep 17 17:36:20.277036 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:20.276986    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk" event={"ID":"44aafdf2-ce1d-48b0-af0b-258a670bf634","Type":"ContainerStarted","Data":"52b3bd3132c3853f5138b5326762761545ff168e38ddcc7e7fe0a74c37a419d6"}
Sep 17 17:36:20.279828 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:20.279781    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4" event={"ID":"ac40df94-f601-44c9-b2bd-84d1777f48c4","Type":"ContainerStarted","Data":"34a3a01c4b60a0f7ee31986f0252d240d1e10f304e68380ccd0a7b38808f97bb"}
Sep 17 17:36:20.281450 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:20.281422    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh" event={"ID":"f921a0f5-7305-48c6-a425-9ca3aa783087","Type":"ContainerStarted","Data":"e49f02e7c1badbf17265eb9c59166c74bdc58fc1fea3f6fa5848531929e79773"}
Sep 17 17:36:20.300463 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:20.300407    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-cchl4" podStartSLOduration=2.300386134 podStartE2EDuration="2.300386134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:20.300182752 +0000 UTC m=+141.627615857" watchObservedRunningTime="2026-09-17 17:36:20.300386134 +0000 UTC m=+141.627819239"
Sep 17 17:36:20.355654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:20.355593    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:20.355806 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:20.355759    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:36:20.355870 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:20.355828    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls podName:a99cb909-d860-4aba-9b4d-61e57f7a53da nodeName:}" failed. No retries permitted until 2026-09-17 17:36:22.355808678 +0000 UTC m=+143.683241773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-j9djx" (UID: "a99cb909-d860-4aba-9b4d-61e57f7a53da") : secret "samples-operator-tls" not found
Sep 17 17:36:20.557559 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:20.557479    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:20.557703 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:20.557636    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:36:20.557703 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:20.557656    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfd788fb-xgjzl: secret "image-registry-tls" not found
Sep 17 17:36:20.557770 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:20.557715    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls podName:1315d0ff-e41f-4a59-8942-8f17e7e40fb0 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:22.557695688 +0000 UTC m=+143.885128770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls") pod "image-registry-67bfd788fb-xgjzl" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0") : secret "image-registry-tls" not found
Sep 17 17:36:21.286492 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:21.286445    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk" event={"ID":"44aafdf2-ce1d-48b0-af0b-258a670bf634","Type":"ContainerStarted","Data":"289c129d8e77b1f6534c96f2099ba5905e07940a50b02179755379763cfb5e12"}
Sep 17 17:36:22.292101 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:22.292074    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/0.log"
Sep 17 17:36:22.292513 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:22.292116    2586 generic.go:356] "Generic (PLEG): container finished" podID="8cfa90e4-2193-4b0d-ae07-880f3dc27c4d" containerID="73ff410dc78be29fe722ce5a776602d721f0476d0942e03be4c14a58db61f579" exitCode=255
Sep 17 17:36:22.292513 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:22.292205    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf" event={"ID":"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d","Type":"ContainerDied","Data":"73ff410dc78be29fe722ce5a776602d721f0476d0942e03be4c14a58db61f579"}
Sep 17 17:36:22.292513 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:22.292473    2586 scope.go:117] "RemoveContainer" containerID="73ff410dc78be29fe722ce5a776602d721f0476d0942e03be4c14a58db61f579"
Sep 17 17:36:22.293916 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:22.293891    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh" event={"ID":"f921a0f5-7305-48c6-a425-9ca3aa783087","Type":"ContainerStarted","Data":"39a561603568e1746403e065ee5840395ce436f899527e7b6ce4a2cea26b2548"}
Sep 17 17:36:22.315692 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:22.315503    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-575dk" podStartSLOduration=3.325934333 podStartE2EDuration="4.315484278s" totalImagesPullingTime="989.549945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:21.304935634 +0000 UTC m=+142.632368739" watchObservedRunningTime="2026-09-17 17:36:22.315484278 +0000 UTC m=+143.642917382"
Sep 17 17:36:22.336598 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:22.336548    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh" podStartSLOduration=2.127762595 podStartE2EDuration="4.336530552s" totalImagesPullingTime="2.208767957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:22.335346869 +0000 UTC m=+143.662779973" watchObservedRunningTime="2026-09-17 17:36:22.336530552 +0000 UTC m=+143.663963657"
Sep 17 17:36:22.375098 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:22.374588    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:22.375098 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:22.374928    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:36:22.375098 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:22.375013    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls podName:a99cb909-d860-4aba-9b4d-61e57f7a53da nodeName:}" failed. No retries permitted until 2026-09-17 17:36:26.37499481 +0000 UTC m=+147.702427901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-j9djx" (UID: "a99cb909-d860-4aba-9b4d-61e57f7a53da") : secret "samples-operator-tls" not found
Sep 17 17:36:22.576246 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:22.576144    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:22.576419 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:22.576297    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:36:22.576419 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:22.576315    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfd788fb-xgjzl: secret "image-registry-tls" not found
Sep 17 17:36:22.576419 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:22.576369    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls podName:1315d0ff-e41f-4a59-8942-8f17e7e40fb0 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:26.576354765 +0000 UTC m=+147.903787848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls") pod "image-registry-67bfd788fb-xgjzl" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0") : secret "image-registry-tls" not found
Sep 17 17:36:23.023515 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.023481    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-stkx7"]
Sep 17 17:36:23.025626 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.025600    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.028823 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.028799    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 17:36:23.028823 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.028818    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 17:36:23.029189 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.029173    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 17:36:23.029252 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.029195    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 17:36:23.029797 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.029783    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kp8x9\""
Sep 17 17:36:23.039459 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.039438    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stkx7"]
Sep 17 17:36:23.181480 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.181437    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32b3dc76-eec7-4aa0-859c-816db4eb1f20-data-volume\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.181683 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.181531    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32b3dc76-eec7-4aa0-859c-816db4eb1f20-crio-socket\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.181683 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.181557    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.181683 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.181586    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.181790 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.181688    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tkwc\" (UniqueName: \"kubernetes.io/projected/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-api-access-7tkwc\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.283030 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.282933    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32b3dc76-eec7-4aa0-859c-816db4eb1f20-data-volume\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.283168 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.283115    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32b3dc76-eec7-4aa0-859c-816db4eb1f20-crio-socket\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.283168 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.283155    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.283249 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.283181    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.283249 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.283207    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tkwc\" (UniqueName: \"kubernetes.io/projected/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-api-access-7tkwc\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.283249 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.283206    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32b3dc76-eec7-4aa0-859c-816db4eb1f20-crio-socket\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.283391 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:23.283280    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:23.283391 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:23.283315    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:23.283391 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:23.283335    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:23.783322238 +0000 UTC m=+145.110755360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:23.283391 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.283278    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32b3dc76-eec7-4aa0-859c-816db4eb1f20-data-volume\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.283535 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:23.283398    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:23.783380099 +0000 UTC m=+145.110813210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:23.298894 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.298871    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:36:23.299324 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.299313    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/0.log"
Sep 17 17:36:23.299364 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.299346    2586 generic.go:356] "Generic (PLEG): container finished" podID="8cfa90e4-2193-4b0d-ae07-880f3dc27c4d" containerID="fa4804a54afeeb97597d5c6fa8affad109b4fea2474e64877cea2f011174ce2d" exitCode=255
Sep 17 17:36:23.299439 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.299423    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf" event={"ID":"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d","Type":"ContainerDied","Data":"fa4804a54afeeb97597d5c6fa8affad109b4fea2474e64877cea2f011174ce2d"}
Sep 17 17:36:23.299519 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.299505    2586 scope.go:117] "RemoveContainer" containerID="73ff410dc78be29fe722ce5a776602d721f0476d0942e03be4c14a58db61f579"
Sep 17 17:36:23.299782 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.299765    2586 scope.go:117] "RemoveContainer" containerID="fa4804a54afeeb97597d5c6fa8affad109b4fea2474e64877cea2f011174ce2d"
Sep 17 17:36:23.299995 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:23.299973    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-m8nlf_openshift-console-operator(8cfa90e4-2193-4b0d-ae07-880f3dc27c4d)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf" podUID="8cfa90e4-2193-4b0d-ae07-880f3dc27c4d"
Sep 17 17:36:23.305480 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.305456    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tkwc\" (UniqueName: \"kubernetes.io/projected/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-api-access-7tkwc\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.787736 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.787706    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.787931 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:23.787745    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:23.787931 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:23.787879    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:23.787931 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:23.787900    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:23.788130 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:23.787977    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:24.787944809 +0000 UTC m=+146.115377892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:23.788130 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:23.787995    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:24.787986256 +0000 UTC m=+146.115419342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:24.304428 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.304397    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:36:24.304809 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.304730    2586 scope.go:117] "RemoveContainer" containerID="fa4804a54afeeb97597d5c6fa8affad109b4fea2474e64877cea2f011174ce2d"
Sep 17 17:36:24.304890 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:24.304871    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-m8nlf_openshift-console-operator(8cfa90e4-2193-4b0d-ae07-880f3dc27c4d)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf" podUID="8cfa90e4-2193-4b0d-ae07-880f3dc27c4d"
Sep 17 17:36:24.450507 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.450472    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"]
Sep 17 17:36:24.453181 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.453162    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:24.456107 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.456084    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 17:36:24.456269 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.456192    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7zknh\""
Sep 17 17:36:24.456269 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.456199    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 17:36:24.465398 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.465371    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"]
Sep 17 17:36:24.593840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.593752    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:24.593840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.593798    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:24.694480 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.694437    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:24.694584 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.694553    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:24.694623 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:24.694594    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 17:36:24.694675 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:24.694664    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert podName:519129db-a7b4-4a8b-97e4-884bc0cfbd5d nodeName:}" failed. No retries permitted until 2026-09-17 17:36:25.194648676 +0000 UTC m=+146.522081758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-lgq2g" (UID: "519129db-a7b4-4a8b-97e4-884bc0cfbd5d") : secret "networking-console-plugin-cert" not found
Sep 17 17:36:24.695163 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.695148    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:24.795555 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.795510    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:24.795631 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.795571    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:24.795672 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:24.795622    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:24.795714 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:24.795689    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:24.795714 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:24.795703    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:26.795682953 +0000 UTC m=+148.123116049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:24.795789 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:24.795727    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:26.795717367 +0000 UTC m=+148.123150449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:24.948379 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:24.948293    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g9ckj_333ce5a7-0e31-40c2-9929-b855616daf6a/dns-node-resolver/0.log"
Sep 17 17:36:25.199533 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.199454    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:25.199671 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:25.199608    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 17:36:25.199710 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:25.199674    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert podName:519129db-a7b4-4a8b-97e4-884bc0cfbd5d nodeName:}" failed. No retries permitted until 2026-09-17 17:36:26.199656606 +0000 UTC m=+147.527089702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-lgq2g" (UID: "519129db-a7b4-4a8b-97e4-884bc0cfbd5d") : secret "networking-console-plugin-cert" not found
Sep 17 17:36:25.207525 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.207495    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-fssp8"]
Sep 17 17:36:25.209439 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.209424    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.211820 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.211794    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 17:36:25.211941 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.211794    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 17:36:25.211941 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.211796    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 17:36:25.211941 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.211801    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 17:36:25.212696 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.212682    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dg9hf\""
Sep 17 17:36:25.218305 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.218275    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-fssp8"]
Sep 17 17:36:25.300935 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.300898    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtj7\" (UniqueName: \"kubernetes.io/projected/e5b3852b-5269-4ec8-aac1-858d16efc463-kube-api-access-bqtj7\") pod \"service-ca-55f6fc7b86-fssp8\" (UID: \"e5b3852b-5269-4ec8-aac1-858d16efc463\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.301123 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.300972    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e5b3852b-5269-4ec8-aac1-858d16efc463-signing-cabundle\") pod \"service-ca-55f6fc7b86-fssp8\" (UID: \"e5b3852b-5269-4ec8-aac1-858d16efc463\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.301123 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.301076    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e5b3852b-5269-4ec8-aac1-858d16efc463-signing-key\") pod \"service-ca-55f6fc7b86-fssp8\" (UID: \"e5b3852b-5269-4ec8-aac1-858d16efc463\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.401869 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.401827    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e5b3852b-5269-4ec8-aac1-858d16efc463-signing-key\") pod \"service-ca-55f6fc7b86-fssp8\" (UID: \"e5b3852b-5269-4ec8-aac1-858d16efc463\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.402335 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.401919    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtj7\" (UniqueName: \"kubernetes.io/projected/e5b3852b-5269-4ec8-aac1-858d16efc463-kube-api-access-bqtj7\") pod \"service-ca-55f6fc7b86-fssp8\" (UID: \"e5b3852b-5269-4ec8-aac1-858d16efc463\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.402335 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.402017    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e5b3852b-5269-4ec8-aac1-858d16efc463-signing-cabundle\") pod \"service-ca-55f6fc7b86-fssp8\" (UID: \"e5b3852b-5269-4ec8-aac1-858d16efc463\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.402625 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.402607    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e5b3852b-5269-4ec8-aac1-858d16efc463-signing-cabundle\") pod \"service-ca-55f6fc7b86-fssp8\" (UID: \"e5b3852b-5269-4ec8-aac1-858d16efc463\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.404329 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.404312    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e5b3852b-5269-4ec8-aac1-858d16efc463-signing-key\") pod \"service-ca-55f6fc7b86-fssp8\" (UID: \"e5b3852b-5269-4ec8-aac1-858d16efc463\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.412296 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.412272    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtj7\" (UniqueName: \"kubernetes.io/projected/e5b3852b-5269-4ec8-aac1-858d16efc463-kube-api-access-bqtj7\") pod \"service-ca-55f6fc7b86-fssp8\" (UID: \"e5b3852b-5269-4ec8-aac1-858d16efc463\") " pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.519545 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.519514    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8"
Sep 17 17:36:25.791199 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:25.791119    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-fssp8"]
Sep 17 17:36:25.794385 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:25.794358    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b3852b_5269_4ec8_aac1_858d16efc463.slice/crio-859c92e377d2b835140e8261c00390f5dced8af36fb5a0ea82100f87563b6805 WatchSource:0}: Error finding container 859c92e377d2b835140e8261c00390f5dced8af36fb5a0ea82100f87563b6805: Status 404 returned error can't find the container with id 859c92e377d2b835140e8261c00390f5dced8af36fb5a0ea82100f87563b6805
Sep 17 17:36:26.150124 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:26.150050    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kkv5p_64eb3efe-305b-4efd-bcc1-1381b298e187/node-ca/0.log"
Sep 17 17:36:26.209214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:26.209171    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:26.209379 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.209310    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 17:36:26.209477 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.209392    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert podName:519129db-a7b4-4a8b-97e4-884bc0cfbd5d nodeName:}" failed. No retries permitted until 2026-09-17 17:36:28.209371985 +0000 UTC m=+149.536805085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-lgq2g" (UID: "519129db-a7b4-4a8b-97e4-884bc0cfbd5d") : secret "networking-console-plugin-cert" not found
Sep 17 17:36:26.312856 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:26.312816    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8" event={"ID":"e5b3852b-5269-4ec8-aac1-858d16efc463","Type":"ContainerStarted","Data":"859c92e377d2b835140e8261c00390f5dced8af36fb5a0ea82100f87563b6805"}
Sep 17 17:36:26.411038 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:26.410935    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:26.411442 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.411100    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 17:36:26.411442 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.411177    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls podName:a99cb909-d860-4aba-9b4d-61e57f7a53da nodeName:}" failed. No retries permitted until 2026-09-17 17:36:34.411157301 +0000 UTC m=+155.738590397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-j9djx" (UID: "a99cb909-d860-4aba-9b4d-61e57f7a53da") : secret "samples-operator-tls" not found
Sep 17 17:36:26.547993 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:26.547946    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2vzr4_8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e/serve-healthcheck-canary/0.log"
Sep 17 17:36:26.613715 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:26.613673    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:26.613893 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.613834    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:36:26.613893 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.613863    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bfd788fb-xgjzl: secret "image-registry-tls" not found
Sep 17 17:36:26.613992 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.613938    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls podName:1315d0ff-e41f-4a59-8942-8f17e7e40fb0 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:34.613915985 +0000 UTC m=+155.941349068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls") pod "image-registry-67bfd788fb-xgjzl" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0") : secret "image-registry-tls" not found
Sep 17 17:36:26.815813 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:26.815771    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:26.815813 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:26.815819    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:26.816090 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.815906    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:26.816090 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.815928    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:26.816090 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.815992    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:30.815970487 +0000 UTC m=+152.143403571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:26.816090 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:26.816012    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:30.816001548 +0000 UTC m=+152.143434636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:28.227269 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:28.227226    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:28.227666 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:28.227391    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 17:36:28.227666 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:28.227457    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert podName:519129db-a7b4-4a8b-97e4-884bc0cfbd5d nodeName:}" failed. No retries permitted until 2026-09-17 17:36:32.227441851 +0000 UTC m=+153.554874933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-lgq2g" (UID: "519129db-a7b4-4a8b-97e4-884bc0cfbd5d") : secret "networking-console-plugin-cert" not found
Sep 17 17:36:28.320459 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:28.320427    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8" event={"ID":"e5b3852b-5269-4ec8-aac1-858d16efc463","Type":"ContainerStarted","Data":"4d524dd50faa0c48b42c664e7c83a94be466c7404fbe8d61bce8376f41cb2d4c"}
Sep 17 17:36:28.339233 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:28.339187    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-fssp8" podStartSLOduration=1.580849875 podStartE2EDuration="3.339171856s" totalImagesPullingTime="1.758321981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:28.338420383 +0000 UTC m=+149.665853487" watchObservedRunningTime="2026-09-17 17:36:28.339171856 +0000 UTC m=+149.666604959"
Sep 17 17:36:28.977314 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:28.977270    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:28.977568 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:28.977545    2586 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:28.977987 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:28.977972    2586 scope.go:117] "RemoveContainer" containerID="fa4804a54afeeb97597d5c6fa8affad109b4fea2474e64877cea2f011174ce2d"
Sep 17 17:36:28.978181 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:28.978159    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-m8nlf_openshift-console-operator(8cfa90e4-2193-4b0d-ae07-880f3dc27c4d)\"" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf" podUID="8cfa90e4-2193-4b0d-ae07-880f3dc27c4d"
Sep 17 17:36:30.852305 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:30.852264    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:30.852305 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:30.852305    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:30.852739 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:30.852381    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:36:30.852739 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:30.852406    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:30.852739 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:30.852433    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:38.852420448 +0000 UTC m=+160.179853530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : configmap "kube-rbac-proxy" not found
Sep 17 17:36:30.852739 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:30.852480    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls podName:32b3dc76-eec7-4aa0-859c-816db4eb1f20 nodeName:}" failed. No retries permitted until 2026-09-17 17:36:38.852466175 +0000 UTC m=+160.179899256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stkx7" (UID: "32b3dc76-eec7-4aa0-859c-816db4eb1f20") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:36:32.262970 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:32.262920    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:32.263436 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:32.263064    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 17:36:32.263436 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:32.263127    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert podName:519129db-a7b4-4a8b-97e4-884bc0cfbd5d nodeName:}" failed. No retries permitted until 2026-09-17 17:36:40.263112247 +0000 UTC m=+161.590545329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-lgq2g" (UID: "519129db-a7b4-4a8b-97e4-884bc0cfbd5d") : secret "networking-console-plugin-cert" not found
Sep 17 17:36:34.483622 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:34.483584    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:34.485876 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:34.485856    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a99cb909-d860-4aba-9b4d-61e57f7a53da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-j9djx\" (UID: \"a99cb909-d860-4aba-9b4d-61e57f7a53da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:34.580942 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:34.580909    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"
Sep 17 17:36:34.684571 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:34.684542    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:34.686970 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:34.686924    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") pod \"image-registry-67bfd788fb-xgjzl\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") " pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:34.780315 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:34.780279    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:34.863183 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:34.863161    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx"]
Sep 17 17:36:35.054811 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:35.054697    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bfd788fb-xgjzl"]
Sep 17 17:36:35.059439 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:35.059414    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1315d0ff_e41f_4a59_8942_8f17e7e40fb0.slice/crio-04f215f17ccd7bb16c0ce2bdbb3cadadab0d133ffc5efe1e850fa8ab994cc9d5 WatchSource:0}: Error finding container 04f215f17ccd7bb16c0ce2bdbb3cadadab0d133ffc5efe1e850fa8ab994cc9d5: Status 404 returned error can't find the container with id 04f215f17ccd7bb16c0ce2bdbb3cadadab0d133ffc5efe1e850fa8ab994cc9d5
Sep 17 17:36:35.344505 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:35.344423    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl" event={"ID":"1315d0ff-e41f-4a59-8942-8f17e7e40fb0","Type":"ContainerStarted","Data":"5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697"}
Sep 17 17:36:35.344505 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:35.344479    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl" event={"ID":"1315d0ff-e41f-4a59-8942-8f17e7e40fb0","Type":"ContainerStarted","Data":"04f215f17ccd7bb16c0ce2bdbb3cadadab0d133ffc5efe1e850fa8ab994cc9d5"}
Sep 17 17:36:35.344505 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:35.344499    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:36:35.345623 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:35.345596    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx" event={"ID":"a99cb909-d860-4aba-9b4d-61e57f7a53da","Type":"ContainerStarted","Data":"46f32b1a45ebf86b87906050d3624dc3545cd121a626d8a1763baed726c8e41a"}
Sep 17 17:36:35.366557 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:35.366506    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl" podStartSLOduration=17.366489998 podStartE2EDuration="17.366489998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:35.365685395 +0000 UTC m=+156.693118498" watchObservedRunningTime="2026-09-17 17:36:35.366489998 +0000 UTC m=+156.693923101"
Sep 17 17:36:36.773612 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:36.773579    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5n874" podUID="5ceee1e7-8072-46f3-8122-49b19e223845"
Sep 17 17:36:36.830684 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:36:36.830642    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d5rkr" podUID="53437e34-2e7d-4e34-a8b6-6886e50a8463"
Sep 17 17:36:37.353443 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:37.353409    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx" event={"ID":"a99cb909-d860-4aba-9b4d-61e57f7a53da","Type":"ContainerStarted","Data":"0eb8010f731f01026b6e2d4bcf8bdc3b63c564e5f20ce30d1353a0e2f7def5e5"}
Sep 17 17:36:37.353443 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:37.353428    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5n874"
Sep 17 17:36:37.353634 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:37.353463    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx" event={"ID":"a99cb909-d860-4aba-9b4d-61e57f7a53da","Type":"ContainerStarted","Data":"12bbf35cc627bb0b4aaad501f7aef7dfd359a2ee7db176467114c9ce11b2116a"}
Sep 17 17:36:37.378724 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:37.375879    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-j9djx" podStartSLOduration=17.579090934 podStartE2EDuration="19.37586024s" totalImagesPullingTime="1.796769306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:37.373941269 +0000 UTC m=+158.701374373" watchObservedRunningTime="2026-09-17 17:36:37.37586024 +0000 UTC m=+158.703293345"
Sep 17 17:36:38.921383 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:38.921347    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:38.921383 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:38.921386    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:38.921916 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:38.921898    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32b3dc76-eec7-4aa0-859c-816db4eb1f20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:38.923633 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:38.923610    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32b3dc76-eec7-4aa0-859c-816db4eb1f20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stkx7\" (UID: \"32b3dc76-eec7-4aa0-859c-816db4eb1f20\") " pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:38.934609 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:38.934588    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stkx7"
Sep 17 17:36:39.222058 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:39.222027    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stkx7"]
Sep 17 17:36:39.224627 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:39.224602    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b3dc76_eec7_4aa0_859c_816db4eb1f20.slice/crio-95d378ff33f4c56dd4bf1408482ffe98bbd9278ca87d08b7083b6f671c222d2a WatchSource:0}: Error finding container 95d378ff33f4c56dd4bf1408482ffe98bbd9278ca87d08b7083b6f671c222d2a: Status 404 returned error can't find the container with id 95d378ff33f4c56dd4bf1408482ffe98bbd9278ca87d08b7083b6f671c222d2a
Sep 17 17:36:39.360997 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:39.360963    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stkx7" event={"ID":"32b3dc76-eec7-4aa0-859c-816db4eb1f20","Type":"ContainerStarted","Data":"253b84a3df83171507c19fc9475d7fd8a83f252765627f359e692ca4b5138492"}
Sep 17 17:36:39.361137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:39.361015    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stkx7" event={"ID":"32b3dc76-eec7-4aa0-859c-816db4eb1f20","Type":"ContainerStarted","Data":"95d378ff33f4c56dd4bf1408482ffe98bbd9278ca87d08b7083b6f671c222d2a"}
Sep 17 17:36:40.330775 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:40.330740    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:40.333365 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:40.333343    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/519129db-a7b4-4a8b-97e4-884bc0cfbd5d-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-lgq2g\" (UID: \"519129db-a7b4-4a8b-97e4-884bc0cfbd5d\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:40.362069 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:40.362045    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"
Sep 17 17:36:40.764930 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:40.764899    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g"]
Sep 17 17:36:40.768376 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:40.768347    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519129db_a7b4_4a8b_97e4_884bc0cfbd5d.slice/crio-6fcf757a451e1e0ec4eb8fb7ee0ebfe1abaf8d126ca78dc70f97b064defa667a WatchSource:0}: Error finding container 6fcf757a451e1e0ec4eb8fb7ee0ebfe1abaf8d126ca78dc70f97b064defa667a: Status 404 returned error can't find the container with id 6fcf757a451e1e0ec4eb8fb7ee0ebfe1abaf8d126ca78dc70f97b064defa667a
Sep 17 17:36:41.369924 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:41.369888    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g" event={"ID":"519129db-a7b4-4a8b-97e4-884bc0cfbd5d","Type":"ContainerStarted","Data":"6fcf757a451e1e0ec4eb8fb7ee0ebfe1abaf8d126ca78dc70f97b064defa667a"}
Sep 17 17:36:41.372113 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:41.372085    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stkx7" event={"ID":"32b3dc76-eec7-4aa0-859c-816db4eb1f20","Type":"ContainerStarted","Data":"eec062468cf75304b68985e35376db9a33ca40593b20e26336ecdce9d2b13a3c"}
Sep 17 17:36:41.641343 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:41.641267    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:36:41.643874 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:41.643846    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ceee1e7-8072-46f3-8122-49b19e223845-metrics-tls\") pod \"dns-default-5n874\" (UID: \"5ceee1e7-8072-46f3-8122-49b19e223845\") " pod="openshift-dns/dns-default-5n874"
Sep 17 17:36:41.856409 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:41.856380    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vdp8v\""
Sep 17 17:36:41.864822 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:41.864782    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5n874"
Sep 17 17:36:42.378458 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:42.378422    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g" event={"ID":"519129db-a7b4-4a8b-97e4-884bc0cfbd5d","Type":"ContainerStarted","Data":"903bbfe2f942f0f26c1b3e31f0dab1ea44014ab0f794bce775387ba7fdceba23"}
Sep 17 17:36:42.380433 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:42.380402    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stkx7" event={"ID":"32b3dc76-eec7-4aa0-859c-816db4eb1f20","Type":"ContainerStarted","Data":"1c3b68591b113d2bbc525dfe88ccd21511f680a5811bebe8b386a5967d8f660a"}
Sep 17 17:36:42.395050 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:42.394868    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-lgq2g" podStartSLOduration=17.026734518 podStartE2EDuration="18.394850505s" totalImagesPullingTime="1.368115987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:42.394824756 +0000 UTC m=+163.722257861" watchObservedRunningTime="2026-09-17 17:36:42.394850505 +0000 UTC m=+163.722283610"
Sep 17 17:36:42.401085 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:42.401061    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5n874"]
Sep 17 17:36:42.404375 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:42.404351    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ceee1e7_8072_46f3_8122_49b19e223845.slice/crio-e7b98c9f22e02eb0ac8e486a82797efb68e10312952687ddf5ebb9c2eb38519d WatchSource:0}: Error finding container e7b98c9f22e02eb0ac8e486a82797efb68e10312952687ddf5ebb9c2eb38519d: Status 404 returned error can't find the container with id e7b98c9f22e02eb0ac8e486a82797efb68e10312952687ddf5ebb9c2eb38519d
Sep 17 17:36:42.416770 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:42.416728    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-stkx7" podStartSLOduration=16.688608079 podStartE2EDuration="19.416713096s" totalImagesPullingTime="2.728105017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:36:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:42.416288707 +0000 UTC m=+163.743721816" watchObservedRunningTime="2026-09-17 17:36:42.416713096 +0000 UTC m=+163.744146200"
Sep 17 17:36:42.812125 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:42.812100    2586 scope.go:117] "RemoveContainer" containerID="fa4804a54afeeb97597d5c6fa8affad109b4fea2474e64877cea2f011174ce2d"
Sep 17 17:36:43.388489 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:43.388460    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:36:43.388923 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:43.388588    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf" event={"ID":"8cfa90e4-2193-4b0d-ae07-880f3dc27c4d","Type":"ContainerStarted","Data":"b49f55993b3596cbecb9ef310a1c3fa39c7f2becd9d94fb99677af0274bd50ae"}
Sep 17 17:36:43.389073 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:43.389056    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:43.390216 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:43.390190    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5n874" event={"ID":"5ceee1e7-8072-46f3-8122-49b19e223845","Type":"ContainerStarted","Data":"e7b98c9f22e02eb0ac8e486a82797efb68e10312952687ddf5ebb9c2eb38519d"}
Sep 17 17:36:43.394659 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:43.394634    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf"
Sep 17 17:36:43.436496 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:43.436444    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-m8nlf" podStartSLOduration=23.030367112 podStartE2EDuration="25.436423491s" totalImagesPullingTime="2.406056379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:43.435731581 +0000 UTC m=+164.763164686" watchObservedRunningTime="2026-09-17 17:36:43.436423491 +0000 UTC m=+164.763856590"
Sep 17 17:36:45.398872 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:45.398830    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5n874" event={"ID":"5ceee1e7-8072-46f3-8122-49b19e223845","Type":"ContainerStarted","Data":"1b34b98399f5e50f18a7e8dc055b8f12e2bc97a5f4f7813e538fcd3a2a782c92"}
Sep 17 17:36:45.399356 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:45.398892    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5n874" event={"ID":"5ceee1e7-8072-46f3-8122-49b19e223845","Type":"ContainerStarted","Data":"be4a560db1ca8ba60fdc4b7908d21cd6947234c53af58369ad05e89fb04e647d"}
Sep 17 17:36:45.424488 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:45.424420    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5n874" podStartSLOduration=130.484837483 podStartE2EDuration="2m12.42439726s" totalImagesPullingTime="1.939559777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:45.422505447 +0000 UTC m=+166.749938553" watchObservedRunningTime="2026-09-17 17:36:45.42439726 +0000 UTC m=+166.751830369"
Sep 17 17:36:46.403204 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:46.403173    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5n874"
Sep 17 17:36:47.620355 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.620318    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67bfd788fb-xgjzl"]
Sep 17 17:36:47.670146 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.670116    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"]
Sep 17 17:36:47.673240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.673225    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.685567 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.685541    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"]
Sep 17 17:36:47.690552 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.690530    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/916d7461-7312-45d1-80fe-9d83fc853a45-image-registry-private-configuration\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.690663 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.690561    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/916d7461-7312-45d1-80fe-9d83fc853a45-registry-certificates\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.690663 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.690587    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/916d7461-7312-45d1-80fe-9d83fc853a45-trusted-ca\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.690663 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.690613    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/916d7461-7312-45d1-80fe-9d83fc853a45-ca-trust-extracted\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.690825 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.690695    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/916d7461-7312-45d1-80fe-9d83fc853a45-installation-pull-secrets\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.690825 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.690742    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/916d7461-7312-45d1-80fe-9d83fc853a45-bound-sa-token\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.690825 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.690774    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/916d7461-7312-45d1-80fe-9d83fc853a45-registry-tls\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.690825 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.690799    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5jgd\" (UniqueName: \"kubernetes.io/projected/916d7461-7312-45d1-80fe-9d83fc853a45-kube-api-access-m5jgd\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.791558 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.791525    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/916d7461-7312-45d1-80fe-9d83fc853a45-installation-pull-secrets\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.791746 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.791567    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/916d7461-7312-45d1-80fe-9d83fc853a45-bound-sa-token\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.791746 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.791592    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/916d7461-7312-45d1-80fe-9d83fc853a45-registry-tls\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.791746 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.791613    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5jgd\" (UniqueName: \"kubernetes.io/projected/916d7461-7312-45d1-80fe-9d83fc853a45-kube-api-access-m5jgd\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.791746 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.791690    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/916d7461-7312-45d1-80fe-9d83fc853a45-image-registry-private-configuration\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.791994 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.791871    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/916d7461-7312-45d1-80fe-9d83fc853a45-registry-certificates\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.791994 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.791908    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/916d7461-7312-45d1-80fe-9d83fc853a45-trusted-ca\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.791994 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.791940    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/916d7461-7312-45d1-80fe-9d83fc853a45-ca-trust-extracted\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.792370 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.792345    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/916d7461-7312-45d1-80fe-9d83fc853a45-ca-trust-extracted\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.792650 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.792628    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/916d7461-7312-45d1-80fe-9d83fc853a45-registry-certificates\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.792823 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.792804    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/916d7461-7312-45d1-80fe-9d83fc853a45-trusted-ca\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.794177 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.794158    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/916d7461-7312-45d1-80fe-9d83fc853a45-registry-tls\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.794454 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.794438    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/916d7461-7312-45d1-80fe-9d83fc853a45-image-registry-private-configuration\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.794538 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.794521    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/916d7461-7312-45d1-80fe-9d83fc853a45-installation-pull-secrets\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.802540 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.802516    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/916d7461-7312-45d1-80fe-9d83fc853a45-bound-sa-token\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.802540 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.802522    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5jgd\" (UniqueName: \"kubernetes.io/projected/916d7461-7312-45d1-80fe-9d83fc853a45-kube-api-access-m5jgd\") pod \"image-registry-6f8cb86bbd-6hbsp\" (UID: \"916d7461-7312-45d1-80fe-9d83fc853a45\") " pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:47.982372 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:47.982298    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:48.260389 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:48.260359    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"]
Sep 17 17:36:48.263199 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:36:48.263169    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916d7461_7312_45d1_80fe_9d83fc853a45.slice/crio-f885caa9f17dbd37a6ba87aaf9d8e6b631e9584bae02382faa09672b7e4acee2 WatchSource:0}: Error finding container f885caa9f17dbd37a6ba87aaf9d8e6b631e9584bae02382faa09672b7e4acee2: Status 404 returned error can't find the container with id f885caa9f17dbd37a6ba87aaf9d8e6b631e9584bae02382faa09672b7e4acee2
Sep 17 17:36:48.411115 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:48.411077    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp" event={"ID":"916d7461-7312-45d1-80fe-9d83fc853a45","Type":"ContainerStarted","Data":"b8e26ca15b794b2e752bb44f610c6fde7ff1fb9d8e2b45405129e78a4f1d6f5d"}
Sep 17 17:36:48.411280 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:48.411133    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp" event={"ID":"916d7461-7312-45d1-80fe-9d83fc853a45","Type":"ContainerStarted","Data":"f885caa9f17dbd37a6ba87aaf9d8e6b631e9584bae02382faa09672b7e4acee2"}
Sep 17 17:36:48.411280 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:48.411182    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:36:48.444895 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:48.444835    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp" podStartSLOduration=1.4448135739999999 podStartE2EDuration="1.444813574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:36:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:36:48.444483722 +0000 UTC m=+169.771916826" watchObservedRunningTime="2026-09-17 17:36:48.444813574 +0000 UTC m=+169.772246679"
Sep 17 17:36:49.812156 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:49.812107    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:36:56.408463 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:56.408432    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5n874"
Sep 17 17:36:57.626107 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:57.626072    2586 patch_prober.go:28] interesting pod/image-registry-67bfd788fb-xgjzl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 17:36:57.626539 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:36:57.626121    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl" podUID="1315d0ff-e41f-4a59-8942-8f17e7e40fb0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:37:07.624881 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:07.624851    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:37:09.419005 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.418977    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f8cb86bbd-6hbsp"
Sep 17 17:37:09.597897 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.597856    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"]
Sep 17 17:37:09.605963 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.605930    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.609446 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.609413    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 17 17:37:09.609658 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.609638    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 17:37:09.609658 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.609655    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 17:37:09.609776 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.609699    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 17 17:37:09.609858 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.609840    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vcrh8\""
Sep 17 17:37:09.609910 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.609881    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 17:37:09.615385 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.615362    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"]
Sep 17 17:37:09.629856 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.629829    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-txhwc"]
Sep 17 17:37:09.633538 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.633518    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.636465 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.636446    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dq864\""
Sep 17 17:37:09.636758 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.636741    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 17:37:09.636852 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.636814    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 17:37:09.637483 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.637468    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 17:37:09.667663 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.667640    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d4e790-3784-44bc-9050-1a296e108069-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.667787 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.667688    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42d4e790-3784-44bc-9050-1a296e108069-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.667787 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.667707    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjv56\" (UniqueName: \"kubernetes.io/projected/42d4e790-3784-44bc-9050-1a296e108069-kube-api-access-wjv56\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.667787 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.667728    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42d4e790-3784-44bc-9050-1a296e108069-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.769097 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769063    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-tls\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.769233 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769127    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xplz\" (UniqueName: \"kubernetes.io/projected/e91fb231-2326-404b-92f1-b36a65d4f665-kube-api-access-9xplz\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.769233 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769205    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d4e790-3784-44bc-9050-1a296e108069-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.769328 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769234    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e91fb231-2326-404b-92f1-b36a65d4f665-root\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.769328 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769264    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e91fb231-2326-404b-92f1-b36a65d4f665-metrics-client-ca\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.769425 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769324    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-textfile\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.769425 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769400    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-accelerators-collector-config\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.769528 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769450    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42d4e790-3784-44bc-9050-1a296e108069-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.769528 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769482    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjv56\" (UniqueName: \"kubernetes.io/projected/42d4e790-3784-44bc-9050-1a296e108069-kube-api-access-wjv56\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.769528 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769512    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-wtmp\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.769667 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769540    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42d4e790-3784-44bc-9050-1a296e108069-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.769667 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769566    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e91fb231-2326-404b-92f1-b36a65d4f665-sys\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.769667 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.769624    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.769778 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:37:09.769668    2586 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 17 17:37:09.769778 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:37:09.769737    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d4e790-3784-44bc-9050-1a296e108069-openshift-state-metrics-tls podName:42d4e790-3784-44bc-9050-1a296e108069 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:10.269723566 +0000 UTC m=+191.597156652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/42d4e790-3784-44bc-9050-1a296e108069-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-4m7q9" (UID: "42d4e790-3784-44bc-9050-1a296e108069") : secret "openshift-state-metrics-tls" not found
Sep 17 17:37:09.770088 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.770064    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42d4e790-3784-44bc-9050-1a296e108069-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.771925 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.771896    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42d4e790-3784-44bc-9050-1a296e108069-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.788463 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.788441    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjv56\" (UniqueName: \"kubernetes.io/projected/42d4e790-3784-44bc-9050-1a296e108069-kube-api-access-wjv56\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:09.870939 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.870901    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-accelerators-collector-config\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.870948    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-wtmp\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871012    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e91fb231-2326-404b-92f1-b36a65d4f665-sys\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871035    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871063    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-tls\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871110    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xplz\" (UniqueName: \"kubernetes.io/projected/e91fb231-2326-404b-92f1-b36a65d4f665-kube-api-access-9xplz\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871108    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e91fb231-2326-404b-92f1-b36a65d4f665-sys\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871441 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871168    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-wtmp\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871441 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871201    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e91fb231-2326-404b-92f1-b36a65d4f665-root\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871441 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871231    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e91fb231-2326-404b-92f1-b36a65d4f665-metrics-client-ca\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871441 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871267    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-textfile\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871441 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871300    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e91fb231-2326-404b-92f1-b36a65d4f665-root\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871675 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871567    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-textfile\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871675 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871637    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-accelerators-collector-config\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.871775 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.871741    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e91fb231-2326-404b-92f1-b36a65d4f665-metrics-client-ca\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.873513 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.873478    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.873647 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.873613    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e91fb231-2326-404b-92f1-b36a65d4f665-node-exporter-tls\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.914744 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.914718    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xplz\" (UniqueName: \"kubernetes.io/projected/e91fb231-2326-404b-92f1-b36a65d4f665-kube-api-access-9xplz\") pod \"node-exporter-txhwc\" (UID: \"e91fb231-2326-404b-92f1-b36a65d4f665\") " pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.943913 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:09.943883    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-txhwc"
Sep 17 17:37:09.958249 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:37:09.958211    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91fb231_2326_404b_92f1_b36a65d4f665.slice/crio-7ee8594be3b990d02fecce64345e7f3869bad4b79f9e8f475e44a01f67b396c9 WatchSource:0}: Error finding container 7ee8594be3b990d02fecce64345e7f3869bad4b79f9e8f475e44a01f67b396c9: Status 404 returned error can't find the container with id 7ee8594be3b990d02fecce64345e7f3869bad4b79f9e8f475e44a01f67b396c9
Sep 17 17:37:10.275032 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.275003    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42d4e790-3784-44bc-9050-1a296e108069-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:10.277348 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.277319    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/42d4e790-3784-44bc-9050-1a296e108069-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4m7q9\" (UID: \"42d4e790-3784-44bc-9050-1a296e108069\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:10.485780 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.485742    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txhwc" event={"ID":"e91fb231-2326-404b-92f1-b36a65d4f665","Type":"ContainerStarted","Data":"7ee8594be3b990d02fecce64345e7f3869bad4b79f9e8f475e44a01f67b396c9"}
Sep 17 17:37:10.517027 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.516996    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"
Sep 17 17:37:10.817981 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.817925    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9"]
Sep 17 17:37:10.836417 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.836381    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 17:37:10.841661 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.841637    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.846649 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.846622    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 17:37:10.846816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.846797    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 17:37:10.846915 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.846829    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 17:37:10.847791 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.847700    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 17:37:10.848378 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.848362    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 17:37:10.849545 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.849433    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 17:37:10.849545 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.849499    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rknm7\""
Sep 17 17:37:10.849938 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.849918    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 17:37:10.851490 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.851425    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 17:37:10.854378 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.854356    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 17:37:10.871287 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.871262    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 17:37:10.891300 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:37:10.891267    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d4e790_3784_44bc_9050_1a296e108069.slice/crio-e9c37d08ef66d7a8e40b28f950fe7594d70e0cee67db40bd20f1814b9b3e7aab WatchSource:0}: Error finding container e9c37d08ef66d7a8e40b28f950fe7594d70e0cee67db40bd20f1814b9b3e7aab: Status 404 returned error can't find the container with id e9c37d08ef66d7a8e40b28f950fe7594d70e0cee67db40bd20f1814b9b3e7aab
Sep 17 17:37:10.980918 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.980888    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-web-config\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981060 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.980931    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981060 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981013    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981060 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981052    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13d22495-ca29-44ff-b512-f966a68f04a8-config-out\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981223 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981075    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981223 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981101    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13d22495-ca29-44ff-b512-f966a68f04a8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981223 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981136    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn6fb\" (UniqueName: \"kubernetes.io/projected/13d22495-ca29-44ff-b512-f966a68f04a8-kube-api-access-dn6fb\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981223 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981154    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981223 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981178    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13d22495-ca29-44ff-b512-f966a68f04a8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981223 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981194    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981510 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981242    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-config-volume\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981510 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981276    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13d22495-ca29-44ff-b512-f966a68f04a8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:10.981510 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:10.981310    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/13d22495-ca29-44ff-b512-f966a68f04a8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.082639 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.082545    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13d22495-ca29-44ff-b512-f966a68f04a8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.082639 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.082581    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.082639 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.082599    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-config-volume\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.082639 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.082628    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13d22495-ca29-44ff-b512-f966a68f04a8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.082943 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.082712    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/13d22495-ca29-44ff-b512-f966a68f04a8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.082943 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.082773    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-web-config\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.082943 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.082818    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.082943 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.082861    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.082943 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.082889    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13d22495-ca29-44ff-b512-f966a68f04a8-config-out\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.083329 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.083301    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/13d22495-ca29-44ff-b512-f966a68f04a8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.083442 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.083422    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13d22495-ca29-44ff-b512-f966a68f04a8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.083612 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.083584    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.083728 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.083640    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13d22495-ca29-44ff-b512-f966a68f04a8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.083728 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.083679    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn6fb\" (UniqueName: \"kubernetes.io/projected/13d22495-ca29-44ff-b512-f966a68f04a8-kube-api-access-dn6fb\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.083728 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.083714    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.084994 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.084967    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13d22495-ca29-44ff-b512-f966a68f04a8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.086353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.085771    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-web-config\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.086353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.085805    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.086353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.085946    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-config-volume\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.086353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.086170    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.086353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.086208    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.086659 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.086590    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.087578 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.087558    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13d22495-ca29-44ff-b512-f966a68f04a8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.087716 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.087700    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13d22495-ca29-44ff-b512-f966a68f04a8-config-out\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.087804 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.087783    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/13d22495-ca29-44ff-b512-f966a68f04a8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.099567 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.099545    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn6fb\" (UniqueName: \"kubernetes.io/projected/13d22495-ca29-44ff-b512-f966a68f04a8-kube-api-access-dn6fb\") pod \"alertmanager-main-0\" (UID: \"13d22495-ca29-44ff-b512-f966a68f04a8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.153148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.153118    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 17:37:11.458354 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.458313    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 17:37:11.461478 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:37:11.461455    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d22495_ca29_44ff_b512_f966a68f04a8.slice/crio-a3d841263912aa4a7a3a4f375093293f8fd984518fb6cd78fd3d1093fef85073 WatchSource:0}: Error finding container a3d841263912aa4a7a3a4f375093293f8fd984518fb6cd78fd3d1093fef85073: Status 404 returned error can't find the container with id a3d841263912aa4a7a3a4f375093293f8fd984518fb6cd78fd3d1093fef85073
Sep 17 17:37:11.491162 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.491124    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13d22495-ca29-44ff-b512-f966a68f04a8","Type":"ContainerStarted","Data":"a3d841263912aa4a7a3a4f375093293f8fd984518fb6cd78fd3d1093fef85073"}
Sep 17 17:37:11.493238 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.493205    2586 generic.go:356] "Generic (PLEG): container finished" podID="e91fb231-2326-404b-92f1-b36a65d4f665" containerID="710a15ec1aa160a8ed859725de8713e24f086ce803b3b254676d430f6eca22b4" exitCode=0
Sep 17 17:37:11.493361 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.493306    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txhwc" event={"ID":"e91fb231-2326-404b-92f1-b36a65d4f665","Type":"ContainerDied","Data":"710a15ec1aa160a8ed859725de8713e24f086ce803b3b254676d430f6eca22b4"}
Sep 17 17:37:11.495855 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.495826    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9" event={"ID":"42d4e790-3784-44bc-9050-1a296e108069","Type":"ContainerStarted","Data":"919d3e4350ef0fbf856eb0f202251332d454a7f2964518d9f0a717d92f575bf0"}
Sep 17 17:37:11.495981 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.495882    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9" event={"ID":"42d4e790-3784-44bc-9050-1a296e108069","Type":"ContainerStarted","Data":"7ad87c2be38da948330ddd3cd7d47484c03180cfcc54acfbd78d6073c7d08deb"}
Sep 17 17:37:11.495981 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:11.495914    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9" event={"ID":"42d4e790-3784-44bc-9050-1a296e108069","Type":"ContainerStarted","Data":"e9c37d08ef66d7a8e40b28f950fe7594d70e0cee67db40bd20f1814b9b3e7aab"}
Sep 17 17:37:12.503419 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.503381    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9" event={"ID":"42d4e790-3784-44bc-9050-1a296e108069","Type":"ContainerStarted","Data":"9afbc18214f81b563d48f739d9571a1e36c1c199d95bd0573983499a1c76ab2a"}
Sep 17 17:37:12.505370 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.505326    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txhwc" event={"ID":"e91fb231-2326-404b-92f1-b36a65d4f665","Type":"ContainerStarted","Data":"2e57ce87f8ac8ec55f9752d98e2f6ee67dfa68f6e5f179e542bc871bce0eae4d"}
Sep 17 17:37:12.505497 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.505393    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-txhwc" event={"ID":"e91fb231-2326-404b-92f1-b36a65d4f665","Type":"ContainerStarted","Data":"b53fef16f6f04de85ed08e05571cd9b0edb994b2f357d756393585db71c0f55f"}
Sep 17 17:37:12.525537 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.525484    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4m7q9" podStartSLOduration=2.63657121 podStartE2EDuration="3.525468399s" totalImagesPullingTime="888.897189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:12.524196172 +0000 UTC m=+193.851629275" watchObservedRunningTime="2026-09-17 17:37:12.525468399 +0000 UTC m=+193.852901503"
Sep 17 17:37:12.546641 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.546548    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-txhwc" podStartSLOduration=2.502194609 podStartE2EDuration="3.546527278s" totalImagesPullingTime="978.692256ms" totalInitContainerRuntime="65.640413ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:12.546228425 +0000 UTC m=+193.873661530" watchObservedRunningTime="2026-09-17 17:37:12.546527278 +0000 UTC m=+193.873960382"
Sep 17 17:37:12.639502 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.639457    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl" podUID="1315d0ff-e41f-4a59-8942-8f17e7e40fb0" containerName="registry" containerID="cri-o://5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697" gracePeriod=30
Sep 17 17:37:12.829324 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.829296    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"]
Sep 17 17:37:12.835276 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.835252    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:12.838239 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.838081    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eh0ufv765blq\""
Sep 17 17:37:12.838239 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.838139    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 17 17:37:12.839219 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.838772    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 17 17:37:12.839219 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.838790    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 17 17:37:12.839219 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.839064    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 17 17:37:12.839219 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.839078    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wf2mf\""
Sep 17 17:37:12.839451 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.839288    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 17 17:37:12.850204 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.850176    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"]
Sep 17 17:37:12.899790 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.899761    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-metrics-client-ca\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:12.899911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.899808    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-grpc-tls\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:12.899911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.899839    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-tls\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:12.900081 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.899926    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:12.900081 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.900049    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:12.900081 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.900074    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:12.900231 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.900103    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:12.900231 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.900140    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cs7w\" (UniqueName: \"kubernetes.io/projected/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-kube-api-access-6cs7w\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:12.932502 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:12.932477    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:37:13.001464 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001428    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jspgx\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-kube-api-access-jspgx\") pod \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") "
Sep 17 17:37:13.001464 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001470    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-bound-sa-token\") pod \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") "
Sep 17 17:37:13.001641 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001505    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-installation-pull-secrets\") pod \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") "
Sep 17 17:37:13.001641 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001620    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-trusted-ca\") pod \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") "
Sep 17 17:37:13.001730 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001660    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-certificates\") pod \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") "
Sep 17 17:37:13.001730 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001693    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-ca-trust-extracted\") pod \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") "
Sep 17 17:37:13.001730 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001728    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") pod \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") "
Sep 17 17:37:13.001879 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001759    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-image-registry-private-configuration\") pod \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\" (UID: \"1315d0ff-e41f-4a59-8942-8f17e7e40fb0\") "
Sep 17 17:37:13.001933 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001920    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-metrics-client-ca\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.002027 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.001971    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-grpc-tls\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.002027 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002012    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-tls\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.002128 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002021    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1315d0ff-e41f-4a59-8942-8f17e7e40fb0" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:37:13.002128 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002063    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1315d0ff-e41f-4a59-8942-8f17e7e40fb0" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:37:13.002222 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002132    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.002280 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002218    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.002280 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002247    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.002381 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002276    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.002381 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002304    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cs7w\" (UniqueName: \"kubernetes.io/projected/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-kube-api-access-6cs7w\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.002474 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002380    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-trusted-ca\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:37:13.002563 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002543    2586 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-certificates\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:37:13.002934 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.002788    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-metrics-client-ca\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.005156 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.005027    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1315d0ff-e41f-4a59-8942-8f17e7e40fb0" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:37:13.005295 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.005116    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1315d0ff-e41f-4a59-8942-8f17e7e40fb0" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:37:13.005633 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.005592    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1315d0ff-e41f-4a59-8942-8f17e7e40fb0" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:37:13.006001 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.005980    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.006373 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.006313    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1315d0ff-e41f-4a59-8942-8f17e7e40fb0" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:37:13.006373 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.006329    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-kube-api-access-jspgx" (OuterVolumeSpecName: "kube-api-access-jspgx") pod "1315d0ff-e41f-4a59-8942-8f17e7e40fb0" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0"). InnerVolumeSpecName "kube-api-access-jspgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:37:13.006537 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.006498    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.006965 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.006916    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.006965 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.006932    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-tls\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.007585 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.007565    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-grpc-tls\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.008024 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.008007    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.011587 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.011564    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1315d0ff-e41f-4a59-8942-8f17e7e40fb0" (UID: "1315d0ff-e41f-4a59-8942-8f17e7e40fb0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:37:13.012094 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.012079    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cs7w\" (UniqueName: \"kubernetes.io/projected/f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0-kube-api-access-6cs7w\") pod \"thanos-querier-c4bd45d6d-xs8m6\" (UID: \"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0\") " pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.103374 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.103301    2586 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-bound-sa-token\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:37:13.103374 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.103326    2586 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-installation-pull-secrets\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:37:13.103374 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.103334    2586 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-ca-trust-extracted\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:37:13.103374 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.103344    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-registry-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:37:13.103374 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.103353    2586 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-image-registry-private-configuration\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:37:13.103374 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.103361    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jspgx\" (UniqueName: \"kubernetes.io/projected/1315d0ff-e41f-4a59-8942-8f17e7e40fb0-kube-api-access-jspgx\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:37:13.158728 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.158698    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:13.440395 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.440367    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"]
Sep 17 17:37:13.442699 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:37:13.442671    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47ec31f_dd0f_4bf7_bbd9_7b3c47c043b0.slice/crio-b719baede6e457f6060777274a1be75a7fa69fb719ce118b0c54e43b712b9f85 WatchSource:0}: Error finding container b719baede6e457f6060777274a1be75a7fa69fb719ce118b0c54e43b712b9f85: Status 404 returned error can't find the container with id b719baede6e457f6060777274a1be75a7fa69fb719ce118b0c54e43b712b9f85
Sep 17 17:37:13.509871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.509832    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6" event={"ID":"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0","Type":"ContainerStarted","Data":"b719baede6e457f6060777274a1be75a7fa69fb719ce118b0c54e43b712b9f85"}
Sep 17 17:37:13.511158 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.511137    2586 generic.go:356] "Generic (PLEG): container finished" podID="1315d0ff-e41f-4a59-8942-8f17e7e40fb0" containerID="5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697" exitCode=0
Sep 17 17:37:13.511258 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.511184    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl"
Sep 17 17:37:13.511258 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.511226    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl" event={"ID":"1315d0ff-e41f-4a59-8942-8f17e7e40fb0","Type":"ContainerDied","Data":"5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697"}
Sep 17 17:37:13.511354 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.511280    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bfd788fb-xgjzl" event={"ID":"1315d0ff-e41f-4a59-8942-8f17e7e40fb0","Type":"ContainerDied","Data":"04f215f17ccd7bb16c0ce2bdbb3cadadab0d133ffc5efe1e850fa8ab994cc9d5"}
Sep 17 17:37:13.511354 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.511311    2586 scope.go:117] "RemoveContainer" containerID="5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697"
Sep 17 17:37:13.512684 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.512667    2586 generic.go:356] "Generic (PLEG): container finished" podID="13d22495-ca29-44ff-b512-f966a68f04a8" containerID="9742d465d1d66f0f5f60d7437f37697dadc8dc4bc99f3374c93b23210aff0560" exitCode=0
Sep 17 17:37:13.512785 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.512764    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13d22495-ca29-44ff-b512-f966a68f04a8","Type":"ContainerDied","Data":"9742d465d1d66f0f5f60d7437f37697dadc8dc4bc99f3374c93b23210aff0560"}
Sep 17 17:37:13.520452 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.520431    2586 scope.go:117] "RemoveContainer" containerID="5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697"
Sep 17 17:37:13.520858 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:37:13.520830    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697\": container with ID starting with 5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697 not found: ID does not exist" containerID="5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697"
Sep 17 17:37:13.520932 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.520872    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697"} err="failed to get container status \"5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697\": rpc error: code = NotFound desc = could not find container \"5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697\": container with ID starting with 5bee6a142f497fda4877e88f258dd7533d41635a0fb4e994cdcfc5896d6e3697 not found: ID does not exist"
Sep 17 17:37:13.548687 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.548660    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67bfd788fb-xgjzl"]
Sep 17 17:37:13.560651 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:13.560629    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67bfd788fb-xgjzl"]
Sep 17 17:37:14.088469 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.088433    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-84dd99b89-v2fmq"]
Sep 17 17:37:14.088914 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.088889    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1315d0ff-e41f-4a59-8942-8f17e7e40fb0" containerName="registry"
Sep 17 17:37:14.088914 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.088911    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="1315d0ff-e41f-4a59-8942-8f17e7e40fb0" containerName="registry"
Sep 17 17:37:14.089106 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.088987    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="1315d0ff-e41f-4a59-8942-8f17e7e40fb0" containerName="registry"
Sep 17 17:37:14.091226 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.091204    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.094835 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.094806    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 17 17:37:14.096576 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.095981    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ngb4s\""
Sep 17 17:37:14.096576 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.096225    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-881ls689mrfva\""
Sep 17 17:37:14.096576 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.096446    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 17 17:37:14.096576 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.096466    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 17:37:14.096884 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.096677    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 17 17:37:14.108212 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.108178    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84dd99b89-v2fmq"]
Sep 17 17:37:14.213654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.213564    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-secret-metrics-server-client-certs\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.213654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.213642    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-metrics-server-audit-profiles\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.213867 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.213671    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-audit-log\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.213867 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.213697    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.213867 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.213745    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-secret-metrics-server-tls\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.214008 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.213876    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-client-ca-bundle\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.214008 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.213927    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nt7t\" (UniqueName: \"kubernetes.io/projected/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-kube-api-access-8nt7t\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.315207 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.315044    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-client-ca-bundle\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.315483 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.315250    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nt7t\" (UniqueName: \"kubernetes.io/projected/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-kube-api-access-8nt7t\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.315483 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.315298    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-secret-metrics-server-client-certs\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.315483 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.315369    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-metrics-server-audit-profiles\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.315483 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.315406    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-audit-log\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.315483 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.315435    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.315483 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.315459    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-secret-metrics-server-tls\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.316280 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.316252    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-audit-log\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.316757 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.316676    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-metrics-server-audit-profiles\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.316860 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.316789    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.319275 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.319225    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-client-ca-bundle\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.319524 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.319501    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-secret-metrics-server-client-certs\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.319609 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.319588    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-secret-metrics-server-tls\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.344684 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.343805    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nt7t\" (UniqueName: \"kubernetes.io/projected/202acb0f-fac8-4034-bd20-bd6fe8e5a4b2-kube-api-access-8nt7t\") pod \"metrics-server-84dd99b89-v2fmq\" (UID: \"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2\") " pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.402828 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.402790    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:14.417522 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.417217    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789dcd84bd-fqcv9"]
Sep 17 17:37:14.419882 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.419820    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.422497 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.422344    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 17:37:14.422676 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.422658    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 17:37:14.423642 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.423499    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 17:37:14.423934 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.423858    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 17:37:14.423934 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.423875    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 17:37:14.424092 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.424073    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 17:37:14.424382 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.424364    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 17:37:14.424814 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.424604    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xdhkz\""
Sep 17 17:37:14.432520 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.432502    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 17:37:14.435842 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.435821    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"]
Sep 17 17:37:14.438721 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.438704    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:14.441645 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.441569    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-t78k7\""
Sep 17 17:37:14.441755 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.441693    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 17 17:37:14.448909 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.448881    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789dcd84bd-fqcv9"]
Sep 17 17:37:14.496146 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.496098    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"]
Sep 17 17:37:14.517192 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.517160    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-trusted-ca-bundle\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.517782 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.517702    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-serving-cert\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.518066 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.517940    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-console-config\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.518260 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.518202    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-oauth-config\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.518411 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.518234    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-service-ca\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.518999 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.518880    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-oauth-serving-cert\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.519403 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.519118    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbbe41d7-7f3b-417e-8d3d-4d091f5b2998-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-kw76k\" (UID: \"fbbe41d7-7f3b-417e-8d3d-4d091f5b2998\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:14.519403 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.519175    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfz8z\" (UniqueName: \"kubernetes.io/projected/968820a1-8300-40fe-aa84-6e45480d01a8-kube-api-access-rfz8z\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.519403 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.519202    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68cz9\" (UniqueName: \"kubernetes.io/projected/fbbe41d7-7f3b-417e-8d3d-4d091f5b2998-kube-api-access-68cz9\") pod \"monitoring-plugin-5984459ff8-kw76k\" (UID: \"fbbe41d7-7f3b-417e-8d3d-4d091f5b2998\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:14.620474 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.620387    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-oauth-config\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.620474 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.620433    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-service-ca\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.620474 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.620464    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-oauth-serving-cert\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.620751 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.620490    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbbe41d7-7f3b-417e-8d3d-4d091f5b2998-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-kw76k\" (UID: \"fbbe41d7-7f3b-417e-8d3d-4d091f5b2998\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:14.620751 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.620535    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfz8z\" (UniqueName: \"kubernetes.io/projected/968820a1-8300-40fe-aa84-6e45480d01a8-kube-api-access-rfz8z\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.620751 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.620562    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68cz9\" (UniqueName: \"kubernetes.io/projected/fbbe41d7-7f3b-417e-8d3d-4d091f5b2998-kube-api-access-68cz9\") pod \"monitoring-plugin-5984459ff8-kw76k\" (UID: \"fbbe41d7-7f3b-417e-8d3d-4d091f5b2998\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:14.620751 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.620598    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-trusted-ca-bundle\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.620751 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.620625    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-serving-cert\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.620751 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.620696    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-console-config\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.621786 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:37:14.621233    2586 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 17 17:37:14.621786 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:37:14.621307    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbbe41d7-7f3b-417e-8d3d-4d091f5b2998-monitoring-plugin-cert podName:fbbe41d7-7f3b-417e-8d3d-4d091f5b2998 nodeName:}" failed. No retries permitted until 2026-09-17 17:37:15.121285831 +0000 UTC m=+196.448719131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fbbe41d7-7f3b-417e-8d3d-4d091f5b2998-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-kw76k" (UID: "fbbe41d7-7f3b-417e-8d3d-4d091f5b2998") : secret "monitoring-plugin-cert" not found
Sep 17 17:37:14.621786 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.621460    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-console-config\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.621786 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.621740    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-oauth-serving-cert\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.622098 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.621901    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-service-ca\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.622278 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.622252    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-trusted-ca-bundle\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.624255 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.624211    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-oauth-config\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.624854 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.624834    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-serving-cert\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.633149 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.633125    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68cz9\" (UniqueName: \"kubernetes.io/projected/fbbe41d7-7f3b-417e-8d3d-4d091f5b2998-kube-api-access-68cz9\") pod \"monitoring-plugin-5984459ff8-kw76k\" (UID: \"fbbe41d7-7f3b-417e-8d3d-4d091f5b2998\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:14.633778 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.633757    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfz8z\" (UniqueName: \"kubernetes.io/projected/968820a1-8300-40fe-aa84-6e45480d01a8-kube-api-access-rfz8z\") pod \"console-789dcd84bd-fqcv9\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") " pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.714108 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.714078    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84dd99b89-v2fmq"]
Sep 17 17:37:14.737459 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.737388    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:14.819455 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:14.819419    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1315d0ff-e41f-4a59-8942-8f17e7e40fb0" path="/var/lib/kubelet/pods/1315d0ff-e41f-4a59-8942-8f17e7e40fb0/volumes"
Sep 17 17:37:14.894865 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:37:14.894826    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202acb0f_fac8_4034_bd20_bd6fe8e5a4b2.slice/crio-4ad5f54487f371ffc8b5c54e9031bf2478f62a7118c135b0ef123be20444fc56 WatchSource:0}: Error finding container 4ad5f54487f371ffc8b5c54e9031bf2478f62a7118c135b0ef123be20444fc56: Status 404 returned error can't find the container with id 4ad5f54487f371ffc8b5c54e9031bf2478f62a7118c135b0ef123be20444fc56
Sep 17 17:37:15.125336 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:15.125301    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbbe41d7-7f3b-417e-8d3d-4d091f5b2998-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-kw76k\" (UID: \"fbbe41d7-7f3b-417e-8d3d-4d091f5b2998\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:15.128150 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:15.128125    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbbe41d7-7f3b-417e-8d3d-4d091f5b2998-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-kw76k\" (UID: \"fbbe41d7-7f3b-417e-8d3d-4d091f5b2998\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:15.357179 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:15.357141    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:15.529441 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:15.529412    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq" event={"ID":"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2","Type":"ContainerStarted","Data":"4ad5f54487f371ffc8b5c54e9031bf2478f62a7118c135b0ef123be20444fc56"}
Sep 17 17:37:15.738131 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:15.738088    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"]
Sep 17 17:37:15.742459 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:15.742395    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789dcd84bd-fqcv9"]
Sep 17 17:37:15.742768 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:37:15.742739    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbe41d7_7f3b_417e_8d3d_4d091f5b2998.slice/crio-06b4d01a0e863d8c8a0674ced1f669e3dbf9d60712647f9fdacdfb6a265d4d50 WatchSource:0}: Error finding container 06b4d01a0e863d8c8a0674ced1f669e3dbf9d60712647f9fdacdfb6a265d4d50: Status 404 returned error can't find the container with id 06b4d01a0e863d8c8a0674ced1f669e3dbf9d60712647f9fdacdfb6a265d4d50
Sep 17 17:37:15.748522 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:37:15.748486    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968820a1_8300_40fe_aa84_6e45480d01a8.slice/crio-30f1c8d7b0c884b0d79c2d452cfb7a5bfffaea252fd5231cd93c25fc5af9043a WatchSource:0}: Error finding container 30f1c8d7b0c884b0d79c2d452cfb7a5bfffaea252fd5231cd93c25fc5af9043a: Status 404 returned error can't find the container with id 30f1c8d7b0c884b0d79c2d452cfb7a5bfffaea252fd5231cd93c25fc5af9043a
Sep 17 17:37:16.540712 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.540680    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13d22495-ca29-44ff-b512-f966a68f04a8","Type":"ContainerStarted","Data":"0fa48abce24d74db6f3257094a67001d494aa447e0f1d499fea17640ad96f135"}
Sep 17 17:37:16.541214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.540763    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13d22495-ca29-44ff-b512-f966a68f04a8","Type":"ContainerStarted","Data":"5fd6cd57df6d45c321d657076503e02c4f29eaa784df8ca732097734e9c53b50"}
Sep 17 17:37:16.541214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.540807    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13d22495-ca29-44ff-b512-f966a68f04a8","Type":"ContainerStarted","Data":"890f11486e403c6ca7d894e464abb2496f4895a26d3df79375276b353efb3fde"}
Sep 17 17:37:16.541214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.540848    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13d22495-ca29-44ff-b512-f966a68f04a8","Type":"ContainerStarted","Data":"518acd2072e60dd612687d9a0bad04c2868f08eacb9d4e35ec0bc26d1a14cced"}
Sep 17 17:37:16.541214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.540889    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13d22495-ca29-44ff-b512-f966a68f04a8","Type":"ContainerStarted","Data":"ecafe759927f42f5d9c6823addca81145070309919a613154368a0c5e6b2c3e0"}
Sep 17 17:37:16.543018 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.542991    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6" event={"ID":"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0","Type":"ContainerStarted","Data":"b4db3ddcf9aa8a0136c1e16dd0139d6ad002261186abd18d4faf1d4a57855744"}
Sep 17 17:37:16.543165 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.543066    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6" event={"ID":"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0","Type":"ContainerStarted","Data":"920d9d02764c58cf4634a1acccf1b8b07a4151e811a39e31f10c7622dbd8d6d7"}
Sep 17 17:37:16.543165 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.543105    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6" event={"ID":"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0","Type":"ContainerStarted","Data":"525c05857413de35bcf8ce7760995b1aab97056e78ebdca3bb9b66a441567f0c"}
Sep 17 17:37:16.544502 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.544471    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k" event={"ID":"fbbe41d7-7f3b-417e-8d3d-4d091f5b2998","Type":"ContainerStarted","Data":"06b4d01a0e863d8c8a0674ced1f669e3dbf9d60712647f9fdacdfb6a265d4d50"}
Sep 17 17:37:16.545964 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:16.545922    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dcd84bd-fqcv9" event={"ID":"968820a1-8300-40fe-aa84-6e45480d01a8","Type":"ContainerStarted","Data":"30f1c8d7b0c884b0d79c2d452cfb7a5bfffaea252fd5231cd93c25fc5af9043a"}
Sep 17 17:37:17.559467 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:17.559270    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6" event={"ID":"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0","Type":"ContainerStarted","Data":"b793f9dea8c423c4e268f9a470eba111875ef96890f7f9fa9989a0d6ad68a84e"}
Sep 17 17:37:17.559467 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:17.559361    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6" event={"ID":"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0","Type":"ContainerStarted","Data":"8960381f16b24a0d5941d9c28ad6f63c43a6192438b1bd2463c03b1c63643c39"}
Sep 17 17:37:17.559467 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:17.559405    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6" event={"ID":"f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0","Type":"ContainerStarted","Data":"486454896ede151295ba179d45496f734980243287ec4711ba320231296b42ea"}
Sep 17 17:37:17.560060 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:17.559696    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:17.564875 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:17.564847    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13d22495-ca29-44ff-b512-f966a68f04a8","Type":"ContainerStarted","Data":"bc14022adf41e5d4cb595a9c84e2ad17be6170481155bdd2c7f50d33a48fbcc9"}
Sep 17 17:37:17.568070 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:17.567994    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq" event={"ID":"202acb0f-fac8-4034-bd20-bd6fe8e5a4b2","Type":"ContainerStarted","Data":"0691913b1cab5a1ef17a83271fb02cf5e72c716fc7691337453ed1c51637741d"}
Sep 17 17:37:17.586746 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:17.586690    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6" podStartSLOduration=2.058618066 podStartE2EDuration="5.586669351s" totalImagesPullingTime="3.528051285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:17.585159466 +0000 UTC m=+198.912592571" watchObservedRunningTime="2026-09-17 17:37:17.586669351 +0000 UTC m=+198.914102455"
Sep 17 17:37:17.607695 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:17.607240    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq" podStartSLOduration=1.9551085750000001 podStartE2EDuration="3.607217347s" totalImagesPullingTime="1.652108772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:17.605552276 +0000 UTC m=+198.932985382" watchObservedRunningTime="2026-09-17 17:37:17.607217347 +0000 UTC m=+198.934650453"
Sep 17 17:37:17.633801 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:17.633743    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.882352556 podStartE2EDuration="7.633730799s" totalImagesPullingTime="4.737216124s" totalInitContainerRuntime="14.162119ms" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:17.632757386 +0000 UTC m=+198.960190490" watchObservedRunningTime="2026-09-17 17:37:17.633730799 +0000 UTC m=+198.961163902"
Sep 17 17:37:20.582983 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:20.582929    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k" event={"ID":"fbbe41d7-7f3b-417e-8d3d-4d091f5b2998","Type":"ContainerStarted","Data":"6269ab3e8c82a8691cc136177a16dfc46f1b2a5891d01ed6fa34d962f7e569f2"}
Sep 17 17:37:20.583450 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:20.583049    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:20.584839 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:20.584811    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dcd84bd-fqcv9" event={"ID":"968820a1-8300-40fe-aa84-6e45480d01a8","Type":"ContainerStarted","Data":"6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44"}
Sep 17 17:37:20.589511 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:20.589489    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k"
Sep 17 17:37:20.602326 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:20.602282    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-kw76k" podStartSLOduration=1.897401042 podStartE2EDuration="6.602266767s" totalImagesPullingTime="4.704865725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:20.601270182 +0000 UTC m=+201.928703308" watchObservedRunningTime="2026-09-17 17:37:20.602266767 +0000 UTC m=+201.929699871"
Sep 17 17:37:20.623447 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:20.623394    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789dcd84bd-fqcv9" podStartSLOduration=1.860915244 podStartE2EDuration="6.62337795s" totalImagesPullingTime="4.762462706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:37:20.621896888 +0000 UTC m=+201.949329993" watchObservedRunningTime="2026-09-17 17:37:20.62337795 +0000 UTC m=+201.950811053"
Sep 17 17:37:23.579355 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:23.579327    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c4bd45d6d-xs8m6"
Sep 17 17:37:24.737921 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:24.737889    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:24.738320 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:24.737939    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:24.742736 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:24.742713    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:25.610982 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:25.610944    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:37:34.403814 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:34.403775    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:34.404218 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:34.403847    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:47.410669 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:37:47.410634    2586 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf921a0f5_7305_48c6_a425_9ca3aa783087.slice/crio-conmon-39a561603568e1746403e065ee5840395ce436f899527e7b6ce4a2cea26b2548.scope\": RecentStats: unable to find data in memory cache]"
Sep 17 17:37:47.693811 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:47.693726    2586 generic.go:356] "Generic (PLEG): container finished" podID="f921a0f5-7305-48c6-a425-9ca3aa783087" containerID="39a561603568e1746403e065ee5840395ce436f899527e7b6ce4a2cea26b2548" exitCode=0
Sep 17 17:37:47.693980 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:47.693800    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh" event={"ID":"f921a0f5-7305-48c6-a425-9ca3aa783087","Type":"ContainerDied","Data":"39a561603568e1746403e065ee5840395ce436f899527e7b6ce4a2cea26b2548"}
Sep 17 17:37:47.694130 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:47.694117    2586 scope.go:117] "RemoveContainer" containerID="39a561603568e1746403e065ee5840395ce436f899527e7b6ce4a2cea26b2548"
Sep 17 17:37:48.700450 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:48.700416    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-vzdgh" event={"ID":"f921a0f5-7305-48c6-a425-9ca3aa783087","Type":"ContainerStarted","Data":"bbcab7c94e8108cdf5a4b348ec9c91082128bbce57f24ea358d395be5ad49b32"}
Sep 17 17:37:53.554098 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:53.554061    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5n874_5ceee1e7-8072-46f3-8122-49b19e223845/dns/0.log"
Sep 17 17:37:53.568663 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:53.568639    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5n874_5ceee1e7-8072-46f3-8122-49b19e223845/kube-rbac-proxy/0.log"
Sep 17 17:37:53.934436 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:53.934361    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g9ckj_333ce5a7-0e31-40c2-9929-b855616daf6a/dns-node-resolver/0.log"
Sep 17 17:37:54.408757 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:54.408724    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:37:54.412618 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:37:54.412599    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-84dd99b89-v2fmq"
Sep 17 17:38:12.530710 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:12.530618    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:38:12.533095 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:12.533071    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53437e34-2e7d-4e34-a8b6-6886e50a8463-metrics-certs\") pod \"network-metrics-daemon-d5rkr\" (UID: \"53437e34-2e7d-4e34-a8b6-6886e50a8463\") " pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:38:12.618697 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:12.618665    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-745tx\""
Sep 17 17:38:12.624063 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:12.624044    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5rkr"
Sep 17 17:38:12.906301 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:12.906136    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d5rkr"]
Sep 17 17:38:12.908879 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:38:12.908847    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53437e34_2e7d_4e34_a8b6_6886e50a8463.slice/crio-865923c4365c0ac98b8283c0c0de5eca6ff43b6b9564f3cc693e16a04b26ce46 WatchSource:0}: Error finding container 865923c4365c0ac98b8283c0c0de5eca6ff43b6b9564f3cc693e16a04b26ce46: Status 404 returned error can't find the container with id 865923c4365c0ac98b8283c0c0de5eca6ff43b6b9564f3cc693e16a04b26ce46
Sep 17 17:38:13.811121 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:13.811081    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5rkr" event={"ID":"53437e34-2e7d-4e34-a8b6-6886e50a8463","Type":"ContainerStarted","Data":"865923c4365c0ac98b8283c0c0de5eca6ff43b6b9564f3cc693e16a04b26ce46"}
Sep 17 17:38:14.818005 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:14.817970    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5rkr" event={"ID":"53437e34-2e7d-4e34-a8b6-6886e50a8463","Type":"ContainerStarted","Data":"25ce6401acf1fd848871c49164317f05f0ae1632311afe9b6a24166d44304c49"}
Sep 17 17:38:14.818372 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:14.818019    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5rkr" event={"ID":"53437e34-2e7d-4e34-a8b6-6886e50a8463","Type":"ContainerStarted","Data":"3acafe8a737ceb31572cc910d6465e0eb50f03fc9033d94127c481c1149e3787"}
Sep 17 17:38:14.838231 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:14.838179    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d5rkr" podStartSLOduration=253.904186881 podStartE2EDuration="4m14.838164036s" totalImagesPullingTime="933.977155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:14.836481822 +0000 UTC m=+256.163914925" watchObservedRunningTime="2026-09-17 17:38:14.838164036 +0000 UTC m=+256.165597140"
Sep 17 17:38:34.183472 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.183433    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f87595769-4fngg"]
Sep 17 17:38:34.186528 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.186510    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.190415 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.190391    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 17:38:34.190558 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.190385    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 17:38:34.190558 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.190458    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2z2tt\""
Sep 17 17:38:34.190558 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.190401    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 17:38:34.190558 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.190496    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 17:38:34.191404 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.191390    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 17:38:34.206697 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.206674    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 17:38:34.213561 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.213540    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f87595769-4fngg"]
Sep 17 17:38:34.294987 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.294938    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-telemeter-client-tls\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.294987 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.294986    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.295184 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.295008    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-serving-certs-ca-bundle\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.295184 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.295046    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-federate-client-tls\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.295184 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.295071    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlr7h\" (UniqueName: \"kubernetes.io/projected/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-kube-api-access-wlr7h\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.295184 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.295145    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-metrics-client-ca\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.295309 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.295194    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-secret-telemeter-client\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.295309 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.295235    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.396061 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.396025    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-secret-telemeter-client\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.396214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.396074    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.396214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.396114    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-telemeter-client-tls\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.396214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.396139    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.396214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.396168    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-serving-certs-ca-bundle\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.396214 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.396194    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-federate-client-tls\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.396503 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.396308    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlr7h\" (UniqueName: \"kubernetes.io/projected/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-kube-api-access-wlr7h\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.396503 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.396395    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-metrics-client-ca\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.397191 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.397128    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-serving-certs-ca-bundle\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.397191 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.397159    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.397379 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.397275    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-metrics-client-ca\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.398753 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.398723    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-federate-client-tls\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.398853 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.398750    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.399094 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.399076    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-telemeter-client-tls\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.399137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.399090    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-secret-telemeter-client\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.407889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.407870    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlr7h\" (UniqueName: \"kubernetes.io/projected/76496c3c-ecaa-4806-8c3a-f183e13ec9a8-kube-api-access-wlr7h\") pod \"telemeter-client-6f87595769-4fngg\" (UID: \"76496c3c-ecaa-4806-8c3a-f183e13ec9a8\") " pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.496082 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.495992    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f87595769-4fngg"
Sep 17 17:38:34.785540 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.785509    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f87595769-4fngg"]
Sep 17 17:38:34.789224 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:38:34.789198    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76496c3c_ecaa_4806_8c3a_f183e13ec9a8.slice/crio-09f47057ac858ca5088602dee7f95805bbfd147dae71afe9df1a21370eea8b22 WatchSource:0}: Error finding container 09f47057ac858ca5088602dee7f95805bbfd147dae71afe9df1a21370eea8b22: Status 404 returned error can't find the container with id 09f47057ac858ca5088602dee7f95805bbfd147dae71afe9df1a21370eea8b22
Sep 17 17:38:34.894269 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:34.894233    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f87595769-4fngg" event={"ID":"76496c3c-ecaa-4806-8c3a-f183e13ec9a8","Type":"ContainerStarted","Data":"09f47057ac858ca5088602dee7f95805bbfd147dae71afe9df1a21370eea8b22"}
Sep 17 17:38:36.904617 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:36.904581    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f87595769-4fngg" event={"ID":"76496c3c-ecaa-4806-8c3a-f183e13ec9a8","Type":"ContainerStarted","Data":"621ae6e161bab19d0811079cc42317b07403c0b14155f2220a45650619ed423b"}
Sep 17 17:38:36.904997 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:36.904634    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f87595769-4fngg" event={"ID":"76496c3c-ecaa-4806-8c3a-f183e13ec9a8","Type":"ContainerStarted","Data":"e24aff75671f5aa3d2a7b0961fee9928a9d7fd5eb76c3c8d5a924fb38de8a542"}
Sep 17 17:38:36.904997 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:36.904652    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f87595769-4fngg" event={"ID":"76496c3c-ecaa-4806-8c3a-f183e13ec9a8","Type":"ContainerStarted","Data":"aef0aaa2ffbc729274879b1ceac2800baf19d8021ce3d120fc6f86d49d07b3a1"}
Sep 17 17:38:36.934513 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:36.934462    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f87595769-4fngg" podStartSLOduration=1.421027957 podStartE2EDuration="2.934445932s" totalImagesPullingTime="1.513417975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:36.933062566 +0000 UTC m=+278.260495669" watchObservedRunningTime="2026-09-17 17:38:36.934445932 +0000 UTC m=+278.261879036"
Sep 17 17:38:37.039729 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.039697    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8479659d5-c994r"]
Sep 17 17:38:37.042692 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.042670    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.060529 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.060505    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8479659d5-c994r"]
Sep 17 17:38:37.121741 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.121696    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-oauth-config\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.121920 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.121757    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-service-ca\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.121920 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.121864    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-config\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.121920 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.121904    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-trusted-ca-bundle\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.122100 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.121987    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-oauth-serving-cert\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.122100 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.122015    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-serving-cert\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.122100 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.122041    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hjjh\" (UniqueName: \"kubernetes.io/projected/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-kube-api-access-2hjjh\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.222781 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.222694    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hjjh\" (UniqueName: \"kubernetes.io/projected/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-kube-api-access-2hjjh\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.222781 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.222751    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-oauth-config\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.222781 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.222772    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-service-ca\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.223116 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.222803    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-config\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.223116 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.222824    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-trusted-ca-bundle\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.223116 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.222901    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-oauth-serving-cert\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.223116 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.222938    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-serving-cert\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.223675 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.223650    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-service-ca\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.223771 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.223671    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-oauth-serving-cert\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.223771 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.223692    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-config\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.223771 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.223751    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-trusted-ca-bundle\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.225329 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.225308    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-oauth-config\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.225513 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.225495    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-serving-cert\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.232389 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.232366    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hjjh\" (UniqueName: \"kubernetes.io/projected/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-kube-api-access-2hjjh\") pod \"console-8479659d5-c994r\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") " pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.353154 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.353100    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:37.628866 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.628835    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8479659d5-c994r"]
Sep 17 17:38:37.631925 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:38:37.631895    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e9abd3_db2b_4d94_ba35_5bcc469e77a4.slice/crio-b44fe63b842a4cb7bf75f5c40e6b074cdb3725b08a94dfb0aa4cbfe0df74e849 WatchSource:0}: Error finding container b44fe63b842a4cb7bf75f5c40e6b074cdb3725b08a94dfb0aa4cbfe0df74e849: Status 404 returned error can't find the container with id b44fe63b842a4cb7bf75f5c40e6b074cdb3725b08a94dfb0aa4cbfe0df74e849
Sep 17 17:38:37.910063 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.909948    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8479659d5-c994r" event={"ID":"42e9abd3-db2b-4d94-ba35-5bcc469e77a4","Type":"ContainerStarted","Data":"f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e"}
Sep 17 17:38:37.910063 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.910047    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8479659d5-c994r" event={"ID":"42e9abd3-db2b-4d94-ba35-5bcc469e77a4","Type":"ContainerStarted","Data":"b44fe63b842a4cb7bf75f5c40e6b074cdb3725b08a94dfb0aa4cbfe0df74e849"}
Sep 17 17:38:37.932334 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:37.932282    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8479659d5-c994r" podStartSLOduration=0.932267427 podStartE2EDuration="932.267427ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:37.93055665 +0000 UTC m=+279.257989755" watchObservedRunningTime="2026-09-17 17:38:37.932267427 +0000 UTC m=+279.259700530"
Sep 17 17:38:47.354234 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:47.354186    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:47.354234 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:47.354251    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:47.358849 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:47.358826    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:47.957688 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:47.957655    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:38:48.015386 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.015357    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789dcd84bd-fqcv9"]
Sep 17 17:38:48.099994 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.099949    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77859d75dc-qk2x5"]
Sep 17 17:38:48.104654 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.104632    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.118630 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.118604    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77859d75dc-qk2x5"]
Sep 17 17:38:48.215201 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.215124    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-service-ca\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.215201 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.215157    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-config\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.215388 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.215212    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlgf\" (UniqueName: \"kubernetes.io/projected/e07dd76e-b5aa-4bd6-a165-47427b36799c-kube-api-access-lqlgf\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.215388 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.215232    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-oauth-serving-cert\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.215388 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.215269    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-serving-cert\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.215388 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.215319    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-trusted-ca-bundle\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.215388 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.215348    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-oauth-config\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.316213 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.316183    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-serving-cert\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.316401 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.316224    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-trusted-ca-bundle\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.316401 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.316253    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-oauth-config\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.316401 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.316303    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-service-ca\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.316401 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.316347    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-config\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.316601 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.316401    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlgf\" (UniqueName: \"kubernetes.io/projected/e07dd76e-b5aa-4bd6-a165-47427b36799c-kube-api-access-lqlgf\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.316601 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.316428    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-oauth-serving-cert\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.317137 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.317115    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-oauth-serving-cert\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.317229 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.317196    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-service-ca\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.317272 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.317196    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-config\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.317510 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.317490    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-trusted-ca-bundle\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.318667 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.318637    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-oauth-config\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.318843 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.318827    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-serving-cert\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.327560 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.327532    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlgf\" (UniqueName: \"kubernetes.io/projected/e07dd76e-b5aa-4bd6-a165-47427b36799c-kube-api-access-lqlgf\") pod \"console-77859d75dc-qk2x5\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") " pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.414485 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.414453    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:48.704871 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.704841    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77859d75dc-qk2x5"]
Sep 17 17:38:48.707790 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:38:48.707763    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07dd76e_b5aa_4bd6_a165_47427b36799c.slice/crio-3fdbcc90285f8376431a78dfbe9c2fa5c6d82e0cadf73349e5c6cdec375015cc WatchSource:0}: Error finding container 3fdbcc90285f8376431a78dfbe9c2fa5c6d82e0cadf73349e5c6cdec375015cc: Status 404 returned error can't find the container with id 3fdbcc90285f8376431a78dfbe9c2fa5c6d82e0cadf73349e5c6cdec375015cc
Sep 17 17:38:48.959535 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.959440    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77859d75dc-qk2x5" event={"ID":"e07dd76e-b5aa-4bd6-a165-47427b36799c","Type":"ContainerStarted","Data":"37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade"}
Sep 17 17:38:48.959535 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.959489    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77859d75dc-qk2x5" event={"ID":"e07dd76e-b5aa-4bd6-a165-47427b36799c","Type":"ContainerStarted","Data":"3fdbcc90285f8376431a78dfbe9c2fa5c6d82e0cadf73349e5c6cdec375015cc"}
Sep 17 17:38:48.987749 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:48.987702    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77859d75dc-qk2x5" podStartSLOduration=0.987685571 podStartE2EDuration="987.685571ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:38:48.985582486 +0000 UTC m=+290.313015592" watchObservedRunningTime="2026-09-17 17:38:48.987685571 +0000 UTC m=+290.315118675"
Sep 17 17:38:58.415439 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:58.415387    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:58.415835 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:58.415469    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:58.423779 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:58.423750    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:59.005727 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:59.005704    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:38:59.082494 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:38:59.082453    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8479659d5-c994r"]
Sep 17 17:39:00.679863 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:00.679836    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:39:00.686876 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:00.686855    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:39:00.690672 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:00.690652    2586 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 17:39:00.701293 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:00.701265    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:39:00.708776 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:00.708757    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:39:13.035139 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.035074    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-789dcd84bd-fqcv9" podUID="968820a1-8300-40fe-aa84-6e45480d01a8" containerName="console" containerID="cri-o://6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44" gracePeriod=15
Sep 17 17:39:13.282385 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.282358    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:39:13.445109 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445026    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-console-config\") pod \"968820a1-8300-40fe-aa84-6e45480d01a8\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") "
Sep 17 17:39:13.445109 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445074    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfz8z\" (UniqueName: \"kubernetes.io/projected/968820a1-8300-40fe-aa84-6e45480d01a8-kube-api-access-rfz8z\") pod \"968820a1-8300-40fe-aa84-6e45480d01a8\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") "
Sep 17 17:39:13.445345 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445118    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-trusted-ca-bundle\") pod \"968820a1-8300-40fe-aa84-6e45480d01a8\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") "
Sep 17 17:39:13.445345 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445152    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-service-ca\") pod \"968820a1-8300-40fe-aa84-6e45480d01a8\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") "
Sep 17 17:39:13.445345 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445188    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-oauth-serving-cert\") pod \"968820a1-8300-40fe-aa84-6e45480d01a8\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") "
Sep 17 17:39:13.445345 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445214    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-oauth-config\") pod \"968820a1-8300-40fe-aa84-6e45480d01a8\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") "
Sep 17 17:39:13.445345 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445265    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-serving-cert\") pod \"968820a1-8300-40fe-aa84-6e45480d01a8\" (UID: \"968820a1-8300-40fe-aa84-6e45480d01a8\") "
Sep 17 17:39:13.445684 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445649    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-console-config" (OuterVolumeSpecName: "console-config") pod "968820a1-8300-40fe-aa84-6e45480d01a8" (UID: "968820a1-8300-40fe-aa84-6e45480d01a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:13.445684 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445662    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "968820a1-8300-40fe-aa84-6e45480d01a8" (UID: "968820a1-8300-40fe-aa84-6e45480d01a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:13.445873 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445771    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "968820a1-8300-40fe-aa84-6e45480d01a8" (UID: "968820a1-8300-40fe-aa84-6e45480d01a8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:13.445873 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.445776    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "968820a1-8300-40fe-aa84-6e45480d01a8" (UID: "968820a1-8300-40fe-aa84-6e45480d01a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:13.447576 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.447544    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "968820a1-8300-40fe-aa84-6e45480d01a8" (UID: "968820a1-8300-40fe-aa84-6e45480d01a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:39:13.447673 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.447598    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968820a1-8300-40fe-aa84-6e45480d01a8-kube-api-access-rfz8z" (OuterVolumeSpecName: "kube-api-access-rfz8z") pod "968820a1-8300-40fe-aa84-6e45480d01a8" (UID: "968820a1-8300-40fe-aa84-6e45480d01a8"). InnerVolumeSpecName "kube-api-access-rfz8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:39:13.447673 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.447595    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "968820a1-8300-40fe-aa84-6e45480d01a8" (UID: "968820a1-8300-40fe-aa84-6e45480d01a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:39:13.546678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.546635    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-trusted-ca-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:13.546678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.546672    2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-service-ca\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:13.546678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.546683    2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-oauth-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:13.546678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.546692    2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-oauth-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:13.546930 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.546700    2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/968820a1-8300-40fe-aa84-6e45480d01a8-console-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:13.546930 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.546708    2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/968820a1-8300-40fe-aa84-6e45480d01a8-console-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:13.546930 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:13.546716    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfz8z\" (UniqueName: \"kubernetes.io/projected/968820a1-8300-40fe-aa84-6e45480d01a8-kube-api-access-rfz8z\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:14.073051 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.073015    2586 generic.go:356] "Generic (PLEG): container finished" podID="968820a1-8300-40fe-aa84-6e45480d01a8" containerID="6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44" exitCode=0
Sep 17 17:39:14.073434 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.073066    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dcd84bd-fqcv9"
Sep 17 17:39:14.073434 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.073107    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dcd84bd-fqcv9" event={"ID":"968820a1-8300-40fe-aa84-6e45480d01a8","Type":"ContainerDied","Data":"6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44"}
Sep 17 17:39:14.073434 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.073156    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dcd84bd-fqcv9" event={"ID":"968820a1-8300-40fe-aa84-6e45480d01a8","Type":"ContainerDied","Data":"30f1c8d7b0c884b0d79c2d452cfb7a5bfffaea252fd5231cd93c25fc5af9043a"}
Sep 17 17:39:14.073434 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.073179    2586 scope.go:117] "RemoveContainer" containerID="6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44"
Sep 17 17:39:14.081791 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.081774    2586 scope.go:117] "RemoveContainer" containerID="6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44"
Sep 17 17:39:14.082096 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:39:14.082081    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44\": container with ID starting with 6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44 not found: ID does not exist" containerID="6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44"
Sep 17 17:39:14.082145 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.082104    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44"} err="failed to get container status \"6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44\": rpc error: code = NotFound desc = could not find container \"6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44\": container with ID starting with 6e8bf017148165f3e7c12541b04fb9d2bbdbc63b047c25791273249edc37df44 not found: ID does not exist"
Sep 17 17:39:14.096363 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.096336    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789dcd84bd-fqcv9"]
Sep 17 17:39:14.100807 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.100784    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789dcd84bd-fqcv9"]
Sep 17 17:39:14.817352 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:14.817323    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="968820a1-8300-40fe-aa84-6e45480d01a8" path="/var/lib/kubelet/pods/968820a1-8300-40fe-aa84-6e45480d01a8/volumes"
Sep 17 17:39:24.102370 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.102302    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8479659d5-c994r" podUID="42e9abd3-db2b-4d94-ba35-5bcc469e77a4" containerName="console" containerID="cri-o://f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e" gracePeriod=15
Sep 17 17:39:24.340321 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.340297    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:39:24.440263 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440186    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hjjh\" (UniqueName: \"kubernetes.io/projected/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-kube-api-access-2hjjh\") pod \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") "
Sep 17 17:39:24.440263 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440217    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-trusted-ca-bundle\") pod \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") "
Sep 17 17:39:24.440263 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440256    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-oauth-serving-cert\") pod \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") "
Sep 17 17:39:24.440472 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440427    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-config\") pod \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") "
Sep 17 17:39:24.440508 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440469    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-oauth-config\") pod \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") "
Sep 17 17:39:24.440566 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440541    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-service-ca\") pod \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") "
Sep 17 17:39:24.440644 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440575    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-serving-cert\") pod \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\" (UID: \"42e9abd3-db2b-4d94-ba35-5bcc469e77a4\") "
Sep 17 17:39:24.440702 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440652    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42e9abd3-db2b-4d94-ba35-5bcc469e77a4" (UID: "42e9abd3-db2b-4d94-ba35-5bcc469e77a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:24.440757 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440701    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "42e9abd3-db2b-4d94-ba35-5bcc469e77a4" (UID: "42e9abd3-db2b-4d94-ba35-5bcc469e77a4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:24.440812 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440784    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-config" (OuterVolumeSpecName: "console-config") pod "42e9abd3-db2b-4d94-ba35-5bcc469e77a4" (UID: "42e9abd3-db2b-4d94-ba35-5bcc469e77a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:24.440898 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440881    2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:24.440987 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440898    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-trusted-ca-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:24.440987 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.440909    2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-oauth-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:24.441255 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.441231    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-service-ca" (OuterVolumeSpecName: "service-ca") pod "42e9abd3-db2b-4d94-ba35-5bcc469e77a4" (UID: "42e9abd3-db2b-4d94-ba35-5bcc469e77a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:39:24.442504 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.442464    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42e9abd3-db2b-4d94-ba35-5bcc469e77a4" (UID: "42e9abd3-db2b-4d94-ba35-5bcc469e77a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:39:24.442578 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.442525    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42e9abd3-db2b-4d94-ba35-5bcc469e77a4" (UID: "42e9abd3-db2b-4d94-ba35-5bcc469e77a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:39:24.442578 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.442542    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-kube-api-access-2hjjh" (OuterVolumeSpecName: "kube-api-access-2hjjh") pod "42e9abd3-db2b-4d94-ba35-5bcc469e77a4" (UID: "42e9abd3-db2b-4d94-ba35-5bcc469e77a4"). InnerVolumeSpecName "kube-api-access-2hjjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:39:24.542156 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.542124    2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-oauth-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:24.542156 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.542151    2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-service-ca\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:24.542156 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.542161    2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-console-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:24.542368 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:24.542170    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hjjh\" (UniqueName: \"kubernetes.io/projected/42e9abd3-db2b-4d94-ba35-5bcc469e77a4-kube-api-access-2hjjh\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:39:25.125929 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:25.125845    2586 generic.go:356] "Generic (PLEG): container finished" podID="42e9abd3-db2b-4d94-ba35-5bcc469e77a4" containerID="f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e" exitCode=0
Sep 17 17:39:25.125929 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:25.125896    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8479659d5-c994r"
Sep 17 17:39:25.125929 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:25.125911    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8479659d5-c994r" event={"ID":"42e9abd3-db2b-4d94-ba35-5bcc469e77a4","Type":"ContainerDied","Data":"f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e"}
Sep 17 17:39:25.126401 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:25.125989    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8479659d5-c994r" event={"ID":"42e9abd3-db2b-4d94-ba35-5bcc469e77a4","Type":"ContainerDied","Data":"b44fe63b842a4cb7bf75f5c40e6b074cdb3725b08a94dfb0aa4cbfe0df74e849"}
Sep 17 17:39:25.126401 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:25.126019    2586 scope.go:117] "RemoveContainer" containerID="f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e"
Sep 17 17:39:25.134338 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:25.134320    2586 scope.go:117] "RemoveContainer" containerID="f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e"
Sep 17 17:39:25.134595 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:39:25.134577    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e\": container with ID starting with f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e not found: ID does not exist" containerID="f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e"
Sep 17 17:39:25.134655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:25.134605    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e"} err="failed to get container status \"f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e\": rpc error: code = NotFound desc = could not find container \"f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e\": container with ID starting with f3640fc9c5590b50ac61d8a4de506b5dfbcbe48cca1b846de14b3282be53758e not found: ID does not exist"
Sep 17 17:39:25.146590 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:25.146566    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8479659d5-c994r"]
Sep 17 17:39:25.153527 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:25.153505    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8479659d5-c994r"]
Sep 17 17:39:26.817885 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:39:26.817854    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e9abd3-db2b-4d94-ba35-5bcc469e77a4" path="/var/lib/kubelet/pods/42e9abd3-db2b-4d94-ba35-5bcc469e77a4/volumes"
Sep 17 17:42:12.143898 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.143862    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f67467b9f-2m2qn"]
Sep 17 17:42:12.144406 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.144212    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e9abd3-db2b-4d94-ba35-5bcc469e77a4" containerName="console"
Sep 17 17:42:12.144406 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.144223    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e9abd3-db2b-4d94-ba35-5bcc469e77a4" containerName="console"
Sep 17 17:42:12.144406 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.144245    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968820a1-8300-40fe-aa84-6e45480d01a8" containerName="console"
Sep 17 17:42:12.144406 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.144250    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="968820a1-8300-40fe-aa84-6e45480d01a8" containerName="console"
Sep 17 17:42:12.144406 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.144295    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="968820a1-8300-40fe-aa84-6e45480d01a8" containerName="console"
Sep 17 17:42:12.144406 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.144305    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e9abd3-db2b-4d94-ba35-5bcc469e77a4" containerName="console"
Sep 17 17:42:12.147278 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.147260    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.169901 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.169869    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f67467b9f-2m2qn"]
Sep 17 17:42:12.248238 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.248203    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-console-config\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.248238 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.248239    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km8g8\" (UniqueName: \"kubernetes.io/projected/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-kube-api-access-km8g8\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.248459 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.248260    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-console-oauth-config\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.248459 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.248281    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-service-ca\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.248459 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.248369    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-trusted-ca-bundle\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.248459 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.248398    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-oauth-serving-cert\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.248459 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.248447    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-console-serving-cert\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.349494 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.349458    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-console-config\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.349494 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.349495    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km8g8\" (UniqueName: \"kubernetes.io/projected/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-kube-api-access-km8g8\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.349706 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.349515    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-console-oauth-config\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.349706 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.349632    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-service-ca\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.349706 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.349695    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-trusted-ca-bundle\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.349832 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.349811    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-oauth-serving-cert\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.349868 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.349860    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-console-serving-cert\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.350382 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.350350    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-service-ca\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.350522 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.350350    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-console-config\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.350584 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.350529    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-trusted-ca-bundle\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.350584 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.350534    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-oauth-serving-cert\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.352219 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.352202    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-console-oauth-config\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.352313 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.352296    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-console-serving-cert\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.360505 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.360476    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km8g8\" (UniqueName: \"kubernetes.io/projected/1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a-kube-api-access-km8g8\") pod \"console-f67467b9f-2m2qn\" (UID: \"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a\") " pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.456775 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.456694    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:12.743513 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.743423    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f67467b9f-2m2qn"]
Sep 17 17:42:12.746388 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:42:12.746357    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0cf574_b3e4_483a_8398_d9f7e7ca5d5a.slice/crio-464ba6b96263803a792c92b70d2618b662af1e24ea92d2992461e66d84c63be7 WatchSource:0}: Error finding container 464ba6b96263803a792c92b70d2618b662af1e24ea92d2992461e66d84c63be7: Status 404 returned error can't find the container with id 464ba6b96263803a792c92b70d2618b662af1e24ea92d2992461e66d84c63be7
Sep 17 17:42:12.830392 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.830355    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f67467b9f-2m2qn" event={"ID":"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a","Type":"ContainerStarted","Data":"69feadad5a5596eb335454dbbcbd85027cd88e60ca2643580739ef19e22c207b"}
Sep 17 17:42:12.830556 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.830414    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f67467b9f-2m2qn" event={"ID":"1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a","Type":"ContainerStarted","Data":"464ba6b96263803a792c92b70d2618b662af1e24ea92d2992461e66d84c63be7"}
Sep 17 17:42:12.864251 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:12.864192    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f67467b9f-2m2qn" podStartSLOduration=0.864173643 podStartE2EDuration="864.173643ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:42:12.863711699 +0000 UTC m=+494.191144803" watchObservedRunningTime="2026-09-17 17:42:12.864173643 +0000 UTC m=+494.191606747"
Sep 17 17:42:22.457757 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:22.457718    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:22.458176 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:22.457863    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:22.462983 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:22.462937    2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:22.876390 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:22.876363    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f67467b9f-2m2qn"
Sep 17 17:42:22.942251 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:22.942216    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77859d75dc-qk2x5"]
Sep 17 17:42:47.963678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:47.963582    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77859d75dc-qk2x5" podUID="e07dd76e-b5aa-4bd6-a165-47427b36799c" containerName="console" containerID="cri-o://37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade" gracePeriod=15
Sep 17 17:42:48.216595 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.216542    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:42:48.256022 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.255993    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-service-ca\") pod \"e07dd76e-b5aa-4bd6-a165-47427b36799c\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") "
Sep 17 17:42:48.256172 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256039    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-serving-cert\") pod \"e07dd76e-b5aa-4bd6-a165-47427b36799c\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") "
Sep 17 17:42:48.256172 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256068    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-trusted-ca-bundle\") pod \"e07dd76e-b5aa-4bd6-a165-47427b36799c\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") "
Sep 17 17:42:48.256172 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256120    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-config\") pod \"e07dd76e-b5aa-4bd6-a165-47427b36799c\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") "
Sep 17 17:42:48.256322 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256227    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-oauth-serving-cert\") pod \"e07dd76e-b5aa-4bd6-a165-47427b36799c\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") "
Sep 17 17:42:48.256322 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256256    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqlgf\" (UniqueName: \"kubernetes.io/projected/e07dd76e-b5aa-4bd6-a165-47427b36799c-kube-api-access-lqlgf\") pod \"e07dd76e-b5aa-4bd6-a165-47427b36799c\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") "
Sep 17 17:42:48.256322 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256285    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-oauth-config\") pod \"e07dd76e-b5aa-4bd6-a165-47427b36799c\" (UID: \"e07dd76e-b5aa-4bd6-a165-47427b36799c\") "
Sep 17 17:42:48.256483 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256380    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-service-ca" (OuterVolumeSpecName: "service-ca") pod "e07dd76e-b5aa-4bd6-a165-47427b36799c" (UID: "e07dd76e-b5aa-4bd6-a165-47427b36799c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:42:48.256605 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256538    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e07dd76e-b5aa-4bd6-a165-47427b36799c" (UID: "e07dd76e-b5aa-4bd6-a165-47427b36799c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:42:48.256605 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256547    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-config" (OuterVolumeSpecName: "console-config") pod "e07dd76e-b5aa-4bd6-a165-47427b36799c" (UID: "e07dd76e-b5aa-4bd6-a165-47427b36799c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:42:48.256605 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256557    2586 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-service-ca\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:42:48.256855 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.256600    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e07dd76e-b5aa-4bd6-a165-47427b36799c" (UID: "e07dd76e-b5aa-4bd6-a165-47427b36799c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:42:48.258402 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.258366    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e07dd76e-b5aa-4bd6-a165-47427b36799c" (UID: "e07dd76e-b5aa-4bd6-a165-47427b36799c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:42:48.258867 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.258838    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e07dd76e-b5aa-4bd6-a165-47427b36799c-kube-api-access-lqlgf" (OuterVolumeSpecName: "kube-api-access-lqlgf") pod "e07dd76e-b5aa-4bd6-a165-47427b36799c" (UID: "e07dd76e-b5aa-4bd6-a165-47427b36799c"). InnerVolumeSpecName "kube-api-access-lqlgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:42:48.258867 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.258846    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e07dd76e-b5aa-4bd6-a165-47427b36799c" (UID: "e07dd76e-b5aa-4bd6-a165-47427b36799c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:42:48.356910 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.356879    2586 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-oauth-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:42:48.356910 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.356904    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqlgf\" (UniqueName: \"kubernetes.io/projected/e07dd76e-b5aa-4bd6-a165-47427b36799c-kube-api-access-lqlgf\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:42:48.356910 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.356914    2586 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-oauth-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:42:48.357141 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.356923    2586 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-serving-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:42:48.357141 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.356932    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-trusted-ca-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:42:48.357141 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.356940    2586 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07dd76e-b5aa-4bd6-a165-47427b36799c-console-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:42:48.977180 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.977143    2586 generic.go:356] "Generic (PLEG): container finished" podID="e07dd76e-b5aa-4bd6-a165-47427b36799c" containerID="37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade" exitCode=0
Sep 17 17:42:48.977564 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.977192    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77859d75dc-qk2x5"
Sep 17 17:42:48.977564 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.977227    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77859d75dc-qk2x5" event={"ID":"e07dd76e-b5aa-4bd6-a165-47427b36799c","Type":"ContainerDied","Data":"37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade"}
Sep 17 17:42:48.977564 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.977274    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77859d75dc-qk2x5" event={"ID":"e07dd76e-b5aa-4bd6-a165-47427b36799c","Type":"ContainerDied","Data":"3fdbcc90285f8376431a78dfbe9c2fa5c6d82e0cadf73349e5c6cdec375015cc"}
Sep 17 17:42:48.977564 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.977299    2586 scope.go:117] "RemoveContainer" containerID="37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade"
Sep 17 17:42:48.985740 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.985723    2586 scope.go:117] "RemoveContainer" containerID="37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade"
Sep 17 17:42:48.986053 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:42:48.986028    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade\": container with ID starting with 37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade not found: ID does not exist" containerID="37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade"
Sep 17 17:42:48.986151 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.986063    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade"} err="failed to get container status \"37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade\": rpc error: code = NotFound desc = could not find container \"37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade\": container with ID starting with 37daa1a4212ea60185f482e75033af0aa9fc2dc042b15da859356c09b01a1ade not found: ID does not exist"
Sep 17 17:42:48.996082 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:48.996059    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77859d75dc-qk2x5"]
Sep 17 17:42:49.001133 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:49.001111    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77859d75dc-qk2x5"]
Sep 17 17:42:50.816710 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:42:50.816679    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e07dd76e-b5aa-4bd6-a165-47427b36799c" path="/var/lib/kubelet/pods/e07dd76e-b5aa-4bd6-a165-47427b36799c/volumes"
Sep 17 17:44:00.708545 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:00.708518    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:44:00.715904 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:00.715868    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:44:00.729210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:00.729184    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:44:00.735762 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:00.735741    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:44:24.483482 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.483448    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"]
Sep 17 17:44:24.487811 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.483772    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e07dd76e-b5aa-4bd6-a165-47427b36799c" containerName="console"
Sep 17 17:44:24.487811 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.483796    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07dd76e-b5aa-4bd6-a165-47427b36799c" containerName="console"
Sep 17 17:44:24.487811 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.483859    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="e07dd76e-b5aa-4bd6-a165-47427b36799c" containerName="console"
Sep 17 17:44:24.490307 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.490278    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.492789 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.492768    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 17:44:24.492789 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.492785    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w94v4\""
Sep 17 17:44:24.492941 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.492793    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 17:44:24.505343 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.505321    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"]
Sep 17 17:44:24.591400 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.591372    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.591585 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.591417    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.591585 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.591436    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl8rm\" (UniqueName: \"kubernetes.io/projected/d3b3c2fc-481c-45d9-9e33-381514af9d3e-kube-api-access-pl8rm\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.691851 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.691803    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.691851 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.691853    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl8rm\" (UniqueName: \"kubernetes.io/projected/d3b3c2fc-481c-45d9-9e33-381514af9d3e-kube-api-access-pl8rm\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.692082 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.691945    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.692224 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.692205    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.692258 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.692246    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.703604 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.703574    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl8rm\" (UniqueName: \"kubernetes.io/projected/d3b3c2fc-481c-45d9-9e33-381514af9d3e-kube-api-access-pl8rm\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:24.799597 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:24.799566    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:25.073737 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:25.073713    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"]
Sep 17 17:44:25.076213 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:44:25.076189    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b3c2fc_481c_45d9_9e33_381514af9d3e.slice/crio-f84124a309c35cbcb31850610adfb8d031119cea22bd11a217b7b8822d2803e6 WatchSource:0}: Error finding container f84124a309c35cbcb31850610adfb8d031119cea22bd11a217b7b8822d2803e6: Status 404 returned error can't find the container with id f84124a309c35cbcb31850610adfb8d031119cea22bd11a217b7b8822d2803e6
Sep 17 17:44:25.078451 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:25.078435    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:44:25.370053 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:25.369967    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl" event={"ID":"d3b3c2fc-481c-45d9-9e33-381514af9d3e","Type":"ContainerStarted","Data":"f84124a309c35cbcb31850610adfb8d031119cea22bd11a217b7b8822d2803e6"}
Sep 17 17:44:30.396516 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:30.396436    2586 generic.go:356] "Generic (PLEG): container finished" podID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerID="1a329f577af860058b1542f75956cbe894ed32d2d37ffb352616b2847b833be4" exitCode=0
Sep 17 17:44:30.396876 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:30.396522    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl" event={"ID":"d3b3c2fc-481c-45d9-9e33-381514af9d3e","Type":"ContainerDied","Data":"1a329f577af860058b1542f75956cbe894ed32d2d37ffb352616b2847b833be4"}
Sep 17 17:44:33.414930 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:33.414896    2586 generic.go:356] "Generic (PLEG): container finished" podID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerID="e41971a30e2fb75177735bd6bcf485eb759f55bb7e5287e202361015fded5aa3" exitCode=0
Sep 17 17:44:33.415355 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:33.414973    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl" event={"ID":"d3b3c2fc-481c-45d9-9e33-381514af9d3e","Type":"ContainerDied","Data":"e41971a30e2fb75177735bd6bcf485eb759f55bb7e5287e202361015fded5aa3"}
Sep 17 17:44:39.445693 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:39.445602    2586 generic.go:356] "Generic (PLEG): container finished" podID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerID="dce3f36afb12c163a002296cb68f435112c95a03044e7578257cf339147a7269" exitCode=0
Sep 17 17:44:39.445693 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:39.445633    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl" event={"ID":"d3b3c2fc-481c-45d9-9e33-381514af9d3e","Type":"ContainerDied","Data":"dce3f36afb12c163a002296cb68f435112c95a03044e7578257cf339147a7269"}
Sep 17 17:44:40.570921 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.570897    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:40.613077 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.613053    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl8rm\" (UniqueName: \"kubernetes.io/projected/d3b3c2fc-481c-45d9-9e33-381514af9d3e-kube-api-access-pl8rm\") pod \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") "
Sep 17 17:44:40.613077 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.613086    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-util\") pod \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") "
Sep 17 17:44:40.613312 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.613102    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-bundle\") pod \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\" (UID: \"d3b3c2fc-481c-45d9-9e33-381514af9d3e\") "
Sep 17 17:44:40.613881 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.613853    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-bundle" (OuterVolumeSpecName: "bundle") pod "d3b3c2fc-481c-45d9-9e33-381514af9d3e" (UID: "d3b3c2fc-481c-45d9-9e33-381514af9d3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:44:40.615303 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.615277    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b3c2fc-481c-45d9-9e33-381514af9d3e-kube-api-access-pl8rm" (OuterVolumeSpecName: "kube-api-access-pl8rm") pod "d3b3c2fc-481c-45d9-9e33-381514af9d3e" (UID: "d3b3c2fc-481c-45d9-9e33-381514af9d3e"). InnerVolumeSpecName "kube-api-access-pl8rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:44:40.617557 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.617530    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-util" (OuterVolumeSpecName: "util") pod "d3b3c2fc-481c-45d9-9e33-381514af9d3e" (UID: "d3b3c2fc-481c-45d9-9e33-381514af9d3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:44:40.713673 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.713588    2586 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-util\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:44:40.713673 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.713618    2586 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3b3c2fc-481c-45d9-9e33-381514af9d3e-bundle\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:44:40.713673 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:40.713629    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl8rm\" (UniqueName: \"kubernetes.io/projected/d3b3c2fc-481c-45d9-9e33-381514af9d3e-kube-api-access-pl8rm\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:44:41.456047 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:41.456023    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl"
Sep 17 17:44:41.456211 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:41.456012    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1amt6nl" event={"ID":"d3b3c2fc-481c-45d9-9e33-381514af9d3e","Type":"ContainerDied","Data":"f84124a309c35cbcb31850610adfb8d031119cea22bd11a217b7b8822d2803e6"}
Sep 17 17:44:41.456211 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:41.456138    2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f84124a309c35cbcb31850610adfb8d031119cea22bd11a217b7b8822d2803e6"
Sep 17 17:44:48.254546 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.254514    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"]
Sep 17 17:44:48.255025 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.254882    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerName="util"
Sep 17 17:44:48.255025 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.254893    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerName="util"
Sep 17 17:44:48.255025 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.254910    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerName="extract"
Sep 17 17:44:48.255025 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.254915    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerName="extract"
Sep 17 17:44:48.255025 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.254923    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerName="pull"
Sep 17 17:44:48.255025 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.254927    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerName="pull"
Sep 17 17:44:48.255025 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.254992    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3b3c2fc-481c-45d9-9e33-381514af9d3e" containerName="extract"
Sep 17 17:44:48.256830 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.256816    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:44:48.259471 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.259448    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 17 17:44:48.259614 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.259475    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 17 17:44:48.259614 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.259492    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 17 17:44:48.259614 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.259499    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-4wsct\""
Sep 17 17:44:48.275635 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.275610    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"]
Sep 17 17:44:48.381401 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.381374    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m9fl\" (UniqueName: \"kubernetes.io/projected/6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07-kube-api-access-6m9fl\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-k8zz9\" (UID: \"6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:44:48.381572 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.381443    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-k8zz9\" (UID: \"6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:44:48.481929 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.481901    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m9fl\" (UniqueName: \"kubernetes.io/projected/6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07-kube-api-access-6m9fl\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-k8zz9\" (UID: \"6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:44:48.482121 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.482010    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-k8zz9\" (UID: \"6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:44:48.484305 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.484283    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-k8zz9\" (UID: \"6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:44:48.500001 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.499979    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m9fl\" (UniqueName: \"kubernetes.io/projected/6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07-kube-api-access-6m9fl\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-k8zz9\" (UID: \"6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:44:48.566537 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.566469    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:44:48.843111 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:48.843030    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"]
Sep 17 17:44:48.847366 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:44:48.847343    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e93fbd2_2765_4efe_abbf_c4bc9fcdcf07.slice/crio-a4bbf3dcd2f7ab7bd73db958a4b4e6fcd5ccf912a7934bf7bcde10bacb30cdf2 WatchSource:0}: Error finding container a4bbf3dcd2f7ab7bd73db958a4b4e6fcd5ccf912a7934bf7bcde10bacb30cdf2: Status 404 returned error can't find the container with id a4bbf3dcd2f7ab7bd73db958a4b4e6fcd5ccf912a7934bf7bcde10bacb30cdf2
Sep 17 17:44:49.491940 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:49.491909    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9" event={"ID":"6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07","Type":"ContainerStarted","Data":"a4bbf3dcd2f7ab7bd73db958a4b4e6fcd5ccf912a7934bf7bcde10bacb30cdf2"}
Sep 17 17:44:52.504889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.504856    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-r9lhs"]
Sep 17 17:44:52.508068 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.508046    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:52.510366 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.510340    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9" event={"ID":"6e93fbd2-2765-4efe-abbf-c4bc9fcdcf07","Type":"ContainerStarted","Data":"c575b4cc921ce91c14a83836aed038e0624624fa2375bbd2d5f0ec78d3c7831d"}
Sep 17 17:44:52.510503 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.510402    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:44:52.511336 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.511313    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 17 17:44:52.511457 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.511313    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Sep 17 17:44:52.511630 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.511615    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-xzxfb\""
Sep 17 17:44:52.522506 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.522483    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-r9lhs"]
Sep 17 17:44:52.582892 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.582833    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9" podStartSLOduration=1.788025514 podStartE2EDuration="4.582815992s" totalImagesPullingTime="2.794790478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:44:52.580669254 +0000 UTC m=+653.908102356" watchObservedRunningTime="2026-09-17 17:44:52.582815992 +0000 UTC m=+653.910249095"
Sep 17 17:44:52.616456 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.616423    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9j9z\" (UniqueName: \"kubernetes.io/projected/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-kube-api-access-g9j9z\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:52.616615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.616483    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-cabundle0\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:52.616615 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.616529    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-certificates\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:52.717861 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.717823    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9j9z\" (UniqueName: \"kubernetes.io/projected/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-kube-api-access-g9j9z\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:52.718092 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.717871    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-cabundle0\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:52.718092 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.717892    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-certificates\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:52.718092 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:44:52.718041    2586 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Sep 17 17:44:52.718092 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:44:52.718061    2586 secret.go:281] references non-existent secret key: ca.crt
Sep 17 17:44:52.718092 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:44:52.718071    2586 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Sep 17 17:44:52.718092 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:44:52.718084    2586 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-r9lhs: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Sep 17 17:44:52.718401 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:44:52.718143    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-certificates podName:a14b23ed-2d73-44f9-b0bb-8468b8d86dd6 nodeName:}" failed. No retries permitted until 2026-09-17 17:44:53.218122165 +0000 UTC m=+654.545555253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-certificates") pod "keda-operator-579c8958f7-r9lhs" (UID: "a14b23ed-2d73-44f9-b0bb-8468b8d86dd6") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Sep 17 17:44:52.718689 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.718665    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-cabundle0\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:52.741597 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.741572    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9j9z\" (UniqueName: \"kubernetes.io/projected/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-kube-api-access-g9j9z\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:52.883536 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.883453    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"]
Sep 17 17:44:52.887002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.886985    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:52.889564 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.889544    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Sep 17 17:44:52.898404 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.898383    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"]
Sep 17 17:44:52.919938 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.919894    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/821674ac-216c-44c6-90ba-17678ead2e65-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-l6pxr\" (UID: \"821674ac-216c-44c6-90ba-17678ead2e65\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:52.920155 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.920131    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/821674ac-216c-44c6-90ba-17678ead2e65-certificates\") pod \"keda-metrics-apiserver-77857b7b98-l6pxr\" (UID: \"821674ac-216c-44c6-90ba-17678ead2e65\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:52.920249 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:52.920205    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2bqn\" (UniqueName: \"kubernetes.io/projected/821674ac-216c-44c6-90ba-17678ead2e65-kube-api-access-w2bqn\") pod \"keda-metrics-apiserver-77857b7b98-l6pxr\" (UID: \"821674ac-216c-44c6-90ba-17678ead2e65\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:53.021297 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.021255    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/821674ac-216c-44c6-90ba-17678ead2e65-certificates\") pod \"keda-metrics-apiserver-77857b7b98-l6pxr\" (UID: \"821674ac-216c-44c6-90ba-17678ead2e65\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:53.021490 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.021319    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2bqn\" (UniqueName: \"kubernetes.io/projected/821674ac-216c-44c6-90ba-17678ead2e65-kube-api-access-w2bqn\") pod \"keda-metrics-apiserver-77857b7b98-l6pxr\" (UID: \"821674ac-216c-44c6-90ba-17678ead2e65\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:53.021490 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.021349    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/821674ac-216c-44c6-90ba-17678ead2e65-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-l6pxr\" (UID: \"821674ac-216c-44c6-90ba-17678ead2e65\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:53.021805 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.021786    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/821674ac-216c-44c6-90ba-17678ead2e65-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-l6pxr\" (UID: \"821674ac-216c-44c6-90ba-17678ead2e65\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:53.024006 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.023975    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/821674ac-216c-44c6-90ba-17678ead2e65-certificates\") pod \"keda-metrics-apiserver-77857b7b98-l6pxr\" (UID: \"821674ac-216c-44c6-90ba-17678ead2e65\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:53.031572 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.031545    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2bqn\" (UniqueName: \"kubernetes.io/projected/821674ac-216c-44c6-90ba-17678ead2e65-kube-api-access-w2bqn\") pod \"keda-metrics-apiserver-77857b7b98-l6pxr\" (UID: \"821674ac-216c-44c6-90ba-17678ead2e65\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:53.105096 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.105059    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-mbrmq"]
Sep 17 17:44:53.108541 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.108523    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:44:53.111047 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.111030    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Sep 17 17:44:53.126074 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.126039    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-mbrmq"]
Sep 17 17:44:53.198700 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.198615    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:53.224512 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.224482    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2164cd67-8e1e-4c40-8e5f-0424ae5a444b-certificates\") pod \"keda-admission-6c4d864b86-mbrmq\" (UID: \"2164cd67-8e1e-4c40-8e5f-0424ae5a444b\") " pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:44:53.224675 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.224545    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fh9b\" (UniqueName: \"kubernetes.io/projected/2164cd67-8e1e-4c40-8e5f-0424ae5a444b-kube-api-access-6fh9b\") pod \"keda-admission-6c4d864b86-mbrmq\" (UID: \"2164cd67-8e1e-4c40-8e5f-0424ae5a444b\") " pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:44:53.224675 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.224626    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-certificates\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:53.227344 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.227312    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a14b23ed-2d73-44f9-b0bb-8468b8d86dd6-certificates\") pod \"keda-operator-579c8958f7-r9lhs\" (UID: \"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6\") " pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:53.325967 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.325918    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2164cd67-8e1e-4c40-8e5f-0424ae5a444b-certificates\") pod \"keda-admission-6c4d864b86-mbrmq\" (UID: \"2164cd67-8e1e-4c40-8e5f-0424ae5a444b\") " pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:44:53.326134 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.326030    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fh9b\" (UniqueName: \"kubernetes.io/projected/2164cd67-8e1e-4c40-8e5f-0424ae5a444b-kube-api-access-6fh9b\") pod \"keda-admission-6c4d864b86-mbrmq\" (UID: \"2164cd67-8e1e-4c40-8e5f-0424ae5a444b\") " pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:44:53.328448 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.328429    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/2164cd67-8e1e-4c40-8e5f-0424ae5a444b-certificates\") pod \"keda-admission-6c4d864b86-mbrmq\" (UID: \"2164cd67-8e1e-4c40-8e5f-0424ae5a444b\") " pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:44:53.343056 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.343031    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fh9b\" (UniqueName: \"kubernetes.io/projected/2164cd67-8e1e-4c40-8e5f-0424ae5a444b-kube-api-access-6fh9b\") pod \"keda-admission-6c4d864b86-mbrmq\" (UID: \"2164cd67-8e1e-4c40-8e5f-0424ae5a444b\") " pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:44:53.418691 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.418657    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:44:53.427136 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.427105    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:44:53.478068 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.478027    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"]
Sep 17 17:44:53.483144 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:44:53.483114    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821674ac_216c_44c6_90ba_17678ead2e65.slice/crio-04f21610ddcbc0d00c9d025bed59081c114370134746ac4f8a75e2c398705089 WatchSource:0}: Error finding container 04f21610ddcbc0d00c9d025bed59081c114370134746ac4f8a75e2c398705089: Status 404 returned error can't find the container with id 04f21610ddcbc0d00c9d025bed59081c114370134746ac4f8a75e2c398705089
Sep 17 17:44:53.517693 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.517656    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr" event={"ID":"821674ac-216c-44c6-90ba-17678ead2e65","Type":"ContainerStarted","Data":"04f21610ddcbc0d00c9d025bed59081c114370134746ac4f8a75e2c398705089"}
Sep 17 17:44:53.732062 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.731978    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-r9lhs"]
Sep 17 17:44:53.733854 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:53.733834    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-mbrmq"]
Sep 17 17:44:53.735590 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:44:53.735562    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2164cd67_8e1e_4c40_8e5f_0424ae5a444b.slice/crio-2da0f4c76df25d96e8cf1b9e9b898efd1f814ec42e81099b7c18c548296673c6 WatchSource:0}: Error finding container 2da0f4c76df25d96e8cf1b9e9b898efd1f814ec42e81099b7c18c548296673c6: Status 404 returned error can't find the container with id 2da0f4c76df25d96e8cf1b9e9b898efd1f814ec42e81099b7c18c548296673c6
Sep 17 17:44:53.736622 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:44:53.736601    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14b23ed_2d73_44f9_b0bb_8468b8d86dd6.slice/crio-fa2d967e087d39059a0fbe60ffbb54c696d3e5aa3324c3e5d161faf699959483 WatchSource:0}: Error finding container fa2d967e087d39059a0fbe60ffbb54c696d3e5aa3324c3e5d161faf699959483: Status 404 returned error can't find the container with id fa2d967e087d39059a0fbe60ffbb54c696d3e5aa3324c3e5d161faf699959483
Sep 17 17:44:54.525058 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:54.525018    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-r9lhs" event={"ID":"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6","Type":"ContainerStarted","Data":"fa2d967e087d39059a0fbe60ffbb54c696d3e5aa3324c3e5d161faf699959483"}
Sep 17 17:44:54.526115 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:54.526091    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-mbrmq" event={"ID":"2164cd67-8e1e-4c40-8e5f-0424ae5a444b","Type":"ContainerStarted","Data":"2da0f4c76df25d96e8cf1b9e9b898efd1f814ec42e81099b7c18c548296673c6"}
Sep 17 17:44:56.541222 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:56.541182    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-mbrmq" event={"ID":"2164cd67-8e1e-4c40-8e5f-0424ae5a444b","Type":"ContainerStarted","Data":"779959496f864e3ba1ce1ac00cd7046e803171b9df05737120101147733aa9e5"}
Sep 17 17:44:56.541688 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:56.541366    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:44:56.570268 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:56.570179    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-mbrmq" podStartSLOduration=1.675484119 podStartE2EDuration="3.570161899s" totalImagesPullingTime="1.89467778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:44:56.569378186 +0000 UTC m=+657.896811289" watchObservedRunningTime="2026-09-17 17:44:56.570161899 +0000 UTC m=+657.897595002"
Sep 17 17:44:57.548013 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:57.547975    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr" event={"ID":"821674ac-216c-44c6-90ba-17678ead2e65","Type":"ContainerStarted","Data":"45827142d06eebfe9b51fd55dbb11d9bfd35c5e283950ed8258628ac472fab5f"}
Sep 17 17:44:57.548438 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:57.548239    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:44:57.578781 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:44:57.578732    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr" podStartSLOduration=2.247912802 podStartE2EDuration="5.578714013s" totalImagesPullingTime="3.330801211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:44:57.577073282 +0000 UTC m=+658.904506397" watchObservedRunningTime="2026-09-17 17:44:57.578714013 +0000 UTC m=+658.906147116"
Sep 17 17:45:02.577833 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:45:02.577797    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-r9lhs" event={"ID":"a14b23ed-2d73-44f9-b0bb-8468b8d86dd6","Type":"ContainerStarted","Data":"7a2b5995a74671deba5ab7f1014dc4a9443f04cae855d981abdc0ec3f1771e9a"}
Sep 17 17:45:02.578231 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:45:02.577936    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:45:02.604464 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:45:02.604411    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-r9lhs" podStartSLOduration=2.4968175280000002 podStartE2EDuration="10.604393071s" totalImagesPullingTime="8.107575543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:45:02.603003121 +0000 UTC m=+663.930436226" watchObservedRunningTime="2026-09-17 17:45:02.604393071 +0000 UTC m=+663.931826173"
Sep 17 17:45:08.556867 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:45:08.556838    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-l6pxr"
Sep 17 17:45:13.520723 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:45:13.520691    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-k8zz9"
Sep 17 17:45:17.551040 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:45:17.551007    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-mbrmq"
Sep 17 17:45:23.586603 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:45:23.586564    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-r9lhs"
Sep 17 17:46:13.121965 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.121882    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-drlsl"]
Sep 17 17:46:13.124937 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.124917    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:46:13.127246 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.127223    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-zkdvg\""
Sep 17 17:46:13.127384 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.127226    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 17 17:46:13.127384 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.127266    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 17 17:46:13.127384 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.127337    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brqqw\" (UniqueName: \"kubernetes.io/projected/d60e2106-c0db-4463-8fea-ad05fddb2371-kube-api-access-brqqw\") pod \"seaweedfs-64568bcd49-drlsl\" (UID: \"d60e2106-c0db-4463-8fea-ad05fddb2371\") " pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:46:13.127534 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.127420    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d60e2106-c0db-4463-8fea-ad05fddb2371-data\") pod \"seaweedfs-64568bcd49-drlsl\" (UID: \"d60e2106-c0db-4463-8fea-ad05fddb2371\") " pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:46:13.128207 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.128191    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 17 17:46:13.135408 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.135388    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-drlsl"]
Sep 17 17:46:13.228627 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.228601    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d60e2106-c0db-4463-8fea-ad05fddb2371-data\") pod \"seaweedfs-64568bcd49-drlsl\" (UID: \"d60e2106-c0db-4463-8fea-ad05fddb2371\") " pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:46:13.228805 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.228652    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brqqw\" (UniqueName: \"kubernetes.io/projected/d60e2106-c0db-4463-8fea-ad05fddb2371-kube-api-access-brqqw\") pod \"seaweedfs-64568bcd49-drlsl\" (UID: \"d60e2106-c0db-4463-8fea-ad05fddb2371\") " pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:46:13.229115 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.229095    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d60e2106-c0db-4463-8fea-ad05fddb2371-data\") pod \"seaweedfs-64568bcd49-drlsl\" (UID: \"d60e2106-c0db-4463-8fea-ad05fddb2371\") " pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:46:13.241157 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.241131    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brqqw\" (UniqueName: \"kubernetes.io/projected/d60e2106-c0db-4463-8fea-ad05fddb2371-kube-api-access-brqqw\") pod \"seaweedfs-64568bcd49-drlsl\" (UID: \"d60e2106-c0db-4463-8fea-ad05fddb2371\") " pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:46:13.435306 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.435232    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:46:13.707448 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.707424    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-drlsl"]
Sep 17 17:46:13.709499 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:46:13.709471    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60e2106_c0db_4463_8fea_ad05fddb2371.slice/crio-7255ddf72624f4617796e38a69a85dc1d3de39d41ede0fced257c67d14e274e4 WatchSource:0}: Error finding container 7255ddf72624f4617796e38a69a85dc1d3de39d41ede0fced257c67d14e274e4: Status 404 returned error can't find the container with id 7255ddf72624f4617796e38a69a85dc1d3de39d41ede0fced257c67d14e274e4
Sep 17 17:46:13.924472 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:13.924436    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-drlsl" event={"ID":"d60e2106-c0db-4463-8fea-ad05fddb2371","Type":"ContainerStarted","Data":"7255ddf72624f4617796e38a69a85dc1d3de39d41ede0fced257c67d14e274e4"}
Sep 17 17:46:16.941990 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:16.941929    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-drlsl" event={"ID":"d60e2106-c0db-4463-8fea-ad05fddb2371","Type":"ContainerStarted","Data":"09800762dea3b5f7b412cf6890ad03e5b64b13c22bc7606ca3879f2179e62389"}
Sep 17 17:46:16.942443 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:16.942115    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:46:16.960723 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:16.960677    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-drlsl" podStartSLOduration=1.202952856 podStartE2EDuration="3.960664223s" totalImagesPullingTime="2.757711367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:46:16.958819407 +0000 UTC m=+738.286252512" watchObservedRunningTime="2026-09-17 17:46:16.960664223 +0000 UTC m=+738.288097326"
Sep 17 17:46:22.949697 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:46:22.949666    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-drlsl"
Sep 17 17:47:30.645343 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.645197    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-s8vw7"]
Sep 17 17:47:30.649365 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.649346    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:30.651911 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.651887    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Sep 17 17:47:30.652077 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.651936    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-dnknw\""
Sep 17 17:47:30.658995 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.658969    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7b966d7984-zfpdb"]
Sep 17 17:47:30.663457 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.663426    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-s8vw7"]
Sep 17 17:47:30.663580 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.663538    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:30.666032 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.666011    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-lgnrz\""
Sep 17 17:47:30.666196 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.666015    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Sep 17 17:47:30.666196 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.666033    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\""
Sep 17 17:47:30.677757 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.677735    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-zfpdb"]
Sep 17 17:47:30.716881 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.716855    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/433414f1-374c-4527-a2e8-43f0fe209f06-tls-certs\") pod \"model-serving-api-7b954ffc95-s8vw7\" (UID: \"433414f1-374c-4527-a2e8-43f0fe209f06\") " pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:30.717058 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.716894    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsxxk\" (UniqueName: \"kubernetes.io/projected/433414f1-374c-4527-a2e8-43f0fe209f06-kube-api-access-tsxxk\") pod \"model-serving-api-7b954ffc95-s8vw7\" (UID: \"433414f1-374c-4527-a2e8-43f0fe209f06\") " pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:30.817487 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.817460    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-metrics-certs\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:30.817679 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.817496    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb5rc\" (UniqueName: \"kubernetes.io/projected/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-kube-api-access-rb5rc\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:30.817679 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.817583    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/433414f1-374c-4527-a2e8-43f0fe209f06-tls-certs\") pod \"model-serving-api-7b954ffc95-s8vw7\" (UID: \"433414f1-374c-4527-a2e8-43f0fe209f06\") " pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:30.817679 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.817633    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsxxk\" (UniqueName: \"kubernetes.io/projected/433414f1-374c-4527-a2e8-43f0fe209f06-kube-api-access-tsxxk\") pod \"model-serving-api-7b954ffc95-s8vw7\" (UID: \"433414f1-374c-4527-a2e8-43f0fe209f06\") " pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:30.817679 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.817671    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-cert\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:30.817859 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:47:30.817742    2586 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 17 17:47:30.817859 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:47:30.817815    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433414f1-374c-4527-a2e8-43f0fe209f06-tls-certs podName:433414f1-374c-4527-a2e8-43f0fe209f06 nodeName:}" failed. No retries permitted until 2026-09-17 17:47:31.317794681 +0000 UTC m=+812.645227770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/433414f1-374c-4527-a2e8-43f0fe209f06-tls-certs") pod "model-serving-api-7b954ffc95-s8vw7" (UID: "433414f1-374c-4527-a2e8-43f0fe209f06") : secret "model-serving-api-tls" not found
Sep 17 17:47:30.833637 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.833603    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsxxk\" (UniqueName: \"kubernetes.io/projected/433414f1-374c-4527-a2e8-43f0fe209f06-kube-api-access-tsxxk\") pod \"model-serving-api-7b954ffc95-s8vw7\" (UID: \"433414f1-374c-4527-a2e8-43f0fe209f06\") " pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:30.918415 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.918328    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-cert\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:30.918569 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.918428    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-metrics-certs\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:30.918569 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.918453    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb5rc\" (UniqueName: \"kubernetes.io/projected/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-kube-api-access-rb5rc\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:30.918569 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:47:30.918481    2586 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 17 17:47:30.918569 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:47:30.918539    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-cert podName:2e539c8f-08c0-4fcb-b5c3-b71cc63734bb nodeName:}" failed. No retries permitted until 2026-09-17 17:47:31.418520516 +0000 UTC m=+812.745953604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-cert") pod "odh-model-controller-7b966d7984-zfpdb" (UID: "2e539c8f-08c0-4fcb-b5c3-b71cc63734bb") : secret "odh-model-controller-webhook-cert" not found
Sep 17 17:47:30.920963 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.920928    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-metrics-certs\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:30.936167 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:30.936145    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb5rc\" (UniqueName: \"kubernetes.io/projected/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-kube-api-access-rb5rc\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:31.323202 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:31.323170    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/433414f1-374c-4527-a2e8-43f0fe209f06-tls-certs\") pod \"model-serving-api-7b954ffc95-s8vw7\" (UID: \"433414f1-374c-4527-a2e8-43f0fe209f06\") " pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:31.325511 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:31.325481    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/433414f1-374c-4527-a2e8-43f0fe209f06-tls-certs\") pod \"model-serving-api-7b954ffc95-s8vw7\" (UID: \"433414f1-374c-4527-a2e8-43f0fe209f06\") " pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:31.424240 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:31.424206    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-cert\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:31.426550 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:31.426521    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e539c8f-08c0-4fcb-b5c3-b71cc63734bb-cert\") pod \"odh-model-controller-7b966d7984-zfpdb\" (UID: \"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb\") " pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:31.560815 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:31.560784    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:31.576151 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:31.576080    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:31.844213 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:31.844188    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-s8vw7"]
Sep 17 17:47:31.846415 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:47:31.846392    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433414f1_374c_4527_a2e8_43f0fe209f06.slice/crio-38e074ada3aeb4ed5a80a79b96774821eddcf371c472bf33e86b403ce1d0fad3 WatchSource:0}: Error finding container 38e074ada3aeb4ed5a80a79b96774821eddcf371c472bf33e86b403ce1d0fad3: Status 404 returned error can't find the container with id 38e074ada3aeb4ed5a80a79b96774821eddcf371c472bf33e86b403ce1d0fad3
Sep 17 17:47:31.873247 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:31.873223    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-zfpdb"]
Sep 17 17:47:31.875314 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:47:31.875289    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e539c8f_08c0_4fcb_b5c3_b71cc63734bb.slice/crio-9b35d3114a46b73c1e2b8e37f185f1530b89b7f597003a6c45edc95c32906ea4 WatchSource:0}: Error finding container 9b35d3114a46b73c1e2b8e37f185f1530b89b7f597003a6c45edc95c32906ea4: Status 404 returned error can't find the container with id 9b35d3114a46b73c1e2b8e37f185f1530b89b7f597003a6c45edc95c32906ea4
Sep 17 17:47:32.299645 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:32.299605    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-zfpdb" event={"ID":"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb","Type":"ContainerStarted","Data":"9b35d3114a46b73c1e2b8e37f185f1530b89b7f597003a6c45edc95c32906ea4"}
Sep 17 17:47:32.301012 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:32.300979    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-s8vw7" event={"ID":"433414f1-374c-4527-a2e8-43f0fe209f06","Type":"ContainerStarted","Data":"38e074ada3aeb4ed5a80a79b96774821eddcf371c472bf33e86b403ce1d0fad3"}
Sep 17 17:47:36.327806 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:36.327772    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-zfpdb" event={"ID":"2e539c8f-08c0-4fcb-b5c3-b71cc63734bb","Type":"ContainerStarted","Data":"de63757f41e5f6161766caba6ee37dfffec582227680047ad3c4ee972eabecd7"}
Sep 17 17:47:36.328286 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:36.327836    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:36.329410 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:36.329390    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-s8vw7" event={"ID":"433414f1-374c-4527-a2e8-43f0fe209f06","Type":"ContainerStarted","Data":"dbb451579bf0ddf46e1b54e4eecf8dbe928b2fba68fb0b659f5706d033aaff99"}
Sep 17 17:47:36.329508 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:36.329429    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:47:36.349091 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:36.349041    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-7b966d7984-zfpdb" podStartSLOduration=2.836328557 podStartE2EDuration="6.349021785s" totalImagesPullingTime="3.512693228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:36.34782954 +0000 UTC m=+817.675262643" watchObservedRunningTime="2026-09-17 17:47:36.349021785 +0000 UTC m=+817.676454889"
Sep 17 17:47:36.366332 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:36.366286    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-s8vw7" podStartSLOduration=2.872376096 podStartE2EDuration="6.366270177s" totalImagesPullingTime="3.493894081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:47:36.365235488 +0000 UTC m=+817.692668604" watchObservedRunningTime="2026-09-17 17:47:36.366270177 +0000 UTC m=+817.693703281"
Sep 17 17:47:47.336555 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:47.336525    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7b966d7984-zfpdb"
Sep 17 17:47:47.338370 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:47:47.338351    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-s8vw7"
Sep 17 17:49:00.740678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:00.740610    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:49:00.748317 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:00.748295    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:49:00.760709 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:00.760687    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:49:00.768965 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:00.768933    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:49:17.562913 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.562870    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"]
Sep 17 17:49:17.565898 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.565873    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.568520 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.568494    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-raw-sklearn-batcher-d953e-kube-rbac-proxy-sar-config\""
Sep 17 17:49:17.568629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.568521    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 17:49:17.568629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.568539    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 17:49:17.568629 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.568556    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q5zmc\""
Sep 17 17:49:17.569389 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.569374    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 17:49:17.569442 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.569393    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 17:49:17.569442 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.569375    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-raw-sklearn-batcher-d953e-predictor-serving-cert\""
Sep 17 17:49:17.586314 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.586286    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"]
Sep 17 17:49:17.655460 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.655427    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.655655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.655496    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q2db\" (UniqueName: \"kubernetes.io/projected/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-api-access-7q2db\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.655655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.655555    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.655655 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.655611    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.655811 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.655679    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-proxy-tls\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.757084 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.757051    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q2db\" (UniqueName: \"kubernetes.io/projected/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-api-access-7q2db\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.757261 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.757101    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.757261 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.757143    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.757261 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.757200    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-proxy-tls\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.757261 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.757255    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.757601 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.757576    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kserve-provision-location\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.757878 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.757857    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-rbac-proxy-sar-config\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.758009 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.757990    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-cabundle-cert\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.759793 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.759772    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-proxy-tls\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.768804 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.768786    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q2db\" (UniqueName: \"kubernetes.io/projected/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-api-access-7q2db\") pod \"isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") " pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:17.876332 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:17.876243    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:18.174777 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:18.174754    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"]
Sep 17 17:49:18.177133 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:49:18.177108    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbd7ab9_ca74_43ce_8bac_f490ed28c865.slice/crio-972ad99974740fdee65f7146d60cbc39c734b218cc97dadb602c85950e5ea73b WatchSource:0}: Error finding container 972ad99974740fdee65f7146d60cbc39c734b218cc97dadb602c85950e5ea73b: Status 404 returned error can't find the container with id 972ad99974740fdee65f7146d60cbc39c734b218cc97dadb602c85950e5ea73b
Sep 17 17:49:18.845828 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:18.845791    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerStarted","Data":"972ad99974740fdee65f7146d60cbc39c734b218cc97dadb602c85950e5ea73b"}
Sep 17 17:49:21.864758 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:21.864675    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerStarted","Data":"e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff"}
Sep 17 17:49:25.886272 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:25.886240    2586 generic.go:356] "Generic (PLEG): container finished" podID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerID="e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff" exitCode=0
Sep 17 17:49:25.886797 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:25.886319    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerDied","Data":"e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff"}
Sep 17 17:49:25.887616 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:25.887600    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:49:39.992577 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:39.992530    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerStarted","Data":"0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee"}
Sep 17 17:49:42.004730 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:42.004690    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerStarted","Data":"37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07"}
Sep 17 17:49:44.026707 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:44.026639    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerStarted","Data":"614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58"}
Sep 17 17:49:44.027325 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:44.027307    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:44.055965 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:44.055913    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podStartSLOduration=2.03736409 podStartE2EDuration="27.055898778s" totalImagesPullingTime="21.265607018s" totalInitContainerRuntime="3.75292767s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:49:17 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:49:44.05360769 +0000 UTC m=+945.381040792" watchObservedRunningTime="2026-09-17 17:49:44.055898778 +0000 UTC m=+945.383331880"
Sep 17 17:49:45.031942 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:45.031913    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:45.032375 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:45.032003    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:45.033433 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:45.033400    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:49:45.034131 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:45.034105    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:49:46.036815 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:46.036775    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:49:46.037269 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:46.037072    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:49:46.040522 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:46.040502    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:49:47.040994 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:47.040931    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:49:47.041389 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:47.041283    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:49:57.041036 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:57.040986    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:49:57.041474 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:49:57.041451    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:50:07.041310 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:07.041262    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:50:07.041794 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:07.041771    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:50:17.041573 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:17.041473    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:50:17.042125 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:17.041880    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:50:27.041216 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:27.041160    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:50:27.041659 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:27.041589    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:50:37.041585 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:37.041532    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:50:37.042057 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:37.041980    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:50:47.041104 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:47.041063    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:50:47.041630 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:47.041599    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:50:57.041964 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:57.041923    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:50:57.042555 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:50:57.042136    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:51:02.653379 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.653347    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"]
Sep 17 17:51:02.653784 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.653578    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" containerID="cri-o://0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee" gracePeriod=30
Sep 17 17:51:02.653784 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.653623    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy" containerID="cri-o://37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07" gracePeriod=30
Sep 17 17:51:02.653784 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.653613    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" containerID="cri-o://614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58" gracePeriod=30
Sep 17 17:51:02.804797 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.804759    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"]
Sep 17 17:51:02.807872 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.807853    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.810556 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.810534    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-57a06-kube-rbac-proxy-sar-config\""
Sep 17 17:51:02.811453 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.811433    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-57a06-predictor-serving-cert\""
Sep 17 17:51:02.829606 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.819771    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-proxy-tls\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.829606 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.819865    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.829606 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.819974    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.829606 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.820003    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-cabundle-cert\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.829606 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.820042    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmmjc\" (UniqueName: \"kubernetes.io/projected/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-api-access-nmmjc\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.838049 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.838025    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"]
Sep 17 17:51:02.921088 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.921006    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.921088 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.921080    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.921352 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.921100    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-cabundle-cert\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.921352 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.921122    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmmjc\" (UniqueName: \"kubernetes.io/projected/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-api-access-nmmjc\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.921352 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.921164    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-proxy-tls\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.921643 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.921621    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.921806 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.921784    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.921863 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.921785    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-cabundle-cert\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.923593 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.923574    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-proxy-tls\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:02.940033 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:02.939999    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmmjc\" (UniqueName: \"kubernetes.io/projected/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-api-access-nmmjc\") pod \"isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:03.139910 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:03.139848    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:03.410360 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:03.410326    2586 generic.go:356] "Generic (PLEG): container finished" podID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerID="37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07" exitCode=2
Sep 17 17:51:03.410543 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:03.410398    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerDied","Data":"37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07"}
Sep 17 17:51:03.417437 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:03.417410    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"]
Sep 17 17:51:03.419246 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:51:03.419218    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0691e9c6_3b3c_486b_bd4e_d04eab0f1fea.slice/crio-ef2a747a8e2170295e712cf7da591eacbdd80cd1acf189ea690c4f99299d25e4 WatchSource:0}: Error finding container ef2a747a8e2170295e712cf7da591eacbdd80cd1acf189ea690c4f99299d25e4: Status 404 returned error can't find the container with id ef2a747a8e2170295e712cf7da591eacbdd80cd1acf189ea690c4f99299d25e4
Sep 17 17:51:04.417189 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:04.417154    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" event={"ID":"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea","Type":"ContainerStarted","Data":"5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de"}
Sep 17 17:51:04.417588 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:04.417214    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" event={"ID":"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea","Type":"ContainerStarted","Data":"ef2a747a8e2170295e712cf7da591eacbdd80cd1acf189ea690c4f99299d25e4"}
Sep 17 17:51:06.037251 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:06.037206    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Sep 17 17:51:07.041820 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:07.041777    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:51:07.042213 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:07.042143    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:51:07.434341 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:07.434312    2586 generic.go:356] "Generic (PLEG): container finished" podID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerID="5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de" exitCode=0
Sep 17 17:51:07.434501 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:07.434381    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" event={"ID":"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea","Type":"ContainerDied","Data":"5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de"}
Sep 17 17:51:07.437180 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:07.437155    2586 generic.go:356] "Generic (PLEG): container finished" podID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerID="0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee" exitCode=0
Sep 17 17:51:07.437292 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:07.437228    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerDied","Data":"0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee"}
Sep 17 17:51:08.444797 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:08.444763    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" event={"ID":"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea","Type":"ContainerStarted","Data":"603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8"}
Sep 17 17:51:08.445186 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:08.444833    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" event={"ID":"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea","Type":"ContainerStarted","Data":"a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1"}
Sep 17 17:51:08.445186 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:08.445014    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:08.470805 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:08.470756    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podStartSLOduration=2.68021157 podStartE2EDuration="6.470739868s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.790528298s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:51:08.468468037 +0000 UTC m=+1029.795901141" watchObservedRunningTime="2026-09-17 17:51:08.470739868 +0000 UTC m=+1029.798172971"
Sep 17 17:51:09.450022 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:09.449990    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:09.451337 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:09.451313    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:51:10.454898 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:10.454855    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:51:11.037673 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:11.037633    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Sep 17 17:51:15.460443 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:15.460413    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:51:15.461081 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:15.461050    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:51:16.037535 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:16.037494    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Sep 17 17:51:16.037714 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:16.037641    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:51:17.041002 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:17.040934    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:51:17.041402 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:17.041350    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:51:21.037147 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:21.037108    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Sep 17 17:51:25.461267 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:25.461224    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:51:26.037191 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:26.037145    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Sep 17 17:51:27.041224 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:27.041182    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 17:51:27.041660 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:27.041331    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:51:27.041660 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:27.041573    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:51:27.041732 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:27.041663    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:51:31.036900 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:31.036864    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Sep 17 17:51:32.808254 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.808230    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:51:32.896007 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.895970    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-cabundle-cert\") pod \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") "
Sep 17 17:51:32.896185 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.896069    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-proxy-tls\") pod \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") "
Sep 17 17:51:32.896185 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.896106    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kserve-provision-location\") pod \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") "
Sep 17 17:51:32.896185 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.896146    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q2db\" (UniqueName: \"kubernetes.io/projected/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-api-access-7q2db\") pod \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") "
Sep 17 17:51:32.896185 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.896173    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-rbac-proxy-sar-config\") pod \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\" (UID: \"9fbd7ab9-ca74-43ce-8bac-f490ed28c865\") "
Sep 17 17:51:32.896433 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.896404    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "9fbd7ab9-ca74-43ce-8bac-f490ed28c865" (UID: "9fbd7ab9-ca74-43ce-8bac-f490ed28c865"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:51:32.896433 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.896421    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "9fbd7ab9-ca74-43ce-8bac-f490ed28c865" (UID: "9fbd7ab9-ca74-43ce-8bac-f490ed28c865"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:51:32.896571 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.896556    2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kserve-provision-location\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:51:32.896638 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.896577    2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-cabundle-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:51:32.896692 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.896627    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9fbd7ab9-ca74-43ce-8bac-f490ed28c865" (UID: "9fbd7ab9-ca74-43ce-8bac-f490ed28c865"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:51:32.898339 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.898315    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9fbd7ab9-ca74-43ce-8bac-f490ed28c865" (UID: "9fbd7ab9-ca74-43ce-8bac-f490ed28c865"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:51:32.898456 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.898367    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-api-access-7q2db" (OuterVolumeSpecName: "kube-api-access-7q2db") pod "9fbd7ab9-ca74-43ce-8bac-f490ed28c865" (UID: "9fbd7ab9-ca74-43ce-8bac-f490ed28c865"). InnerVolumeSpecName "kube-api-access-7q2db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:51:32.997616 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.997530    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:51:32.997616 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.997567    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q2db\" (UniqueName: \"kubernetes.io/projected/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-api-access-7q2db\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:51:32.997616 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:32.997576    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9fbd7ab9-ca74-43ce-8bac-f490ed28c865-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:51:33.576834 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.576799    2586 generic.go:356] "Generic (PLEG): container finished" podID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerID="614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58" exitCode=0
Sep 17 17:51:33.577045 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.576867    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"
Sep 17 17:51:33.577045 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.576865    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerDied","Data":"614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58"}
Sep 17 17:51:33.577045 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.576988    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd" event={"ID":"9fbd7ab9-ca74-43ce-8bac-f490ed28c865","Type":"ContainerDied","Data":"972ad99974740fdee65f7146d60cbc39c734b218cc97dadb602c85950e5ea73b"}
Sep 17 17:51:33.577045 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.577025    2586 scope.go:117] "RemoveContainer" containerID="614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58"
Sep 17 17:51:33.586227 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.586210    2586 scope.go:117] "RemoveContainer" containerID="37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07"
Sep 17 17:51:33.593769 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.593755    2586 scope.go:117] "RemoveContainer" containerID="0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee"
Sep 17 17:51:33.600974 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.600946    2586 scope.go:117] "RemoveContainer" containerID="e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff"
Sep 17 17:51:33.605915 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.605893    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"]
Sep 17 17:51:33.608931 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.608908    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-raw-sklearn-batcher-d953e-predictor-7584c9b5d8-fjsqd"]
Sep 17 17:51:33.610678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.610660    2586 scope.go:117] "RemoveContainer" containerID="614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58"
Sep 17 17:51:33.611041 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:51:33.611015    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58\": container with ID starting with 614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58 not found: ID does not exist" containerID="614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58"
Sep 17 17:51:33.611095 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.611042    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58"} err="failed to get container status \"614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58\": rpc error: code = NotFound desc = could not find container \"614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58\": container with ID starting with 614bb22b7eeaa37f6d71d83a02b76e5c1d716b15320e479f29a346e082aa2c58 not found: ID does not exist"
Sep 17 17:51:33.611095 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.611061    2586 scope.go:117] "RemoveContainer" containerID="37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07"
Sep 17 17:51:33.611364 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:51:33.611341    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07\": container with ID starting with 37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07 not found: ID does not exist" containerID="37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07"
Sep 17 17:51:33.611409 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.611374    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07"} err="failed to get container status \"37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07\": rpc error: code = NotFound desc = could not find container \"37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07\": container with ID starting with 37fb851ffdd61a7af373ffdcc7c71a0bc2ae1d0c6f4a1caa72528fb533776c07 not found: ID does not exist"
Sep 17 17:51:33.611409 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.611398    2586 scope.go:117] "RemoveContainer" containerID="0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee"
Sep 17 17:51:33.611697 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:51:33.611671    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee\": container with ID starting with 0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee not found: ID does not exist" containerID="0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee"
Sep 17 17:51:33.611752 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.611694    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee"} err="failed to get container status \"0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee\": rpc error: code = NotFound desc = could not find container \"0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee\": container with ID starting with 0297b77fcefa3f20965f44c7452b41648e6089792a3ea35d8a685b185dd2a9ee not found: ID does not exist"
Sep 17 17:51:33.611752 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.611712    2586 scope.go:117] "RemoveContainer" containerID="e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff"
Sep 17 17:51:33.612067 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:51:33.612050    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff\": container with ID starting with e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff not found: ID does not exist" containerID="e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff"
Sep 17 17:51:33.612125 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:33.612070    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff"} err="failed to get container status \"e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff\": rpc error: code = NotFound desc = could not find container \"e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff\": container with ID starting with e57c051431b179c97f8835a4faeacfda315f00d55a72d1c1ea62f703560fb2ff not found: ID does not exist"
Sep 17 17:51:34.819558 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:34.819527    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" path="/var/lib/kubelet/pods/9fbd7ab9-ca74-43ce-8bac-f490ed28c865/volumes"
Sep 17 17:51:35.461414 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:35.461382    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:51:45.461210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:45.461130    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:51:55.461433 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:51:55.461393    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:52:05.461360 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:05.461319    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:52:15.461859 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:15.461818    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:52:20.814461 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:20.814425    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 17:52:30.818741 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:30.818713    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:52:53.073306 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.073275    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"]
Sep 17 17:52:53.073899 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.073531    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container" containerID="cri-o://a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1" gracePeriod=30
Sep 17 17:52:53.073899 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.073567    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kube-rbac-proxy" containerID="cri-o://603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8" gracePeriod=30
Sep 17 17:52:53.252789 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.252755    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"]
Sep 17 17:52:53.253186 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253174    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent"
Sep 17 17:52:53.253241 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253188    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent"
Sep 17 17:52:53.253241 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253196    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container"
Sep 17 17:52:53.253241 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253201    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container"
Sep 17 17:52:53.253241 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253214    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy"
Sep 17 17:52:53.253241 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253220    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy"
Sep 17 17:52:53.253241 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253227    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="storage-initializer"
Sep 17 17:52:53.253241 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253232    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="storage-initializer"
Sep 17 17:52:53.253468 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253293    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kserve-container"
Sep 17 17:52:53.253468 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253300    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="agent"
Sep 17 17:52:53.253468 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.253306    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fbd7ab9-ca74-43ce-8bac-f490ed28c865" containerName="kube-rbac-proxy"
Sep 17 17:52:53.256475 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.256460    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.258823 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.258799    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-hpa-68381-kube-rbac-proxy-sar-config\""
Sep 17 17:52:53.258940 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.258799    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-raw-hpa-68381-predictor-serving-cert\""
Sep 17 17:52:53.287082 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.287048    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlz8b\" (UniqueName: \"kubernetes.io/projected/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-api-access-hlz8b\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.287242 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.287124    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.287242 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.287176    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.287324 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.287278    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.287324 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.287318    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.293212 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.293188    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"]
Sep 17 17:52:53.387912 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.387818    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.387912 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.387869    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.387912 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.387901    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlz8b\" (UniqueName: \"kubernetes.io/projected/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-api-access-hlz8b\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.388194 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.387927    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.388194 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.387981    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.388427 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.388402    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.388618 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.388593    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.388725 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.388628    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.390524 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.390495    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.414297 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.414264    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlz8b\" (UniqueName: \"kubernetes.io/projected/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-api-access-hlz8b\") pod \"isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.567056 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.567014    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:53.858183 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.858158    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"]
Sep 17 17:52:53.860453 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:52:53.860417    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a80a6e_4c5b_46e6_81cd_a5ea7c2d4e6c.slice/crio-281927af40069981f860cd93f16ef2f3c3eccc0ce251527d7c5c47f31dd500a5 WatchSource:0}: Error finding container 281927af40069981f860cd93f16ef2f3c3eccc0ce251527d7c5c47f31dd500a5: Status 404 returned error can't find the container with id 281927af40069981f860cd93f16ef2f3c3eccc0ce251527d7c5c47f31dd500a5
Sep 17 17:52:53.975613 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.975578    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" event={"ID":"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c","Type":"ContainerStarted","Data":"46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66"}
Sep 17 17:52:53.975814 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.975646    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" event={"ID":"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c","Type":"ContainerStarted","Data":"281927af40069981f860cd93f16ef2f3c3eccc0ce251527d7c5c47f31dd500a5"}
Sep 17 17:52:53.977760 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.977735    2586 generic.go:356] "Generic (PLEG): container finished" podID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerID="603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8" exitCode=2
Sep 17 17:52:53.977905 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:53.977771    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" event={"ID":"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea","Type":"ContainerDied","Data":"603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8"}
Sep 17 17:52:55.455783 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:55.455730    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.37:8643/healthz\": dial tcp 10.134.0.37:8643: connect: connection refused"
Sep 17 17:52:57.830532 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.830494    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:52:57.930864 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.930834    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-rbac-proxy-sar-config\") pod \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") "
Sep 17 17:52:57.931047 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.930889    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmmjc\" (UniqueName: \"kubernetes.io/projected/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-api-access-nmmjc\") pod \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") "
Sep 17 17:52:57.931047 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.930941    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kserve-provision-location\") pod \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") "
Sep 17 17:52:57.931047 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.931009    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-proxy-tls\") pod \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") "
Sep 17 17:52:57.931047 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.931041    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-cabundle-cert\") pod \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\" (UID: \"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea\") "
Sep 17 17:52:57.931353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.931316    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" (UID: "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:52:57.931461 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.931275    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" (UID: "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:52:57.931461 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.931417    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" (UID: "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:52:57.933006 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.932978    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" (UID: "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:52:57.933118 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.933046    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-api-access-nmmjc" (OuterVolumeSpecName: "kube-api-access-nmmjc") pod "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" (UID: "0691e9c6-3b3c-486b-bd4e-d04eab0f1fea"). InnerVolumeSpecName "kube-api-access-nmmjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:52:57.998874 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.998844    2586 generic.go:356] "Generic (PLEG): container finished" podID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerID="a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1" exitCode=0
Sep 17 17:52:57.999068 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.998900    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"
Sep 17 17:52:57.999068 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.998997    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" event={"ID":"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea","Type":"ContainerDied","Data":"a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1"}
Sep 17 17:52:57.999068 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.999065    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz" event={"ID":"0691e9c6-3b3c-486b-bd4e-d04eab0f1fea","Type":"ContainerDied","Data":"ef2a747a8e2170295e712cf7da591eacbdd80cd1acf189ea690c4f99299d25e4"}
Sep 17 17:52:57.999210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:57.999105    2586 scope.go:117] "RemoveContainer" containerID="603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8"
Sep 17 17:52:58.000697 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.000674    2586 generic.go:356] "Generic (PLEG): container finished" podID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerID="46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66" exitCode=0
Sep 17 17:52:58.000796 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.000747    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" event={"ID":"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c","Type":"ContainerDied","Data":"46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66"}
Sep 17 17:52:58.008021 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.008003    2586 scope.go:117] "RemoveContainer" containerID="a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1"
Sep 17 17:52:58.015680 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.015662    2586 scope.go:117] "RemoveContainer" containerID="5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de"
Sep 17 17:52:58.023581 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.023559    2586 scope.go:117] "RemoveContainer" containerID="603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8"
Sep 17 17:52:58.023909 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:52:58.023881    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8\": container with ID starting with 603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8 not found: ID does not exist" containerID="603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8"
Sep 17 17:52:58.024086 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.023918    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8"} err="failed to get container status \"603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8\": rpc error: code = NotFound desc = could not find container \"603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8\": container with ID starting with 603dfa54869f6ca9548c159bd0a4c9d87117ef84309d7eb7dc063c07a970c2b8 not found: ID does not exist"
Sep 17 17:52:58.024086 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.023944    2586 scope.go:117] "RemoveContainer" containerID="a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1"
Sep 17 17:52:58.024914 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:52:58.024351    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1\": container with ID starting with a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1 not found: ID does not exist" containerID="a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1"
Sep 17 17:52:58.024914 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.024412    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1"} err="failed to get container status \"a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1\": rpc error: code = NotFound desc = could not find container \"a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1\": container with ID starting with a3f8f3fccd9f7d751f67f0ddd3956afa54565354d38a24422d1a6c7fd4f205a1 not found: ID does not exist"
Sep 17 17:52:58.024914 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.024437    2586 scope.go:117] "RemoveContainer" containerID="5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de"
Sep 17 17:52:58.025578 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:52:58.025558    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de\": container with ID starting with 5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de not found: ID does not exist" containerID="5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de"
Sep 17 17:52:58.025678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.025583    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de"} err="failed to get container status \"5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de\": rpc error: code = NotFound desc = could not find container \"5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de\": container with ID starting with 5c7b3799b5d161578ed993e20f5cb827df24d7bc271bf429b32e24ec45efd7de not found: ID does not exist"
Sep 17 17:52:58.032731 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.032712    2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kserve-provision-location\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:52:58.032731 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.032731    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:52:58.032887 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.032742    2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-cabundle-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:52:58.032887 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.032753    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:52:58.032887 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.032761    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmmjc\" (UniqueName: \"kubernetes.io/projected/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea-kube-api-access-nmmjc\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:52:58.039348 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.039327    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"]
Sep 17 17:52:58.047224 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.047200    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-57a06-predictor-84958bdbb4-dfbmz"]
Sep 17 17:52:58.820253 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:58.820218    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" path="/var/lib/kubelet/pods/0691e9c6-3b3c-486b-bd4e-d04eab0f1fea/volumes"
Sep 17 17:52:59.008239 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:59.008208    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" event={"ID":"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c","Type":"ContainerStarted","Data":"6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e"}
Sep 17 17:52:59.008621 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:59.008273    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" event={"ID":"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c","Type":"ContainerStarted","Data":"e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69"}
Sep 17 17:52:59.008621 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:59.008485    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:52:59.037846 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:52:59.037797    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podStartSLOduration=2.104651706 podStartE2EDuration="6.037780996s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.93312929s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:52:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:52:59.035460125 +0000 UTC m=+1140.362893228" watchObservedRunningTime="2026-09-17 17:52:59.037780996 +0000 UTC m=+1140.365214098"
Sep 17 17:53:00.013453 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:00.013421    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:53:00.015119 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:00.015089    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:53:01.018289 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:01.018246    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:53:06.023916 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:06.023880    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:53:06.024599 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:06.024570    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:53:16.028478 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:16.028395    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:53:26.025248 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:26.025209    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:53:36.024447 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:36.024410    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:53:46.025229 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:46.025192    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:53:56.025471 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:53:56.025431    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:54:00.775210 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:00.775175    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:54:00.782535 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:00.782504    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:54:00.793656 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:00.793636    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:54:00.800207 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:00.800190    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:54:06.025434 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:06.025396    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:54:16.025869 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:16.025838    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:54:43.348640 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.348564    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"]
Sep 17 17:54:43.351040 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.348792    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" containerID="cri-o://e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69" gracePeriod=30
Sep 17 17:54:43.351040 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.348823    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kube-rbac-proxy" containerID="cri-o://6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e" gracePeriod=30
Sep 17 17:54:43.490365 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.490333    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"]
Sep 17 17:54:43.490797 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.490780    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container"
Sep 17 17:54:43.490797 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.490797    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container"
Sep 17 17:54:43.490936 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.490806    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kube-rbac-proxy"
Sep 17 17:54:43.490936 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.490812    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kube-rbac-proxy"
Sep 17 17:54:43.490936 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.490822    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="storage-initializer"
Sep 17 17:54:43.490936 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.490827    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="storage-initializer"
Sep 17 17:54:43.490936 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.490899    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kube-rbac-proxy"
Sep 17 17:54:43.490936 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.490906    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="0691e9c6-3b3c-486b-bd4e-d04eab0f1fea" containerName="kserve-container"
Sep 17 17:54:43.494089 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.494071    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:43.496597 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.496573    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-7b2ba-predictor-serving-cert\""
Sep 17 17:54:43.496686 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.496584    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-7b2ba-kube-rbac-proxy-sar-config\""
Sep 17 17:54:43.505355 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.505331    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"]
Sep 17 17:54:43.525374 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.525344    2586 generic.go:356] "Generic (PLEG): container finished" podID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerID="6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e" exitCode=2
Sep 17 17:54:43.525526 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.525393    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" event={"ID":"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c","Type":"ContainerDied","Data":"6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e"}
Sep 17 17:54:43.584634 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.584606    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/40440721-d6d3-4400-8e58-f684adb91f71-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:43.584789 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.584707    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shk68\" (UniqueName: \"kubernetes.io/projected/40440721-d6d3-4400-8e58-f684adb91f71-kube-api-access-shk68\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:43.584789 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.584741    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40440721-d6d3-4400-8e58-f684adb91f71-proxy-tls\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:43.686231 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.686149    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/40440721-d6d3-4400-8e58-f684adb91f71-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:43.686231 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.686204    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shk68\" (UniqueName: \"kubernetes.io/projected/40440721-d6d3-4400-8e58-f684adb91f71-kube-api-access-shk68\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:43.686419 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.686235    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40440721-d6d3-4400-8e58-f684adb91f71-proxy-tls\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:43.686419 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:54:43.686364    2586 secret.go:189] Couldn't get secret kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-serving-cert: secret "message-dumper-raw-7b2ba-predictor-serving-cert" not found
Sep 17 17:54:43.686510 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:54:43.686421    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40440721-d6d3-4400-8e58-f684adb91f71-proxy-tls podName:40440721-d6d3-4400-8e58-f684adb91f71 nodeName:}" failed. No retries permitted until 2026-09-17 17:54:44.186403046 +0000 UTC m=+1245.513836130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/40440721-d6d3-4400-8e58-f684adb91f71-proxy-tls") pod "message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" (UID: "40440721-d6d3-4400-8e58-f684adb91f71") : secret "message-dumper-raw-7b2ba-predictor-serving-cert" not found
Sep 17 17:54:43.686809 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.686790    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/40440721-d6d3-4400-8e58-f684adb91f71-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:43.698188 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:43.698160    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shk68\" (UniqueName: \"kubernetes.io/projected/40440721-d6d3-4400-8e58-f684adb91f71-kube-api-access-shk68\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:44.191540 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:44.191506    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40440721-d6d3-4400-8e58-f684adb91f71-proxy-tls\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:44.193849 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:44.193824    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40440721-d6d3-4400-8e58-f684adb91f71-proxy-tls\") pod \"message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") " pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:44.404786 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:44.404758    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:44.678233 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:44.678204    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"]
Sep 17 17:54:44.680284 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:54:44.680255    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40440721_d6d3_4400_8e58_f684adb91f71.slice/crio-ba1d0ecf194ee815cde412e78e0115572802b96961b72254a07195663c3ef396 WatchSource:0}: Error finding container ba1d0ecf194ee815cde412e78e0115572802b96961b72254a07195663c3ef396: Status 404 returned error can't find the container with id ba1d0ecf194ee815cde412e78e0115572802b96961b72254a07195663c3ef396
Sep 17 17:54:44.682270 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:44.682255    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:54:45.539027 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:45.538982    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" event={"ID":"40440721-d6d3-4400-8e58-f684adb91f71","Type":"ContainerStarted","Data":"ba1d0ecf194ee815cde412e78e0115572802b96961b72254a07195663c3ef396"}
Sep 17 17:54:46.018736 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:46.018699    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.38:8643/healthz\": dial tcp 10.134.0.38:8643: connect: connection refused"
Sep 17 17:54:46.024792 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:46.024762    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 17:54:46.545455 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:46.545422    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" event={"ID":"40440721-d6d3-4400-8e58-f684adb91f71","Type":"ContainerStarted","Data":"bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763"}
Sep 17 17:54:46.545825 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:46.545484    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" event={"ID":"40440721-d6d3-4400-8e58-f684adb91f71","Type":"ContainerStarted","Data":"6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425"}
Sep 17 17:54:46.545825 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:46.545674    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:46.545825 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:46.545802    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:46.547682 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:46.547664    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:54:46.569860 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:46.569813    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" podStartSLOduration=2.536992408 podStartE2EDuration="3.569797622s" totalImagesPullingTime="1.032805214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:54:46.56771285 +0000 UTC m=+1247.895145950" watchObservedRunningTime="2026-09-17 17:54:46.569797622 +0000 UTC m=+1247.897230725"
Sep 17 17:54:48.101007 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.100982    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:54:48.228433 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.228332    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-rbac-proxy-sar-config\") pod \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") "
Sep 17 17:54:48.228586 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.228448    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-cabundle-cert\") pod \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") "
Sep 17 17:54:48.228586 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.228476    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlz8b\" (UniqueName: \"kubernetes.io/projected/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-api-access-hlz8b\") pod \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") "
Sep 17 17:54:48.228586 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.228511    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-proxy-tls\") pod \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") "
Sep 17 17:54:48.228586 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.228536    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kserve-provision-location\") pod \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\" (UID: \"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c\") "
Sep 17 17:54:48.228860 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.228747    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" (UID: "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:54:48.228919 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.228851    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" (UID: "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:54:48.228919 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.228855    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" (UID: "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:54:48.230528 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.230503    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-api-access-hlz8b" (OuterVolumeSpecName: "kube-api-access-hlz8b") pod "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" (UID: "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c"). InnerVolumeSpecName "kube-api-access-hlz8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:54:48.230674 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.230618    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" (UID: "c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:54:48.330030 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.330001    2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-cabundle-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:54:48.330030 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.330027    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlz8b\" (UniqueName: \"kubernetes.io/projected/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-api-access-hlz8b\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:54:48.330203 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.330041    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:54:48.330203 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.330057    2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kserve-provision-location\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:54:48.330203 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.330068    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:54:48.558486 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.558454    2586 generic.go:356] "Generic (PLEG): container finished" podID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerID="e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69" exitCode=0
Sep 17 17:54:48.558710 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.558507    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"
Sep 17 17:54:48.558710 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.558528    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" event={"ID":"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c","Type":"ContainerDied","Data":"e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69"}
Sep 17 17:54:48.558710 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.558620    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2" event={"ID":"c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c","Type":"ContainerDied","Data":"281927af40069981f860cd93f16ef2f3c3eccc0ce251527d7c5c47f31dd500a5"}
Sep 17 17:54:48.558710 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.558671    2586 scope.go:117] "RemoveContainer" containerID="6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e"
Sep 17 17:54:48.568140 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.568124    2586 scope.go:117] "RemoveContainer" containerID="e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69"
Sep 17 17:54:48.576064 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.576049    2586 scope.go:117] "RemoveContainer" containerID="46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66"
Sep 17 17:54:48.582408 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.582385    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"]
Sep 17 17:54:48.584812 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.584798    2586 scope.go:117] "RemoveContainer" containerID="6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e"
Sep 17 17:54:48.585092 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:54:48.585072    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e\": container with ID starting with 6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e not found: ID does not exist" containerID="6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e"
Sep 17 17:54:48.585146 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.585101    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e"} err="failed to get container status \"6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e\": rpc error: code = NotFound desc = could not find container \"6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e\": container with ID starting with 6f19087906f41af76cdea6470085ce23c143dae1d172ccac2ef190b91f20e34e not found: ID does not exist"
Sep 17 17:54:48.585146 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.585118    2586 scope.go:117] "RemoveContainer" containerID="e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69"
Sep 17 17:54:48.585361 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:54:48.585339    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69\": container with ID starting with e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69 not found: ID does not exist" containerID="e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69"
Sep 17 17:54:48.585422 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.585370    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69"} err="failed to get container status \"e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69\": rpc error: code = NotFound desc = could not find container \"e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69\": container with ID starting with e5223a9fef5a287d660e4b32b6680efa58ae7784b41f6a7755b2f8887f7c5b69 not found: ID does not exist"
Sep 17 17:54:48.585422 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.585395    2586 scope.go:117] "RemoveContainer" containerID="46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66"
Sep 17 17:54:48.585629 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:54:48.585612    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66\": container with ID starting with 46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66 not found: ID does not exist" containerID="46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66"
Sep 17 17:54:48.585666 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.585635    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66"} err="failed to get container status \"46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66\": rpc error: code = NotFound desc = could not find container \"46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66\": container with ID starting with 46671cf259e4215a4afc635737daff23b3136af514213852d2cc7f19ad20af66 not found: ID does not exist"
Sep 17 17:54:48.589674 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.589654    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-raw-hpa-68381-predictor-66494c8d76-v7fw2"]
Sep 17 17:54:48.818649 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:48.818552    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" path="/var/lib/kubelet/pods/c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c/volumes"
Sep 17 17:54:53.563309 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:54:53.563282    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:55:03.525412 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.525373    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"]
Sep 17 17:55:03.525987 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.525970    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="storage-initializer"
Sep 17 17:55:03.525987 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.525989    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="storage-initializer"
Sep 17 17:55:03.526127 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.526002    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container"
Sep 17 17:55:03.526127 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.526010    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container"
Sep 17 17:55:03.526127 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.526019    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kube-rbac-proxy"
Sep 17 17:55:03.526127 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.526027    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kube-rbac-proxy"
Sep 17 17:55:03.526127 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.526126    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kserve-container"
Sep 17 17:55:03.526363 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.526142    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a80a6e-4c5b-46e6-81cd-a5ea7c2d4e6c" containerName="kube-rbac-proxy"
Sep 17 17:55:03.530989 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.530946    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.533668 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.533644    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-raw-7b2ba-predictor-serving-cert\""
Sep 17 17:55:03.533889 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.533874    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 17:55:03.533965 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.533891    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-raw-7b2ba-kube-rbac-proxy-sar-config\""
Sep 17 17:55:03.533965 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.533897    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 17:55:03.543429 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.543405    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"]
Sep 17 17:55:03.566419 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.566391    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db33f3a2-74e5-48c6-80f0-ea42e7885308-proxy-tls\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.566419 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.566421    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-cabundle-cert\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.566611 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.566464    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.566611 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.566503    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db33f3a2-74e5-48c6-80f0-ea42e7885308-kserve-provision-location\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.566678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.566632    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkgrr\" (UniqueName: \"kubernetes.io/projected/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-api-access-vkgrr\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.667185 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.667152    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db33f3a2-74e5-48c6-80f0-ea42e7885308-kserve-provision-location\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.667353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.667215    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkgrr\" (UniqueName: \"kubernetes.io/projected/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-api-access-vkgrr\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.667353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.667240    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db33f3a2-74e5-48c6-80f0-ea42e7885308-proxy-tls\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.667353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.667258    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-cabundle-cert\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.667353 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.667288    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.667657 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.667635    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db33f3a2-74e5-48c6-80f0-ea42e7885308-kserve-provision-location\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.668129 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.668103    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-cabundle-cert\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.668175 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.668103    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.669623 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.669606    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db33f3a2-74e5-48c6-80f0-ea42e7885308-proxy-tls\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.681734 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.681704    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkgrr\" (UniqueName: \"kubernetes.io/projected/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-api-access-vkgrr\") pod \"isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") " pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:03.841169 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:03.841091    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:04.129721 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:04.129693    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"]
Sep 17 17:55:04.131456 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:55:04.131431    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb33f3a2_74e5_48c6_80f0_ea42e7885308.slice/crio-0dd4a105e8e4d238e977306f122dbf8922c58dff95185146acd33e125a010a26 WatchSource:0}: Error finding container 0dd4a105e8e4d238e977306f122dbf8922c58dff95185146acd33e125a010a26: Status 404 returned error can't find the container with id 0dd4a105e8e4d238e977306f122dbf8922c58dff95185146acd33e125a010a26
Sep 17 17:55:04.637559 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:04.637523    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerStarted","Data":"4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea"}
Sep 17 17:55:04.638038 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:04.637597    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerStarted","Data":"0dd4a105e8e4d238e977306f122dbf8922c58dff95185146acd33e125a010a26"}
Sep 17 17:55:08.659114 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:08.659080    2586 generic.go:356] "Generic (PLEG): container finished" podID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerID="4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea" exitCode=0
Sep 17 17:55:08.659485 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:08.659154    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerDied","Data":"4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea"}
Sep 17 17:55:09.667339 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:09.667302    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerStarted","Data":"de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292"}
Sep 17 17:55:09.667767 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:09.667370    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerStarted","Data":"0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c"}
Sep 17 17:55:09.667767 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:09.667396    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerStarted","Data":"856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab"}
Sep 17 17:55:09.667767 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:09.667740    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:09.667975 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:09.667886    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:09.669464 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:09.669439    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:55:09.693607 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:09.693565    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podStartSLOduration=2.645592978 podStartE2EDuration="6.693551509s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.047958531s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:55:09.691977846 +0000 UTC m=+1271.019410940" watchObservedRunningTime="2026-09-17 17:55:09.693551509 +0000 UTC m=+1271.020984611"
Sep 17 17:55:10.672039 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:10.672005    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:10.672485 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:10.672118    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:55:10.673272 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:10.673244    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:55:11.677081 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:11.677032    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:55:11.677470 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:11.677450    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:55:16.681133 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:16.681103    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:55:16.681631 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:16.681605    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:55:16.682010 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:16.681987    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:55:26.681581 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:26.681533    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:55:26.682070 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:26.681994    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:55:36.681735 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:36.681686    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:55:36.682194 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:36.682171    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:55:46.681650 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:46.681605    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:55:46.682153 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:46.681997    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:55:56.681702 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:56.681650    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:55:56.682180 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:55:56.682144    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:56:06.681797 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:06.681747    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:56:06.682348 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:06.682322    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:56:16.681611 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:16.681514    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:56:16.682060 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:16.682001    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:56:26.682737 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:26.682704    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:56:26.683227 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:26.683167    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:56:38.494124 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:38.494096    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc_40440721-d6d3-4400-8e58-f684adb91f71/kserve-container/0.log"
Sep 17 17:56:38.763419 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:38.763385    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"]
Sep 17 17:56:38.763683 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:38.763648    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" containerID="cri-o://856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab" gracePeriod=30
Sep 17 17:56:38.763808 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:38.763693    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy" containerID="cri-o://0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c" gracePeriod=30
Sep 17 17:56:38.763808 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:38.763693    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" containerID="cri-o://de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292" gracePeriod=30
Sep 17 17:56:38.839309 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:38.839275    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"]
Sep 17 17:56:38.839500 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:38.839479    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" podUID="40440721-d6d3-4400-8e58-f684adb91f71" containerName="kserve-container" containerID="cri-o://6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425" gracePeriod=30
Sep 17 17:56:38.839572 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:38.839527    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" podUID="40440721-d6d3-4400-8e58-f684adb91f71" containerName="kube-rbac-proxy" containerID="cri-o://bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763" gracePeriod=30
Sep 17 17:56:39.085200 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.085176    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:56:39.102610 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.102561    2586 generic.go:356] "Generic (PLEG): container finished" podID="40440721-d6d3-4400-8e58-f684adb91f71" containerID="bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763" exitCode=2
Sep 17 17:56:39.102610 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.102600    2586 generic.go:356] "Generic (PLEG): container finished" podID="40440721-d6d3-4400-8e58-f684adb91f71" containerID="6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425" exitCode=2
Sep 17 17:56:39.102813 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.102638    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"
Sep 17 17:56:39.102813 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.102650    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" event={"ID":"40440721-d6d3-4400-8e58-f684adb91f71","Type":"ContainerDied","Data":"bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763"}
Sep 17 17:56:39.102813 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.102713    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" event={"ID":"40440721-d6d3-4400-8e58-f684adb91f71","Type":"ContainerDied","Data":"6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425"}
Sep 17 17:56:39.102813 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.102743    2586 scope.go:117] "RemoveContainer" containerID="bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763"
Sep 17 17:56:39.102813 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.102746    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc" event={"ID":"40440721-d6d3-4400-8e58-f684adb91f71","Type":"ContainerDied","Data":"ba1d0ecf194ee815cde412e78e0115572802b96961b72254a07195663c3ef396"}
Sep 17 17:56:39.105570 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.105541    2586 generic.go:356] "Generic (PLEG): container finished" podID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerID="0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c" exitCode=2
Sep 17 17:56:39.105678 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.105592    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerDied","Data":"0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c"}
Sep 17 17:56:39.112413 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.112392    2586 scope.go:117] "RemoveContainer" containerID="6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425"
Sep 17 17:56:39.122126 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.122106    2586 scope.go:117] "RemoveContainer" containerID="bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763"
Sep 17 17:56:39.122445 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:56:39.122425    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763\": container with ID starting with bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763 not found: ID does not exist" containerID="bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763"
Sep 17 17:56:39.122513 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.122458    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763"} err="failed to get container status \"bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763\": rpc error: code = NotFound desc = could not find container \"bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763\": container with ID starting with bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763 not found: ID does not exist"
Sep 17 17:56:39.122513 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.122477    2586 scope.go:117] "RemoveContainer" containerID="6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425"
Sep 17 17:56:39.122742 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:56:39.122727    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425\": container with ID starting with 6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425 not found: ID does not exist" containerID="6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425"
Sep 17 17:56:39.122797 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.122749    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425"} err="failed to get container status \"6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425\": rpc error: code = NotFound desc = could not find container \"6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425\": container with ID starting with 6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425 not found: ID does not exist"
Sep 17 17:56:39.122797 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.122762    2586 scope.go:117] "RemoveContainer" containerID="bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763"
Sep 17 17:56:39.123075 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.123055    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763"} err="failed to get container status \"bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763\": rpc error: code = NotFound desc = could not find container \"bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763\": container with ID starting with bb1684ac148b1a6327f0e4659b0866c4f001b05642cd1d2e9df666ca36c77763 not found: ID does not exist"
Sep 17 17:56:39.123075 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.123075    2586 scope.go:117] "RemoveContainer" containerID="6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425"
Sep 17 17:56:39.123378 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.123358    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425"} err="failed to get container status \"6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425\": rpc error: code = NotFound desc = could not find container \"6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425\": container with ID starting with 6337f74fced81b5c23d4f7c0dbfc3f611f6fb597497530a167dffbb74575b425 not found: ID does not exist"
Sep 17 17:56:39.124661 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.124641    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40440721-d6d3-4400-8e58-f684adb91f71-proxy-tls\") pod \"40440721-d6d3-4400-8e58-f684adb91f71\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") "
Sep 17 17:56:39.124773 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.124691    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/40440721-d6d3-4400-8e58-f684adb91f71-kube-rbac-proxy-sar-config\") pod \"40440721-d6d3-4400-8e58-f684adb91f71\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") "
Sep 17 17:56:39.124773 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.124721    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shk68\" (UniqueName: \"kubernetes.io/projected/40440721-d6d3-4400-8e58-f684adb91f71-kube-api-access-shk68\") pod \"40440721-d6d3-4400-8e58-f684adb91f71\" (UID: \"40440721-d6d3-4400-8e58-f684adb91f71\") "
Sep 17 17:56:39.125091 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.125069    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40440721-d6d3-4400-8e58-f684adb91f71-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "40440721-d6d3-4400-8e58-f684adb91f71" (UID: "40440721-d6d3-4400-8e58-f684adb91f71"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:56:39.126646 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.126625    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40440721-d6d3-4400-8e58-f684adb91f71-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "40440721-d6d3-4400-8e58-f684adb91f71" (UID: "40440721-d6d3-4400-8e58-f684adb91f71"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:56:39.126858 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.126838    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40440721-d6d3-4400-8e58-f684adb91f71-kube-api-access-shk68" (OuterVolumeSpecName: "kube-api-access-shk68") pod "40440721-d6d3-4400-8e58-f684adb91f71" (UID: "40440721-d6d3-4400-8e58-f684adb91f71"). InnerVolumeSpecName "kube-api-access-shk68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:56:39.225850 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.225808    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/40440721-d6d3-4400-8e58-f684adb91f71-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:56:39.225850 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.225845    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/40440721-d6d3-4400-8e58-f684adb91f71-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:56:39.226092 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.225862    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shk68\" (UniqueName: \"kubernetes.io/projected/40440721-d6d3-4400-8e58-f684adb91f71-kube-api-access-shk68\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:56:39.432336 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.432301    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"]
Sep 17 17:56:39.437466 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:39.437437    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-7b2ba-predictor-5dd4c89768-4vsqc"]
Sep 17 17:56:40.825535 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:40.825498    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40440721-d6d3-4400-8e58-f684adb91f71" path="/var/lib/kubelet/pods/40440721-d6d3-4400-8e58-f684adb91f71/volumes"
Sep 17 17:56:41.677802 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:41.677754    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.40:8643/healthz\": dial tcp 10.134.0.40:8643: connect: connection refused"
Sep 17 17:56:44.134497 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:44.134464    2586 generic.go:356] "Generic (PLEG): container finished" podID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerID="856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab" exitCode=0
Sep 17 17:56:44.134849 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:44.134537    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerDied","Data":"856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab"}
Sep 17 17:56:46.677673 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:46.677632    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.40:8643/healthz\": dial tcp 10.134.0.40:8643: connect: connection refused"
Sep 17 17:56:46.682309 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:46.682276    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:56:46.683593 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:46.683562    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:56:51.677243 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:51.677200    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.40:8643/healthz\": dial tcp 10.134.0.40:8643: connect: connection refused"
Sep 17 17:56:51.677604 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:51.677321    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:56:56.677945 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:56.677902    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.40:8643/healthz\": dial tcp 10.134.0.40:8643: connect: connection refused"
Sep 17 17:56:56.682750 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:56.682718    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:56:56.683944 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:56:56.683923    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:57:01.677562 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:01.677518    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.40:8643/healthz\": dial tcp 10.134.0.40:8643: connect: connection refused"
Sep 17 17:57:06.678044 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:06.677996    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.40:8643/healthz\": dial tcp 10.134.0.40:8643: connect: connection refused"
Sep 17 17:57:06.682840 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:06.682808    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:57:06.683007 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:06.682997    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:57:06.683331 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:06.683304    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 17:57:06.683449 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:06.683434    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:57:08.922747 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:08.922719    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:57:09.089148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.089062    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkgrr\" (UniqueName: \"kubernetes.io/projected/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-api-access-vkgrr\") pod \"db33f3a2-74e5-48c6-80f0-ea42e7885308\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") "
Sep 17 17:57:09.089148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.089099    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-rbac-proxy-sar-config\") pod \"db33f3a2-74e5-48c6-80f0-ea42e7885308\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") "
Sep 17 17:57:09.089148 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.089140    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db33f3a2-74e5-48c6-80f0-ea42e7885308-proxy-tls\") pod \"db33f3a2-74e5-48c6-80f0-ea42e7885308\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") "
Sep 17 17:57:09.089454 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.089164    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-cabundle-cert\") pod \"db33f3a2-74e5-48c6-80f0-ea42e7885308\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") "
Sep 17 17:57:09.089454 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.089236    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db33f3a2-74e5-48c6-80f0-ea42e7885308-kserve-provision-location\") pod \"db33f3a2-74e5-48c6-80f0-ea42e7885308\" (UID: \"db33f3a2-74e5-48c6-80f0-ea42e7885308\") "
Sep 17 17:57:09.089589 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.089559    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "db33f3a2-74e5-48c6-80f0-ea42e7885308" (UID: "db33f3a2-74e5-48c6-80f0-ea42e7885308"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:57:09.089589 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.089577    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db33f3a2-74e5-48c6-80f0-ea42e7885308-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "db33f3a2-74e5-48c6-80f0-ea42e7885308" (UID: "db33f3a2-74e5-48c6-80f0-ea42e7885308"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:57:09.089672 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.089583    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "db33f3a2-74e5-48c6-80f0-ea42e7885308" (UID: "db33f3a2-74e5-48c6-80f0-ea42e7885308"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:57:09.091396 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.091373    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-api-access-vkgrr" (OuterVolumeSpecName: "kube-api-access-vkgrr") pod "db33f3a2-74e5-48c6-80f0-ea42e7885308" (UID: "db33f3a2-74e5-48c6-80f0-ea42e7885308"). InnerVolumeSpecName "kube-api-access-vkgrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:57:09.091488 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.091375    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db33f3a2-74e5-48c6-80f0-ea42e7885308-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "db33f3a2-74e5-48c6-80f0-ea42e7885308" (UID: "db33f3a2-74e5-48c6-80f0-ea42e7885308"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:57:09.190492 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.190460    2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-cabundle-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:57:09.190492 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.190489    2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/db33f3a2-74e5-48c6-80f0-ea42e7885308-kserve-provision-location\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:57:09.190492 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.190499    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkgrr\" (UniqueName: \"kubernetes.io/projected/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-api-access-vkgrr\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:57:09.190746 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.190508    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/db33f3a2-74e5-48c6-80f0-ea42e7885308-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:57:09.190746 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.190520    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/db33f3a2-74e5-48c6-80f0-ea42e7885308-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:57:09.257386 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.257355    2586 generic.go:356] "Generic (PLEG): container finished" podID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerID="de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292" exitCode=0
Sep 17 17:57:09.257627 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.257425    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"
Sep 17 17:57:09.257627 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.257430    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerDied","Data":"de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292"}
Sep 17 17:57:09.257627 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.257507    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj" event={"ID":"db33f3a2-74e5-48c6-80f0-ea42e7885308","Type":"ContainerDied","Data":"0dd4a105e8e4d238e977306f122dbf8922c58dff95185146acd33e125a010a26"}
Sep 17 17:57:09.257627 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.257557    2586 scope.go:117] "RemoveContainer" containerID="de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292"
Sep 17 17:57:09.267204 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.267183    2586 scope.go:117] "RemoveContainer" containerID="0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c"
Sep 17 17:57:09.275115 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.275095    2586 scope.go:117] "RemoveContainer" containerID="856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab"
Sep 17 17:57:09.282617 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.282591    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"]
Sep 17 17:57:09.283666 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.283650    2586 scope.go:117] "RemoveContainer" containerID="4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea"
Sep 17 17:57:09.288146 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.288122    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-7b2ba-predictor-69456d97b5-skdpj"]
Sep 17 17:57:09.294800 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.294779    2586 scope.go:117] "RemoveContainer" containerID="de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292"
Sep 17 17:57:09.295144 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:57:09.295126    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292\": container with ID starting with de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292 not found: ID does not exist" containerID="de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292"
Sep 17 17:57:09.295203 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.295154    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292"} err="failed to get container status \"de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292\": rpc error: code = NotFound desc = could not find container \"de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292\": container with ID starting with de199561fa6bfc2826c9e039266869054d303ffa64d2f95b6adbc85c450e3292 not found: ID does not exist"
Sep 17 17:57:09.295203 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.295172    2586 scope.go:117] "RemoveContainer" containerID="0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c"
Sep 17 17:57:09.295438 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:57:09.295419    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c\": container with ID starting with 0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c not found: ID does not exist" containerID="0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c"
Sep 17 17:57:09.295501 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.295448    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c"} err="failed to get container status \"0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c\": rpc error: code = NotFound desc = could not find container \"0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c\": container with ID starting with 0d4f426adaaffbd5092f64893727ff0ed43bcb0f76f9bde05adf5f96accf171c not found: ID does not exist"
Sep 17 17:57:09.295501 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.295473    2586 scope.go:117] "RemoveContainer" containerID="856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab"
Sep 17 17:57:09.295778 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:57:09.295759    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab\": container with ID starting with 856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab not found: ID does not exist" containerID="856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab"
Sep 17 17:57:09.295874 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.295780    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab"} err="failed to get container status \"856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab\": rpc error: code = NotFound desc = could not find container \"856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab\": container with ID starting with 856b9fa4890509b43c1c96784d8c7488c0d1eabbbbe4a6d997e08488cf96b5ab not found: ID does not exist"
Sep 17 17:57:09.295874 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.295794    2586 scope.go:117] "RemoveContainer" containerID="4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea"
Sep 17 17:57:09.296222 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:57:09.296039    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea\": container with ID starting with 4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea not found: ID does not exist" containerID="4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea"
Sep 17 17:57:09.296222 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:09.296061    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea"} err="failed to get container status \"4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea\": rpc error: code = NotFound desc = could not find container \"4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea\": container with ID starting with 4798b9ed48118fabae1f4ffed945cf3ace3374d84081a457941f87c31ae705ea not found: ID does not exist"
Sep 17 17:57:10.818737 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:57:10.818704    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" path="/var/lib/kubelet/pods/db33f3a2-74e5-48c6-80f0-ea42e7885308/volumes"
Sep 17 17:58:22.155393 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155361    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"]
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155729    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40440721-d6d3-4400-8e58-f684adb91f71" containerName="kube-rbac-proxy"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155741    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="40440721-d6d3-4400-8e58-f684adb91f71" containerName="kube-rbac-proxy"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155754    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155759    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155769    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155774    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155783    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="storage-initializer"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155788    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="storage-initializer"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155795    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155799    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155807    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40440721-d6d3-4400-8e58-f684adb91f71" containerName="kserve-container"
Sep 17 17:58:22.155816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155812    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="40440721-d6d3-4400-8e58-f684adb91f71" containerName="kserve-container"
Sep 17 17:58:22.156236 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155869    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="40440721-d6d3-4400-8e58-f684adb91f71" containerName="kserve-container"
Sep 17 17:58:22.156236 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155875    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kube-rbac-proxy"
Sep 17 17:58:22.156236 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155881    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="40440721-d6d3-4400-8e58-f684adb91f71" containerName="kube-rbac-proxy"
Sep 17 17:58:22.156236 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155889    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="kserve-container"
Sep 17 17:58:22.156236 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.155898    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="db33f3a2-74e5-48c6-80f0-ea42e7885308" containerName="agent"
Sep 17 17:58:22.159153 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.159137    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.161549 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.161519    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 17:58:22.161694 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.161521    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"raw-sklearn-runtime-bfe4d-kube-rbac-proxy-sar-config\""
Sep 17 17:58:22.161694 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.161534    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q5zmc\""
Sep 17 17:58:22.161872 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.161858    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 17:58:22.162487 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.162457    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 17:58:22.162487 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.162477    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 17:58:22.162487 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.162487    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"raw-sklearn-runtime-bfe4d-predictor-serving-cert\""
Sep 17 17:58:22.173446 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.173425    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"]
Sep 17 17:58:22.232744 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.232714    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-cabundle-cert\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.232916 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.232835    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba032103-983a-4a58-ac38-bfd7eb3c5966-kserve-provision-location\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.232916 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.232860    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rxn4\" (UniqueName: \"kubernetes.io/projected/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-api-access-7rxn4\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.232916 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.232885    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba032103-983a-4a58-ac38-bfd7eb3c5966-proxy-tls\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.232916 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.232908    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.334025 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.333994    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba032103-983a-4a58-ac38-bfd7eb3c5966-kserve-provision-location\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.334213 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.334031    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rxn4\" (UniqueName: \"kubernetes.io/projected/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-api-access-7rxn4\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.334213 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.334054    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba032103-983a-4a58-ac38-bfd7eb3c5966-proxy-tls\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.334213 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.334073    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.334398 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.334241    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-cabundle-cert\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.334505 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.334479    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba032103-983a-4a58-ac38-bfd7eb3c5966-kserve-provision-location\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.334780 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.334761    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-rbac-proxy-sar-config\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.334874 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.334848    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-cabundle-cert\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.336595 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.336577    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba032103-983a-4a58-ac38-bfd7eb3c5966-proxy-tls\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.344325 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.344305    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rxn4\" (UniqueName: \"kubernetes.io/projected/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-api-access-7rxn4\") pod \"raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") " pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.469643 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.469554    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:22.745547 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:22.745524    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"]
Sep 17 17:58:22.747607 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:58:22.747579    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba032103_983a_4a58_ac38_bfd7eb3c5966.slice/crio-66c7d3e36f16d5c9864c753f22155664082c0996a9b8fca9e519e37534932050 WatchSource:0}: Error finding container 66c7d3e36f16d5c9864c753f22155664082c0996a9b8fca9e519e37534932050: Status 404 returned error can't find the container with id 66c7d3e36f16d5c9864c753f22155664082c0996a9b8fca9e519e37534932050
Sep 17 17:58:23.630608 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:23.630574    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" event={"ID":"ba032103-983a-4a58-ac38-bfd7eb3c5966","Type":"ContainerStarted","Data":"eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5"}
Sep 17 17:58:23.631069 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:23.630640    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" event={"ID":"ba032103-983a-4a58-ac38-bfd7eb3c5966","Type":"ContainerStarted","Data":"66c7d3e36f16d5c9864c753f22155664082c0996a9b8fca9e519e37534932050"}
Sep 17 17:58:27.651919 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:27.651882    2586 generic.go:356] "Generic (PLEG): container finished" podID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerID="eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5" exitCode=0
Sep 17 17:58:27.652318 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:27.651979    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" event={"ID":"ba032103-983a-4a58-ac38-bfd7eb3c5966","Type":"ContainerDied","Data":"eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5"}
Sep 17 17:58:28.659529 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:28.659496    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" event={"ID":"ba032103-983a-4a58-ac38-bfd7eb3c5966","Type":"ContainerStarted","Data":"ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f"}
Sep 17 17:58:28.659904 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:28.659556    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" event={"ID":"ba032103-983a-4a58-ac38-bfd7eb3c5966","Type":"ContainerStarted","Data":"16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5"}
Sep 17 17:58:28.659904 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:28.659742    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:28.687634 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:28.687583    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podStartSLOduration=2.853036348 podStartE2EDuration="6.687568061s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.834531713s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:28.685264106 +0000 UTC m=+1470.012697213" watchObservedRunningTime="2026-09-17 17:58:28.687568061 +0000 UTC m=+1470.015001165"
Sep 17 17:58:29.664520 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:29.664487    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:29.665963 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:29.665922    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:58:30.669366 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:30.669331    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:58:35.673555 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:35.673523    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:58:35.674213 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:35.674012    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:58:45.674185 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:45.674145    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:58:55.674055 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:58:55.674009    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:59:00.809922 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:00.809896    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:59:00.818651 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:00.818630    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:59:00.827309 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:00.827289    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 17:59:00.833570 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:00.833553    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 17:59:05.674750 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:05.674706    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:59:15.674553 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:15.674461    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:59:25.674251 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:25.674211    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:59:34.197458 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.197419    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"]
Sep 17 17:59:34.201097 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.201080    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.203842 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.203820    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-create-predictor-serving-cert\""
Sep 17 17:59:34.204008 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.203851    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\""
Sep 17 17:59:34.214362 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.214335    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"]
Sep 17 17:59:34.288494 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.288457    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816eee40-78c0-4183-b0b5-d9bc4ff34a65-proxy-tls\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.288494 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.288496    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.288722 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.288572    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px9nb\" (UniqueName: \"kubernetes.io/projected/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-api-access-px9nb\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.288722 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.288631    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kserve-provision-location\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.288722 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.288661    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-cabundle-cert\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.390124 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.390092    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px9nb\" (UniqueName: \"kubernetes.io/projected/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-api-access-px9nb\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.390321 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.390134    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kserve-provision-location\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.390321 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.390155    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-cabundle-cert\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.390321 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.390230    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816eee40-78c0-4183-b0b5-d9bc4ff34a65-proxy-tls\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.390321 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.390245    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.390617 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.390596    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kserve-provision-location\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.391013 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.390991    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-cabundle-cert\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.391107 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.391011    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.392748 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.392724    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816eee40-78c0-4183-b0b5-d9bc4ff34a65-proxy-tls\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.399578 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.399555    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px9nb\" (UniqueName: \"kubernetes.io/projected/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-api-access-px9nb\") pod \"isvc-canary-create-predictor-6474b875b9-p9x7s\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") " pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.514193 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.514155    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:34.797319 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.797294    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"]
Sep 17 17:59:34.799551 ip-10-0-134-49 kubenswrapper[2586]: W0917 17:59:34.799514    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816eee40_78c0_4183_b0b5_d9bc4ff34a65.slice/crio-395ed87dac0909cd53438685314f5bdc96f266323d089952d9099cc569c534b2 WatchSource:0}: Error finding container 395ed87dac0909cd53438685314f5bdc96f266323d089952d9099cc569c534b2: Status 404 returned error can't find the container with id 395ed87dac0909cd53438685314f5bdc96f266323d089952d9099cc569c534b2
Sep 17 17:59:34.989728 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.989691    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" event={"ID":"816eee40-78c0-4183-b0b5-d9bc4ff34a65","Type":"ContainerStarted","Data":"249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae"}
Sep 17 17:59:34.989915 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:34.989747    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" event={"ID":"816eee40-78c0-4183-b0b5-d9bc4ff34a65","Type":"ContainerStarted","Data":"395ed87dac0909cd53438685314f5bdc96f266323d089952d9099cc569c534b2"}
Sep 17 17:59:35.674547 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:35.674504    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:59:39.019167 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:39.019127    2586 generic.go:356] "Generic (PLEG): container finished" podID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerID="249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae" exitCode=0
Sep 17 17:59:39.019547 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:39.019219    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" event={"ID":"816eee40-78c0-4183-b0b5-d9bc4ff34a65","Type":"ContainerDied","Data":"249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae"}
Sep 17 17:59:40.026275 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:40.026241    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" event={"ID":"816eee40-78c0-4183-b0b5-d9bc4ff34a65","Type":"ContainerStarted","Data":"8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed"}
Sep 17 17:59:40.026710 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:40.026297    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" event={"ID":"816eee40-78c0-4183-b0b5-d9bc4ff34a65","Type":"ContainerStarted","Data":"bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950"}
Sep 17 17:59:40.026710 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:40.026564    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:40.026816 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:40.026716    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:40.028221 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:40.028192    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 17 17:59:40.048092 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:40.048047    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podStartSLOduration=2.126650663 podStartE2EDuration="6.048032781s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.921382118s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:59:40.045455942 +0000 UTC m=+1541.372889050" watchObservedRunningTime="2026-09-17 17:59:40.048032781 +0000 UTC m=+1541.375465884"
Sep 17 17:59:41.031197 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:41.031158    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 17 17:59:45.675147 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:45.675116    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:59:46.035935 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:46.035909    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 17:59:46.036538 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:46.036514    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 17 17:59:52.177936 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:52.177900    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"]
Sep 17 17:59:52.178418 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:52.178219    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" containerID="cri-o://16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5" gracePeriod=30
Sep 17 17:59:52.178418 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:52.178298    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kube-rbac-proxy" containerID="cri-o://ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f" gracePeriod=30
Sep 17 17:59:53.092775 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:53.092742    2586 generic.go:356] "Generic (PLEG): container finished" podID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerID="ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f" exitCode=2
Sep 17 17:59:53.092943 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:53.092814    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" event={"ID":"ba032103-983a-4a58-ac38-bfd7eb3c5966","Type":"ContainerDied","Data":"ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f"}
Sep 17 17:59:55.670267 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:55.670224    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.41:8643/healthz\": dial tcp 10.134.0.41:8643: connect: connection refused"
Sep 17 17:59:55.674616 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:55.674586    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 17 17:59:56.036803 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:56.036768    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 17 17:59:57.035494 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.035468    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:59:57.097467 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.097391    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-rbac-proxy-sar-config\") pod \"ba032103-983a-4a58-ac38-bfd7eb3c5966\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") "
Sep 17 17:59:57.097467 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.097445    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba032103-983a-4a58-ac38-bfd7eb3c5966-proxy-tls\") pod \"ba032103-983a-4a58-ac38-bfd7eb3c5966\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") "
Sep 17 17:59:57.097671 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.097475    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba032103-983a-4a58-ac38-bfd7eb3c5966-kserve-provision-location\") pod \"ba032103-983a-4a58-ac38-bfd7eb3c5966\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") "
Sep 17 17:59:57.097671 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.097507    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-cabundle-cert\") pod \"ba032103-983a-4a58-ac38-bfd7eb3c5966\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") "
Sep 17 17:59:57.097671 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.097527    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rxn4\" (UniqueName: \"kubernetes.io/projected/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-api-access-7rxn4\") pod \"ba032103-983a-4a58-ac38-bfd7eb3c5966\" (UID: \"ba032103-983a-4a58-ac38-bfd7eb3c5966\") "
Sep 17 17:59:57.097841 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.097793    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba032103-983a-4a58-ac38-bfd7eb3c5966-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ba032103-983a-4a58-ac38-bfd7eb3c5966" (UID: "ba032103-983a-4a58-ac38-bfd7eb3c5966"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:59:57.097841 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.097821    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ba032103-983a-4a58-ac38-bfd7eb3c5966" (UID: "ba032103-983a-4a58-ac38-bfd7eb3c5966"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:57.097977 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.097884    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "ba032103-983a-4a58-ac38-bfd7eb3c5966" (UID: "ba032103-983a-4a58-ac38-bfd7eb3c5966"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:57.099657 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.099625    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba032103-983a-4a58-ac38-bfd7eb3c5966-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ba032103-983a-4a58-ac38-bfd7eb3c5966" (UID: "ba032103-983a-4a58-ac38-bfd7eb3c5966"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:59:57.099657 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.099634    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-api-access-7rxn4" (OuterVolumeSpecName: "kube-api-access-7rxn4") pod "ba032103-983a-4a58-ac38-bfd7eb3c5966" (UID: "ba032103-983a-4a58-ac38-bfd7eb3c5966"). InnerVolumeSpecName "kube-api-access-7rxn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:57.118110 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.118069    2586 generic.go:356] "Generic (PLEG): container finished" podID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerID="16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5" exitCode=0
Sep 17 17:59:57.118239 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.118119    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"
Sep 17 17:59:57.118239 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.118119    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" event={"ID":"ba032103-983a-4a58-ac38-bfd7eb3c5966","Type":"ContainerDied","Data":"16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5"}
Sep 17 17:59:57.118311 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.118246    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f" event={"ID":"ba032103-983a-4a58-ac38-bfd7eb3c5966","Type":"ContainerDied","Data":"66c7d3e36f16d5c9864c753f22155664082c0996a9b8fca9e519e37534932050"}
Sep 17 17:59:57.118311 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.118272    2586 scope.go:117] "RemoveContainer" containerID="ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f"
Sep 17 17:59:57.127886 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.127870    2586 scope.go:117] "RemoveContainer" containerID="16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5"
Sep 17 17:59:57.136041 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.136025    2586 scope.go:117] "RemoveContainer" containerID="eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5"
Sep 17 17:59:57.143574 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.143553    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"]
Sep 17 17:59:57.144274 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.144255    2586 scope.go:117] "RemoveContainer" containerID="ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f"
Sep 17 17:59:57.144557 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:59:57.144538    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f\": container with ID starting with ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f not found: ID does not exist" containerID="ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f"
Sep 17 17:59:57.144607 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.144565    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f"} err="failed to get container status \"ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f\": rpc error: code = NotFound desc = could not find container \"ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f\": container with ID starting with ddfec3efe3d3f20f5dca31fdd1cef722806b7d2c72d433e280ba372087b1aa3f not found: ID does not exist"
Sep 17 17:59:57.144607 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.144583    2586 scope.go:117] "RemoveContainer" containerID="16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5"
Sep 17 17:59:57.144802 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:59:57.144783    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5\": container with ID starting with 16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5 not found: ID does not exist" containerID="16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5"
Sep 17 17:59:57.144846 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.144808    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5"} err="failed to get container status \"16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5\": rpc error: code = NotFound desc = could not find container \"16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5\": container with ID starting with 16a7a1f32c3e2466469bc7074f2ebf38227077757a2e97c866aaab7854fd07f5 not found: ID does not exist"
Sep 17 17:59:57.144846 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.144822    2586 scope.go:117] "RemoveContainer" containerID="eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5"
Sep 17 17:59:57.145065 ip-10-0-134-49 kubenswrapper[2586]: E0917 17:59:57.145051    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5\": container with ID starting with eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5 not found: ID does not exist" containerID="eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5"
Sep 17 17:59:57.145116 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.145069    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5"} err="failed to get container status \"eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5\": rpc error: code = NotFound desc = could not find container \"eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5\": container with ID starting with eb2b9602da4a65ab39844bfd90145cb440d9f8e854bf9e1cf58a7211e60bfda5 not found: ID does not exist"
Sep 17 17:59:57.148508 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.148486    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/raw-sklearn-runtime-bfe4d-predictor-5db4699b8d-2qj6f"]
Sep 17 17:59:57.198290 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.198263    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:59:57.198290 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.198289    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba032103-983a-4a58-ac38-bfd7eb3c5966-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:59:57.198460 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.198301    2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba032103-983a-4a58-ac38-bfd7eb3c5966-kserve-provision-location\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:59:57.198460 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.198309    2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba032103-983a-4a58-ac38-bfd7eb3c5966-cabundle-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:59:57.198460 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:57.198320    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rxn4\" (UniqueName: \"kubernetes.io/projected/ba032103-983a-4a58-ac38-bfd7eb3c5966-kube-api-access-7rxn4\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 17:59:58.818267 ip-10-0-134-49 kubenswrapper[2586]: I0917 17:59:58.818234    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" path="/var/lib/kubelet/pods/ba032103-983a-4a58-ac38-bfd7eb3c5966/volumes"
Sep 17 18:00:06.037025 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:00:06.036985    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 17 18:00:16.036719 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:00:16.036680    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 17 18:00:26.036895 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:00:26.036850    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 17 18:00:36.036580 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:00:36.036543    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 17 18:00:46.036512 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:00:46.036432    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 17 18:00:56.037613 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:00:56.037586    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 18:01:00.247898 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:00.247848    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"]
Sep 17 18:01:00.248365 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:00.248132    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container" containerID="cri-o://bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950" gracePeriod=30
Sep 17 18:01:00.248365 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:00.248163    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kube-rbac-proxy" containerID="cri-o://8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed" gracePeriod=30
Sep 17 18:01:00.429806 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:00.429767    2586 generic.go:356] "Generic (PLEG): container finished" podID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerID="8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed" exitCode=2
Sep 17 18:01:00.429988 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:00.429824    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" event={"ID":"816eee40-78c0-4183-b0b5-d9bc4ff34a65","Type":"ContainerDied","Data":"8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed"}
Sep 17 18:01:01.031822 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:01.031784    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.42:8643/healthz\": dial tcp 10.134.0.42:8643: connect: connection refused"
Sep 17 18:01:05.101012 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.100988    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 18:01:05.104032 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.104013    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-rbac-proxy-sar-config\") pod \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") "
Sep 17 18:01:05.104134 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.104040    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-cabundle-cert\") pod \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") "
Sep 17 18:01:05.104134 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.104072    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kserve-provision-location\") pod \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") "
Sep 17 18:01:05.104134 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.104090    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816eee40-78c0-4183-b0b5-d9bc4ff34a65-proxy-tls\") pod \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") "
Sep 17 18:01:05.104134 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.104128    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px9nb\" (UniqueName: \"kubernetes.io/projected/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-api-access-px9nb\") pod \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\" (UID: \"816eee40-78c0-4183-b0b5-d9bc4ff34a65\") "
Sep 17 18:01:05.104385 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.104356    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "816eee40-78c0-4183-b0b5-d9bc4ff34a65" (UID: "816eee40-78c0-4183-b0b5-d9bc4ff34a65"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:01:05.104455 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.104382    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "816eee40-78c0-4183-b0b5-d9bc4ff34a65" (UID: "816eee40-78c0-4183-b0b5-d9bc4ff34a65"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:01:05.104455 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.104394    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "816eee40-78c0-4183-b0b5-d9bc4ff34a65" (UID: "816eee40-78c0-4183-b0b5-d9bc4ff34a65"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:01:05.106221 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.106193    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-api-access-px9nb" (OuterVolumeSpecName: "kube-api-access-px9nb") pod "816eee40-78c0-4183-b0b5-d9bc4ff34a65" (UID: "816eee40-78c0-4183-b0b5-d9bc4ff34a65"). InnerVolumeSpecName "kube-api-access-px9nb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:01:05.106317 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.106286    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816eee40-78c0-4183-b0b5-d9bc4ff34a65-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "816eee40-78c0-4183-b0b5-d9bc4ff34a65" (UID: "816eee40-78c0-4183-b0b5-d9bc4ff34a65"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:01:05.205046 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.204971    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:01:05.205046 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.204996    2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/816eee40-78c0-4183-b0b5-d9bc4ff34a65-cabundle-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:01:05.205046 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.205007    2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kserve-provision-location\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:01:05.205046 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.205035    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/816eee40-78c0-4183-b0b5-d9bc4ff34a65-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:01:05.205046 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.205045    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px9nb\" (UniqueName: \"kubernetes.io/projected/816eee40-78c0-4183-b0b5-d9bc4ff34a65-kube-api-access-px9nb\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:01:05.456116 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.456033    2586 generic.go:356] "Generic (PLEG): container finished" podID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerID="bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950" exitCode=0
Sep 17 18:01:05.456116 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.456089    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"
Sep 17 18:01:05.456297 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.456126    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" event={"ID":"816eee40-78c0-4183-b0b5-d9bc4ff34a65","Type":"ContainerDied","Data":"bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950"}
Sep 17 18:01:05.456297 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.456186    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s" event={"ID":"816eee40-78c0-4183-b0b5-d9bc4ff34a65","Type":"ContainerDied","Data":"395ed87dac0909cd53438685314f5bdc96f266323d089952d9099cc569c534b2"}
Sep 17 18:01:05.456297 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.456212    2586 scope.go:117] "RemoveContainer" containerID="8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed"
Sep 17 18:01:05.465745 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.465720    2586 scope.go:117] "RemoveContainer" containerID="bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950"
Sep 17 18:01:05.473324 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.473304    2586 scope.go:117] "RemoveContainer" containerID="249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae"
Sep 17 18:01:05.481277 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.481259    2586 scope.go:117] "RemoveContainer" containerID="8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed"
Sep 17 18:01:05.481338 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.481266    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"]
Sep 17 18:01:05.481539 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:01:05.481520    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed\": container with ID starting with 8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed not found: ID does not exist" containerID="8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed"
Sep 17 18:01:05.481586 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.481549    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed"} err="failed to get container status \"8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed\": rpc error: code = NotFound desc = could not find container \"8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed\": container with ID starting with 8316b76e5e13189385eeabfb0ba4b32ecdbabfeaea5706124481110865eed3ed not found: ID does not exist"
Sep 17 18:01:05.481586 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.481566    2586 scope.go:117] "RemoveContainer" containerID="bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950"
Sep 17 18:01:05.481836 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:01:05.481819    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950\": container with ID starting with bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950 not found: ID does not exist" containerID="bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950"
Sep 17 18:01:05.481891 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.481841    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950"} err="failed to get container status \"bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950\": rpc error: code = NotFound desc = could not find container \"bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950\": container with ID starting with bd02c899c05a48f8e3bcbd07f086016c7734f0ddb2c0741018352af3f794f950 not found: ID does not exist"
Sep 17 18:01:05.481891 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.481856    2586 scope.go:117] "RemoveContainer" containerID="249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae"
Sep 17 18:01:05.482136 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:01:05.482119    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae\": container with ID starting with 249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae not found: ID does not exist" containerID="249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae"
Sep 17 18:01:05.482184 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.482141    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae"} err="failed to get container status \"249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae\": rpc error: code = NotFound desc = could not find container \"249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae\": container with ID starting with 249a0be0e0af7f29f16f44c5ab8f538efd2997f6f614982ecd2f7900cc30cdae not found: ID does not exist"
Sep 17 18:01:05.485614 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:05.485595    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-create-predictor-6474b875b9-p9x7s"]
Sep 17 18:01:06.818119 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:06.818085    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" path="/var/lib/kubelet/pods/816eee40-78c0-4183-b0b5-d9bc4ff34a65/volumes"
Sep 17 18:01:09.456730 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.456690    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"]
Sep 17 18:01:09.457265 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457250    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container"
Sep 17 18:01:09.457312 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457268    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container"
Sep 17 18:01:09.457312 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457280    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kube-rbac-proxy"
Sep 17 18:01:09.457312 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457289    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kube-rbac-proxy"
Sep 17 18:01:09.457312 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457304    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="storage-initializer"
Sep 17 18:01:09.457436 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457313    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="storage-initializer"
Sep 17 18:01:09.457436 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457325    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="storage-initializer"
Sep 17 18:01:09.457436 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457333    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="storage-initializer"
Sep 17 18:01:09.457436 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457353    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container"
Sep 17 18:01:09.457436 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457361    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container"
Sep 17 18:01:09.457436 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457375    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kube-rbac-proxy"
Sep 17 18:01:09.457436 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457383    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kube-rbac-proxy"
Sep 17 18:01:09.457639 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457474    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kube-rbac-proxy"
Sep 17 18:01:09.457639 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457485    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kube-rbac-proxy"
Sep 17 18:01:09.457639 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457494    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="816eee40-78c0-4183-b0b5-d9bc4ff34a65" containerName="kserve-container"
Sep 17 18:01:09.457639 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.457506    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba032103-983a-4a58-ac38-bfd7eb3c5966" containerName="kserve-container"
Sep 17 18:01:09.462687 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.462667    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.465190 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.465164    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 18:01:09.465333 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.465271    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q5zmc\""
Sep 17 18:01:09.465421 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.465400    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 18:01:09.466103 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.466084    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\""
Sep 17 18:01:09.466248 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.466116    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\""
Sep 17 18:01:09.466248 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.466091    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 18:01:09.466248 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.466145    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 18:01:09.473602 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.473578    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"]
Sep 17 18:01:09.540007 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.539940    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.540199 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.540047    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94100e82-4d66-4e36-8f5a-701c7ef2b655-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.540199 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.540087    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94100e82-4d66-4e36-8f5a-701c7ef2b655-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.540294 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.540209    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtb9r\" (UniqueName: \"kubernetes.io/projected/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-api-access-mtb9r\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.540294 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.540258    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.640617 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.640585    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtb9r\" (UniqueName: \"kubernetes.io/projected/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-api-access-mtb9r\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.640617 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.640633    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.640893 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.640653    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.640893 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.640684    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94100e82-4d66-4e36-8f5a-701c7ef2b655-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.640893 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.640710    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94100e82-4d66-4e36-8f5a-701c7ef2b655-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.641153 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.641132    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94100e82-4d66-4e36-8f5a-701c7ef2b655-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.641408 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.641387    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.641480 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.641415    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.643123 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.643103    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94100e82-4d66-4e36-8f5a-701c7ef2b655-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.649463 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.649441    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtb9r\" (UniqueName: \"kubernetes.io/projected/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-api-access-mtb9r\") pod \"isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:09.774043 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:09.774003    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:10.048919 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:10.048894    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"]
Sep 17 18:01:10.051416 ip-10-0-134-49 kubenswrapper[2586]: W0917 18:01:10.051389    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94100e82_4d66_4e36_8f5a_701c7ef2b655.slice/crio-76157bce1b24cd2fd41b66faae515a1de72228ce5cdcfb418e18a67fb6a0e7b7 WatchSource:0}: Error finding container 76157bce1b24cd2fd41b66faae515a1de72228ce5cdcfb418e18a67fb6a0e7b7: Status 404 returned error can't find the container with id 76157bce1b24cd2fd41b66faae515a1de72228ce5cdcfb418e18a67fb6a0e7b7
Sep 17 18:01:10.493144 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:10.493060    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" event={"ID":"94100e82-4d66-4e36-8f5a-701c7ef2b655","Type":"ContainerStarted","Data":"4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc"}
Sep 17 18:01:10.493144 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:10.493135    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" event={"ID":"94100e82-4d66-4e36-8f5a-701c7ef2b655","Type":"ContainerStarted","Data":"76157bce1b24cd2fd41b66faae515a1de72228ce5cdcfb418e18a67fb6a0e7b7"}
Sep 17 18:01:14.514845 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:14.514807    2586 generic.go:356] "Generic (PLEG): container finished" podID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerID="4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc" exitCode=0
Sep 17 18:01:14.515294 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:14.514885    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" event={"ID":"94100e82-4d66-4e36-8f5a-701c7ef2b655","Type":"ContainerDied","Data":"4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc"}
Sep 17 18:01:15.523534 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:15.523501    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" event={"ID":"94100e82-4d66-4e36-8f5a-701c7ef2b655","Type":"ContainerStarted","Data":"aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b"}
Sep 17 18:01:15.523938 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:15.523561    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" event={"ID":"94100e82-4d66-4e36-8f5a-701c7ef2b655","Type":"ContainerStarted","Data":"8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468"}
Sep 17 18:01:15.523938 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:15.523848    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:15.549019 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:15.548948    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podStartSLOduration=2.619341917 podStartE2EDuration="6.548934014s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.929592097s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:01:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:01:15.546436774 +0000 UTC m=+1636.873869888" watchObservedRunningTime="2026-09-17 18:01:15.548934014 +0000 UTC m=+1636.876367118"
Sep 17 18:01:16.529535 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:16.529503    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:16.531038 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:16.531012    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:01:17.534437 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:17.534393    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:01:22.538907 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:22.538875    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:01:22.539393 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:22.539368    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:01:32.539531 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:32.539485    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:01:42.539944 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:42.539902    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:01:52.540068 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:01:52.540032    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:02:02.539716 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:02:02.539676    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:02:12.540092 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:02:12.540007    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:02:22.540272 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:02:22.540230    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:02:32.540135 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:02:32.540102    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:04:00.847037 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:00.847007    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 18:04:00.853755 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:00.853728    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 18:04:00.857985 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:00.857942    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 18:04:00.864723 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:00.864698    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ksrc4_194c53c0-2f53-4d58-8774-9581748ac651/ovn-acl-logging/0.log"
Sep 17 18:04:09.859034 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:09.859003    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"]
Sep 17 18:04:09.859464 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:09.859243    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" containerID="cri-o://8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468" gracePeriod=30
Sep 17 18:04:09.859464 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:09.859271    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kube-rbac-proxy" containerID="cri-o://aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b" gracePeriod=30
Sep 17 18:04:10.383403 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:10.383370    2586 generic.go:356] "Generic (PLEG): container finished" podID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerID="aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b" exitCode=2
Sep 17 18:04:10.383589 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:10.383443    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" event={"ID":"94100e82-4d66-4e36-8f5a-701c7ef2b655","Type":"ContainerDied","Data":"aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b"}
Sep 17 18:04:12.535440 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:12.535389    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.43:8643/healthz\": dial tcp 10.134.0.43:8643: connect: connection refused"
Sep 17 18:04:12.539685 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:12.539657    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 17 18:04:14.913818 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:14.913790    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:04:15.004527 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.004499    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94100e82-4d66-4e36-8f5a-701c7ef2b655-kserve-provision-location\") pod \"94100e82-4d66-4e36-8f5a-701c7ef2b655\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") "
Sep 17 18:04:15.004703 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.004538    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-cabundle-cert\") pod \"94100e82-4d66-4e36-8f5a-701c7ef2b655\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") "
Sep 17 18:04:15.004703 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.004594    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-rbac-proxy-sar-config\") pod \"94100e82-4d66-4e36-8f5a-701c7ef2b655\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") "
Sep 17 18:04:15.004703 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.004612    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtb9r\" (UniqueName: \"kubernetes.io/projected/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-api-access-mtb9r\") pod \"94100e82-4d66-4e36-8f5a-701c7ef2b655\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") "
Sep 17 18:04:15.004703 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.004692    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94100e82-4d66-4e36-8f5a-701c7ef2b655-proxy-tls\") pod \"94100e82-4d66-4e36-8f5a-701c7ef2b655\" (UID: \"94100e82-4d66-4e36-8f5a-701c7ef2b655\") "
Sep 17 18:04:15.004935 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.004877    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94100e82-4d66-4e36-8f5a-701c7ef2b655-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "94100e82-4d66-4e36-8f5a-701c7ef2b655" (UID: "94100e82-4d66-4e36-8f5a-701c7ef2b655"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:04:15.005029 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.004999    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "94100e82-4d66-4e36-8f5a-701c7ef2b655" (UID: "94100e82-4d66-4e36-8f5a-701c7ef2b655"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:04:15.005029 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.005014    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "94100e82-4d66-4e36-8f5a-701c7ef2b655" (UID: "94100e82-4d66-4e36-8f5a-701c7ef2b655"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:04:15.005132 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.005105    2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/94100e82-4d66-4e36-8f5a-701c7ef2b655-kserve-provision-location\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:04:15.005132 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.005124    2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-cabundle-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:04:15.005211 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.005140    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:04:15.006802 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.006785    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94100e82-4d66-4e36-8f5a-701c7ef2b655-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "94100e82-4d66-4e36-8f5a-701c7ef2b655" (UID: "94100e82-4d66-4e36-8f5a-701c7ef2b655"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:04:15.006914 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.006895    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-api-access-mtb9r" (OuterVolumeSpecName: "kube-api-access-mtb9r") pod "94100e82-4d66-4e36-8f5a-701c7ef2b655" (UID: "94100e82-4d66-4e36-8f5a-701c7ef2b655"). InnerVolumeSpecName "kube-api-access-mtb9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:04:15.106147 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.106096    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtb9r\" (UniqueName: \"kubernetes.io/projected/94100e82-4d66-4e36-8f5a-701c7ef2b655-kube-api-access-mtb9r\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:04:15.106147 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.106145    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/94100e82-4d66-4e36-8f5a-701c7ef2b655-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:04:15.408694 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.408601    2586 generic.go:356] "Generic (PLEG): container finished" podID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerID="8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468" exitCode=0
Sep 17 18:04:15.408694 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.408651    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" event={"ID":"94100e82-4d66-4e36-8f5a-701c7ef2b655","Type":"ContainerDied","Data":"8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468"}
Sep 17 18:04:15.408923 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.408714    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn" event={"ID":"94100e82-4d66-4e36-8f5a-701c7ef2b655","Type":"ContainerDied","Data":"76157bce1b24cd2fd41b66faae515a1de72228ce5cdcfb418e18a67fb6a0e7b7"}
Sep 17 18:04:15.408923 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.408664    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"
Sep 17 18:04:15.408923 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.408740    2586 scope.go:117] "RemoveContainer" containerID="aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b"
Sep 17 18:04:15.418077 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.418054    2586 scope.go:117] "RemoveContainer" containerID="8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468"
Sep 17 18:04:15.426171 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.426150    2586 scope.go:117] "RemoveContainer" containerID="4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc"
Sep 17 18:04:15.434160 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.434141    2586 scope.go:117] "RemoveContainer" containerID="aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b"
Sep 17 18:04:15.434471 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:04:15.434453    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b\": container with ID starting with aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b not found: ID does not exist" containerID="aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b"
Sep 17 18:04:15.434523 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.434487    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b"} err="failed to get container status \"aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b\": rpc error: code = NotFound desc = could not find container \"aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b\": container with ID starting with aceebf33b48c563ee157c464cef6f2b7532365b0b156cf3e2efec9696be3b03b not found: ID does not exist"
Sep 17 18:04:15.434523 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.434505    2586 scope.go:117] "RemoveContainer" containerID="8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468"
Sep 17 18:04:15.434793 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:04:15.434774    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468\": container with ID starting with 8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468 not found: ID does not exist" containerID="8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468"
Sep 17 18:04:15.434828 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.434802    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468"} err="failed to get container status \"8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468\": rpc error: code = NotFound desc = could not find container \"8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468\": container with ID starting with 8ef3797ae8deabef5629b799b0afd9f64b1446d2c216273e26a38df462751468 not found: ID does not exist"
Sep 17 18:04:15.434828 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.434821    2586 scope.go:117] "RemoveContainer" containerID="4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc"
Sep 17 18:04:15.435086 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:04:15.435068    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc\": container with ID starting with 4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc not found: ID does not exist" containerID="4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc"
Sep 17 18:04:15.435139 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.435090    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc"} err="failed to get container status \"4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc\": rpc error: code = NotFound desc = could not find container \"4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc\": container with ID starting with 4b7d44336cd50b95aea5c134a6b79e4aa61f517c95abedfed2acd24c70b384fc not found: ID does not exist"
Sep 17 18:04:15.442468 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.442442    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"]
Sep 17 18:04:15.451387 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:15.451357    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-5b4b466b66-pbxnn"]
Sep 17 18:04:16.825293 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:16.825260    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" path="/var/lib/kubelet/pods/94100e82-4d66-4e36-8f5a-701c7ef2b655/volumes"
Sep 17 18:04:24.149802 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.149767    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"]
Sep 17 18:04:24.150239 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.150183    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container"
Sep 17 18:04:24.150239 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.150197    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container"
Sep 17 18:04:24.150239 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.150213    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kube-rbac-proxy"
Sep 17 18:04:24.150239 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.150218    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kube-rbac-proxy"
Sep 17 18:04:24.150239 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.150232    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="storage-initializer"
Sep 17 18:04:24.150239 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.150238    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="storage-initializer"
Sep 17 18:04:24.150431 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.150304    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kube-rbac-proxy"
Sep 17 18:04:24.150431 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.150313    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="94100e82-4d66-4e36-8f5a-701c7ef2b655" containerName="kserve-container"
Sep 17 18:04:24.153310 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.153295    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.160614 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.160581    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-cipn-predictor-serving-cert\""
Sep 17 18:04:24.160779 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.160730    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 18:04:24.160849 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.160796    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 18:04:24.161024 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.161006    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-q5zmc\""
Sep 17 18:04:24.161147 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.161044    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-raw-cipn-kube-rbac-proxy-sar-config\""
Sep 17 18:04:24.165313 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.165290    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"]
Sep 17 18:04:24.291751 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.291713    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/65568231-b55d-4887-95b3-c908a9ebb295-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-cnzwk\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.291933 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.291761    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65568231-b55d-4887-95b3-c908a9ebb295-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-cnzwk\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.291933 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.291784    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh577\" (UniqueName: \"kubernetes.io/projected/65568231-b55d-4887-95b3-c908a9ebb295-kube-api-access-jh577\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-cnzwk\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.393273 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.393229    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65568231-b55d-4887-95b3-c908a9ebb295-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-cnzwk\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.393273 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.393274    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh577\" (UniqueName: \"kubernetes.io/projected/65568231-b55d-4887-95b3-c908a9ebb295-kube-api-access-jh577\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-cnzwk\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.393503 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.393351    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/65568231-b55d-4887-95b3-c908a9ebb295-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-cnzwk\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.394003 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.393985    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/65568231-b55d-4887-95b3-c908a9ebb295-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-cnzwk\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.395801 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.395779    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65568231-b55d-4887-95b3-c908a9ebb295-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-cnzwk\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.403821 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.403758    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh577\" (UniqueName: \"kubernetes.io/projected/65568231-b55d-4887-95b3-c908a9ebb295-kube-api-access-jh577\") pod \"message-dumper-raw-cipn-predictor-9774bf55d-cnzwk\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") " pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.469655 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.469615    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:24.751347 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:24.751322    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"]
Sep 17 18:04:24.753412 ip-10-0-134-49 kubenswrapper[2586]: W0917 18:04:24.753385    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65568231_b55d_4887_95b3_c908a9ebb295.slice/crio-4dafe935c48a958f3ed9f44a5841761153d8af51333cc24f2b9461397c927a88 WatchSource:0}: Error finding container 4dafe935c48a958f3ed9f44a5841761153d8af51333cc24f2b9461397c927a88: Status 404 returned error can't find the container with id 4dafe935c48a958f3ed9f44a5841761153d8af51333cc24f2b9461397c927a88
Sep 17 18:04:25.462598 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:25.462554    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk" event={"ID":"65568231-b55d-4887-95b3-c908a9ebb295","Type":"ContainerStarted","Data":"ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e"}
Sep 17 18:04:25.463043 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:25.462619    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk" event={"ID":"65568231-b55d-4887-95b3-c908a9ebb295","Type":"ContainerStarted","Data":"3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2"}
Sep 17 18:04:25.463043 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:25.462647    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk" event={"ID":"65568231-b55d-4887-95b3-c908a9ebb295","Type":"ContainerStarted","Data":"4dafe935c48a958f3ed9f44a5841761153d8af51333cc24f2b9461397c927a88"}
Sep 17 18:04:25.463043 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:25.462719    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:25.484579 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:25.484523    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk" podStartSLOduration=1.484506516 podStartE2EDuration="1.484506516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:04:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:04:25.483395324 +0000 UTC m=+1826.810828429" watchObservedRunningTime="2026-09-17 18:04:25.484506516 +0000 UTC m=+1826.811939682"
Sep 17 18:04:26.467373 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:26.467341    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:26.469226 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:26.469203    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:33.482052 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:33.482024    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:04:34.197047 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.197005    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"]
Sep 17 18:04:34.200994 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.200973    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.203269 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.203241    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 18:04:34.203399 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.203241    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-raw-cipn-predictor-serving-cert\""
Sep 17 18:04:34.203399 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.203307    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 18:04:34.203482 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.203419    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-logger-raw-cipn-kube-rbac-proxy-sar-config\""
Sep 17 18:04:34.214702 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.214677    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"]
Sep 17 18:04:34.278868 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.278830    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd44q\" (UniqueName: \"kubernetes.io/projected/566006e8-90dc-459b-8e1f-15a18d002156-kube-api-access-zd44q\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.279067 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.278898    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/566006e8-90dc-459b-8e1f-15a18d002156-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.279067 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.278930    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.279067 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.278972    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/566006e8-90dc-459b-8e1f-15a18d002156-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.279067 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.279005    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.380258 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.380226    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/566006e8-90dc-459b-8e1f-15a18d002156-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.380434 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.380269    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.380434 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.380294    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/566006e8-90dc-459b-8e1f-15a18d002156-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.380434 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.380324    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.380434 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.380343    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd44q\" (UniqueName: \"kubernetes.io/projected/566006e8-90dc-459b-8e1f-15a18d002156-kube-api-access-zd44q\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.380820 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.380798    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/566006e8-90dc-459b-8e1f-15a18d002156-kserve-provision-location\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.381031 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.381009    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-kube-rbac-proxy-sar-config\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.381085 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.381014    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-cabundle-cert\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.382866 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.382799    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/566006e8-90dc-459b-8e1f-15a18d002156-proxy-tls\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.389684 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.389660    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd44q\" (UniqueName: \"kubernetes.io/projected/566006e8-90dc-459b-8e1f-15a18d002156-kube-api-access-zd44q\") pod \"isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") " pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.512980 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.512928    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:34.797942 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:34.797914    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"]
Sep 17 18:04:34.800084 ip-10-0-134-49 kubenswrapper[2586]: W0917 18:04:34.800055    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566006e8_90dc_459b_8e1f_15a18d002156.slice/crio-9b08588abb98195f24eb435a6de374ccd15bc0d868e7833048080f942645c7a5 WatchSource:0}: Error finding container 9b08588abb98195f24eb435a6de374ccd15bc0d868e7833048080f942645c7a5: Status 404 returned error can't find the container with id 9b08588abb98195f24eb435a6de374ccd15bc0d868e7833048080f942645c7a5
Sep 17 18:04:35.516403 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:35.516359    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerStarted","Data":"de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59"}
Sep 17 18:04:35.516795 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:35.516448    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerStarted","Data":"9b08588abb98195f24eb435a6de374ccd15bc0d868e7833048080f942645c7a5"}
Sep 17 18:04:39.537248 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:39.537212    2586 generic.go:356] "Generic (PLEG): container finished" podID="566006e8-90dc-459b-8e1f-15a18d002156" containerID="de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59" exitCode=0
Sep 17 18:04:39.537616 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:39.537283    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerDied","Data":"de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59"}
Sep 17 18:04:40.544870 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:40.544840    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerStarted","Data":"c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd"}
Sep 17 18:04:40.545323 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:40.544905    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerStarted","Data":"41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2"}
Sep 17 18:04:40.545323 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:40.544931    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerStarted","Data":"89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30"}
Sep 17 18:04:40.545434 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:40.545320    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:40.545434 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:40.545375    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:40.545434 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:40.545398    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:40.547024 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:40.546991    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:04:40.547747 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:40.547723    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:04:40.570424 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:40.570379    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podStartSLOduration=2.670346749 podStartE2EDuration="6.570360797s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.900014048s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:04:40.568486362 +0000 UTC m=+1841.895919457" watchObservedRunningTime="2026-09-17 18:04:40.570360797 +0000 UTC m=+1841.897793900"
Sep 17 18:04:41.550741 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:41.550696    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:04:41.551189 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:41.551163    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:04:46.555279 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:46.555251    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:04:46.557617 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:46.555876    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:04:46.557617 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:46.556311    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:04:56.556259 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:56.556214    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:04:56.556705 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:04:56.556617    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:05:06.556640 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:06.556581    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:05:06.557170 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:06.557100    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:05:16.555978 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:16.555848    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:05:16.556431 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:16.556353    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:05:26.556032 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:26.555993    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:05:26.556578 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:26.556554    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:05:36.556761 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:36.556713    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:05:36.557276 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:36.557253    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:05:46.556347 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:46.556305    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:05:46.556908 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:46.556707    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:05:54.818712 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:54.818666    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:05:54.819182 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:05:54.818895    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:06:04.819116 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:04.819089    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:06:04.819616 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:04.819193    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:06:19.212519 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.212487    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-raw-cipn-predictor-9774bf55d-cnzwk_65568231-b55d-4887-95b3-c908a9ebb295/kserve-container/0.log"
Sep 17 18:06:19.445178 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.445145    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"]
Sep 17 18:06:19.445436 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.445409    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" containerID="cri-o://89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30" gracePeriod=30
Sep 17 18:06:19.445495 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.445407    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" containerID="cri-o://c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd" gracePeriod=30
Sep 17 18:06:19.445495 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.445471    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy" containerID="cri-o://41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2" gracePeriod=30
Sep 17 18:06:19.455860 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.455830    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"]
Sep 17 18:06:19.456078 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.456060    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk" podUID="65568231-b55d-4887-95b3-c908a9ebb295" containerName="kserve-container" containerID="cri-o://3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2" gracePeriod=30
Sep 17 18:06:19.456168 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.456139    2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk" podUID="65568231-b55d-4887-95b3-c908a9ebb295" containerName="kube-rbac-proxy" containerID="cri-o://ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e" gracePeriod=30
Sep 17 18:06:19.716555 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.716523    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:06:19.848922 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.848887    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/65568231-b55d-4887-95b3-c908a9ebb295-kube-rbac-proxy-sar-config\") pod \"65568231-b55d-4887-95b3-c908a9ebb295\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") "
Sep 17 18:06:19.848922 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.848931    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65568231-b55d-4887-95b3-c908a9ebb295-proxy-tls\") pod \"65568231-b55d-4887-95b3-c908a9ebb295\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") "
Sep 17 18:06:19.849172 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.848998    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh577\" (UniqueName: \"kubernetes.io/projected/65568231-b55d-4887-95b3-c908a9ebb295-kube-api-access-jh577\") pod \"65568231-b55d-4887-95b3-c908a9ebb295\" (UID: \"65568231-b55d-4887-95b3-c908a9ebb295\") "
Sep 17 18:06:19.849382 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.849352    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65568231-b55d-4887-95b3-c908a9ebb295-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "65568231-b55d-4887-95b3-c908a9ebb295" (UID: "65568231-b55d-4887-95b3-c908a9ebb295"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:06:19.851176 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.851151    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65568231-b55d-4887-95b3-c908a9ebb295-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "65568231-b55d-4887-95b3-c908a9ebb295" (UID: "65568231-b55d-4887-95b3-c908a9ebb295"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:06:19.851176 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.851170    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65568231-b55d-4887-95b3-c908a9ebb295-kube-api-access-jh577" (OuterVolumeSpecName: "kube-api-access-jh577") pod "65568231-b55d-4887-95b3-c908a9ebb295" (UID: "65568231-b55d-4887-95b3-c908a9ebb295"). InnerVolumeSpecName "kube-api-access-jh577". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:06:19.950460 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.950416    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/65568231-b55d-4887-95b3-c908a9ebb295-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:06:19.950460 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.950461    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65568231-b55d-4887-95b3-c908a9ebb295-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:06:19.950720 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:19.950480    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh577\" (UniqueName: \"kubernetes.io/projected/65568231-b55d-4887-95b3-c908a9ebb295-kube-api-access-jh577\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:06:20.047653 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.047618    2586 generic.go:356] "Generic (PLEG): container finished" podID="566006e8-90dc-459b-8e1f-15a18d002156" containerID="41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2" exitCode=2
Sep 17 18:06:20.047825 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.047696    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerDied","Data":"41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2"}
Sep 17 18:06:20.049357 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.049336    2586 generic.go:356] "Generic (PLEG): container finished" podID="65568231-b55d-4887-95b3-c908a9ebb295" containerID="ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e" exitCode=2
Sep 17 18:06:20.049357 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.049353    2586 generic.go:356] "Generic (PLEG): container finished" podID="65568231-b55d-4887-95b3-c908a9ebb295" containerID="3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2" exitCode=2
Sep 17 18:06:20.049528 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.049400    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"
Sep 17 18:06:20.049528 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.049410    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk" event={"ID":"65568231-b55d-4887-95b3-c908a9ebb295","Type":"ContainerDied","Data":"ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e"}
Sep 17 18:06:20.049528 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.049464    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk" event={"ID":"65568231-b55d-4887-95b3-c908a9ebb295","Type":"ContainerDied","Data":"3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2"}
Sep 17 18:06:20.049528 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.049485    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk" event={"ID":"65568231-b55d-4887-95b3-c908a9ebb295","Type":"ContainerDied","Data":"4dafe935c48a958f3ed9f44a5841761153d8af51333cc24f2b9461397c927a88"}
Sep 17 18:06:20.049528 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.049507    2586 scope.go:117] "RemoveContainer" containerID="ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e"
Sep 17 18:06:20.059024 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.059005    2586 scope.go:117] "RemoveContainer" containerID="3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2"
Sep 17 18:06:20.067359 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.067341    2586 scope.go:117] "RemoveContainer" containerID="ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e"
Sep 17 18:06:20.067662 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:06:20.067645    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e\": container with ID starting with ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e not found: ID does not exist" containerID="ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e"
Sep 17 18:06:20.067701 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.067672    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e"} err="failed to get container status \"ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e\": rpc error: code = NotFound desc = could not find container \"ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e\": container with ID starting with ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e not found: ID does not exist"
Sep 17 18:06:20.067701 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.067690    2586 scope.go:117] "RemoveContainer" containerID="3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2"
Sep 17 18:06:20.067934 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:06:20.067918    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2\": container with ID starting with 3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2 not found: ID does not exist" containerID="3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2"
Sep 17 18:06:20.067994 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.067940    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2"} err="failed to get container status \"3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2\": rpc error: code = NotFound desc = could not find container \"3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2\": container with ID starting with 3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2 not found: ID does not exist"
Sep 17 18:06:20.067994 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.067968    2586 scope.go:117] "RemoveContainer" containerID="ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e"
Sep 17 18:06:20.068243 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.068223    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e"} err="failed to get container status \"ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e\": rpc error: code = NotFound desc = could not find container \"ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e\": container with ID starting with ffb04d37f8426e65609cf38850f551966dbe59dd4d253ae8c3a867c38b99cb7e not found: ID does not exist"
Sep 17 18:06:20.068293 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.068246    2586 scope.go:117] "RemoveContainer" containerID="3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2"
Sep 17 18:06:20.068482 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.068463    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2"} err="failed to get container status \"3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2\": rpc error: code = NotFound desc = could not find container \"3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2\": container with ID starting with 3a7ab35cb9dd9269e9f6a0b3c94401bd4aae7c3f2c12130f127cc8b9b5da53b2 not found: ID does not exist"
Sep 17 18:06:20.073818 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.073792    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"]
Sep 17 18:06:20.080927 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.080906    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-raw-cipn-predictor-9774bf55d-cnzwk"]
Sep 17 18:06:20.819117 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:20.819071    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65568231-b55d-4887-95b3-c908a9ebb295" path="/var/lib/kubelet/pods/65568231-b55d-4887-95b3-c908a9ebb295/volumes"
Sep 17 18:06:21.551699 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:21.551655    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.45:8643/healthz\": dial tcp 10.134.0.45:8643: connect: connection refused"
Sep 17 18:06:24.819035 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:24.818992    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:06:24.819423 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:24.819298    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:06:25.077700 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:25.077612    2586 generic.go:356] "Generic (PLEG): container finished" podID="566006e8-90dc-459b-8e1f-15a18d002156" containerID="89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30" exitCode=0
Sep 17 18:06:25.077700 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:25.077653    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerDied","Data":"89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30"}
Sep 17 18:06:26.551352 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:26.551310    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.45:8643/healthz\": dial tcp 10.134.0.45:8643: connect: connection refused"
Sep 17 18:06:31.550816 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:31.550777    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.45:8643/healthz\": dial tcp 10.134.0.45:8643: connect: connection refused"
Sep 17 18:06:31.551226 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:31.550900    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:06:34.819010 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:34.818942    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:06:34.819420 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:34.819266    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:06:35.652433 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:35.652401    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:35.683199 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:35.683169    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:35.695614 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:35.695579    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:35.708541 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:35.708516    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:36.551836 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:36.551799    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.45:8643/healthz\": dial tcp 10.134.0.45:8643: connect: connection refused"
Sep 17 18:06:36.573457 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:36.573429    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:36.587845 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:36.587810    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:36.600299 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:36.600272    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:36.617787 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:36.617754    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:37.490815 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:37.490786    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:37.506724 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:37.506665    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:37.523019 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:37.522991    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:37.535356 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:37.535332    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:38.381640 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:38.381610    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:38.396192 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:38.396163    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:38.408748 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:38.408723    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:38.421087 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:38.421065    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:39.253396 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:39.253373    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:39.271213 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:39.271185    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:39.287327 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:39.287300    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:39.300697 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:39.300676    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:40.150928 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:40.150892    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:40.165895 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:40.165866    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:40.178602 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:40.178555    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:40.191231 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:40.191201    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:41.027329 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:41.027303    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:41.041604 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:41.041576    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:41.058012 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:41.057984    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:41.070146 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:41.070118    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:41.551300 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:41.551246    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.45:8643/healthz\": dial tcp 10.134.0.45:8643: connect: connection refused"
Sep 17 18:06:41.931571 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:41.931486    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:41.947064 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:41.947034    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:41.958664 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:41.958641    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:41.970654 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:41.970631    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:42.813680 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:42.813644    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:42.831322 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:42.831273    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:42.843756 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:42.843730    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:42.856964 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:42.856934    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:43.728170 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:43.728129    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:43.743508 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:43.743480    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:43.758622 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:43.758598    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:43.772921 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:43.772899    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:44.629737 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:44.629711    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:44.643436 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:44.643413    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:44.656158 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:44.656130    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:44.670023 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:44.670000    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:44.819244 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:44.819204    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.45:8080: connect: connection refused"
Sep 17 18:06:44.819449 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:44.819334    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:06:44.819706 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:44.819682    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 18:06:44.819802 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:44.819784    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:06:45.503228 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:45.503201    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:45.521399 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:45.521375    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:45.547463 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:45.547434    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:45.575598 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:45.575567    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:46.464682 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:46.464658    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:46.480333 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:46.480301    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:46.494810 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:46.494781    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:46.507443 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:46.507417    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:46.551134 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:46.551091    2586 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.45:8643/healthz\": dial tcp 10.134.0.45:8643: connect: connection refused"
Sep 17 18:06:47.435414 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:47.435371    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:47.451342 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:47.451307    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:47.464229 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:47.464200    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:47.476293 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:47.476267    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:48.377907 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:48.377880    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kserve-container/0.log"
Sep 17 18:06:48.393616 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:48.393590    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/kube-rbac-proxy/0.log"
Sep 17 18:06:48.406687 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:48.406662    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/agent/0.log"
Sep 17 18:06:48.418458 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:48.418415    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd_566006e8-90dc-459b-8e1f-15a18d002156/storage-initializer/0.log"
Sep 17 18:06:49.607520 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.607493    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:06:49.709410 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.709319    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-cabundle-cert\") pod \"566006e8-90dc-459b-8e1f-15a18d002156\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") "
Sep 17 18:06:49.709410 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.709403    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/566006e8-90dc-459b-8e1f-15a18d002156-proxy-tls\") pod \"566006e8-90dc-459b-8e1f-15a18d002156\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") "
Sep 17 18:06:49.709657 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.709430    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/566006e8-90dc-459b-8e1f-15a18d002156-kserve-provision-location\") pod \"566006e8-90dc-459b-8e1f-15a18d002156\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") "
Sep 17 18:06:49.709657 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.709469    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd44q\" (UniqueName: \"kubernetes.io/projected/566006e8-90dc-459b-8e1f-15a18d002156-kube-api-access-zd44q\") pod \"566006e8-90dc-459b-8e1f-15a18d002156\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") "
Sep 17 18:06:49.709657 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.709487    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-kube-rbac-proxy-sar-config\") pod \"566006e8-90dc-459b-8e1f-15a18d002156\" (UID: \"566006e8-90dc-459b-8e1f-15a18d002156\") "
Sep 17 18:06:49.709814 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.709734    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "566006e8-90dc-459b-8e1f-15a18d002156" (UID: "566006e8-90dc-459b-8e1f-15a18d002156"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:06:49.709865 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.709812    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/566006e8-90dc-459b-8e1f-15a18d002156-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "566006e8-90dc-459b-8e1f-15a18d002156" (UID: "566006e8-90dc-459b-8e1f-15a18d002156"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:06:49.709903 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.709868    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "566006e8-90dc-459b-8e1f-15a18d002156" (UID: "566006e8-90dc-459b-8e1f-15a18d002156"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:06:49.711629 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.711602    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/566006e8-90dc-459b-8e1f-15a18d002156-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "566006e8-90dc-459b-8e1f-15a18d002156" (UID: "566006e8-90dc-459b-8e1f-15a18d002156"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:06:49.711802 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.711786    2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/566006e8-90dc-459b-8e1f-15a18d002156-kube-api-access-zd44q" (OuterVolumeSpecName: "kube-api-access-zd44q") pod "566006e8-90dc-459b-8e1f-15a18d002156" (UID: "566006e8-90dc-459b-8e1f-15a18d002156"). InnerVolumeSpecName "kube-api-access-zd44q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:06:49.810521 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.810483    2586 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/566006e8-90dc-459b-8e1f-15a18d002156-proxy-tls\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:06:49.810521 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.810512    2586 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/566006e8-90dc-459b-8e1f-15a18d002156-kserve-provision-location\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:06:49.810521 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.810523    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd44q\" (UniqueName: \"kubernetes.io/projected/566006e8-90dc-459b-8e1f-15a18d002156-kube-api-access-zd44q\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:06:49.810758 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.810534    2586 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-kube-rbac-proxy-sar-config\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:06:49.810758 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:49.810542    2586 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/566006e8-90dc-459b-8e1f-15a18d002156-cabundle-cert\") on node \"ip-10-0-134-49.ec2.internal\" DevicePath \"\""
Sep 17 18:06:50.211511 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.211468    2586 generic.go:356] "Generic (PLEG): container finished" podID="566006e8-90dc-459b-8e1f-15a18d002156" containerID="c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd" exitCode=0
Sep 17 18:06:50.211678 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.211530    2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"
Sep 17 18:06:50.211678 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.211549    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerDied","Data":"c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd"}
Sep 17 18:06:50.211678 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.211621    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd" event={"ID":"566006e8-90dc-459b-8e1f-15a18d002156","Type":"ContainerDied","Data":"9b08588abb98195f24eb435a6de374ccd15bc0d868e7833048080f942645c7a5"}
Sep 17 18:06:50.211678 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.211652    2586 scope.go:117] "RemoveContainer" containerID="c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd"
Sep 17 18:06:50.220767 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.220752    2586 scope.go:117] "RemoveContainer" containerID="41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2"
Sep 17 18:06:50.228324 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.228307    2586 scope.go:117] "RemoveContainer" containerID="89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30"
Sep 17 18:06:50.236272 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.236247    2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"]
Sep 17 18:06:50.236456 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.236434    2586 scope.go:117] "RemoveContainer" containerID="de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59"
Sep 17 18:06:50.242205 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.242184    2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-logger-raw-cipn-predictor-778ff5f68f-45rhd"]
Sep 17 18:06:50.245202 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.245170    2586 scope.go:117] "RemoveContainer" containerID="c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd"
Sep 17 18:06:50.245520 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:06:50.245502    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd\": container with ID starting with c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd not found: ID does not exist" containerID="c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd"
Sep 17 18:06:50.245590 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.245534    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd"} err="failed to get container status \"c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd\": rpc error: code = NotFound desc = could not find container \"c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd\": container with ID starting with c458b61df7becd42bdb9c5197c9ef9179817a6fb6cc40125f8ef213064d286fd not found: ID does not exist"
Sep 17 18:06:50.245590 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.245562    2586 scope.go:117] "RemoveContainer" containerID="41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2"
Sep 17 18:06:50.245820 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:06:50.245805    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2\": container with ID starting with 41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2 not found: ID does not exist" containerID="41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2"
Sep 17 18:06:50.245883 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.245829    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2"} err="failed to get container status \"41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2\": rpc error: code = NotFound desc = could not find container \"41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2\": container with ID starting with 41fc4ca69879c7b851b07379a2e28465cc513688690bf53ac795da93c54fdbc2 not found: ID does not exist"
Sep 17 18:06:50.245883 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.245849    2586 scope.go:117] "RemoveContainer" containerID="89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30"
Sep 17 18:06:50.246110 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:06:50.246092    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30\": container with ID starting with 89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30 not found: ID does not exist" containerID="89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30"
Sep 17 18:06:50.246157 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.246115    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30"} err="failed to get container status \"89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30\": rpc error: code = NotFound desc = could not find container \"89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30\": container with ID starting with 89a310635c1674e4ecf6cbdce0bcda5db5d2b5ae5a29aa480e740b487ac41d30 not found: ID does not exist"
Sep 17 18:06:50.246157 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.246128    2586 scope.go:117] "RemoveContainer" containerID="de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59"
Sep 17 18:06:50.246344 ip-10-0-134-49 kubenswrapper[2586]: E0917 18:06:50.246331    2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59\": container with ID starting with de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59 not found: ID does not exist" containerID="de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59"
Sep 17 18:06:50.246394 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.246347    2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59"} err="failed to get container status \"de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59\": rpc error: code = NotFound desc = could not find container \"de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59\": container with ID starting with de3267f5b30ac90f44537677ab6769a24e64d64075d35d71146ac89a18dd7b59 not found: ID does not exist"
Sep 17 18:06:50.818659 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:50.818623    2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="566006e8-90dc-459b-8e1f-15a18d002156" path="/var/lib/kubelet/pods/566006e8-90dc-459b-8e1f-15a18d002156/volumes"
Sep 17 18:06:54.888899 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:54.888852    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pws9z_0dcd31c7-6f39-4ed1-83b5-08dc2a872864/global-pull-secret-syncer/0.log"
Sep 17 18:06:55.063676 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:55.063638    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xjj6f_40d26571-4278-4f4d-8a25-c9c5657bf46b/konnectivity-agent/0.log"
Sep 17 18:06:55.091417 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:55.091386    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-49.ec2.internal_834198684fe123bac38328944a6fc1ae/haproxy/0.log"
Sep 17 18:06:59.106216 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.106190    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13d22495-ca29-44ff-b512-f966a68f04a8/alertmanager/0.log"
Sep 17 18:06:59.139061 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.139032    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13d22495-ca29-44ff-b512-f966a68f04a8/config-reloader/0.log"
Sep 17 18:06:59.173368 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.173338    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13d22495-ca29-44ff-b512-f966a68f04a8/kube-rbac-proxy-web/0.log"
Sep 17 18:06:59.215378 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.215354    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13d22495-ca29-44ff-b512-f966a68f04a8/kube-rbac-proxy/0.log"
Sep 17 18:06:59.243541 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.243515    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13d22495-ca29-44ff-b512-f966a68f04a8/kube-rbac-proxy-metric/0.log"
Sep 17 18:06:59.278883 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.278850    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13d22495-ca29-44ff-b512-f966a68f04a8/prom-label-proxy/0.log"
Sep 17 18:06:59.309896 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.309872    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13d22495-ca29-44ff-b512-f966a68f04a8/init-config-reloader/0.log"
Sep 17 18:06:59.491768 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.491681    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-84dd99b89-v2fmq_202acb0f-fac8-4034-bd20-bd6fe8e5a4b2/metrics-server/0.log"
Sep 17 18:06:59.521370 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.521336    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-kw76k_fbbe41d7-7f3b-417e-8d3d-4d091f5b2998/monitoring-plugin/0.log"
Sep 17 18:06:59.781117 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.781092    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-txhwc_e91fb231-2326-404b-92f1-b36a65d4f665/node-exporter/0.log"
Sep 17 18:06:59.820570 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.820542    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-txhwc_e91fb231-2326-404b-92f1-b36a65d4f665/kube-rbac-proxy/0.log"
Sep 17 18:06:59.855118 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.855095    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-txhwc_e91fb231-2326-404b-92f1-b36a65d4f665/init-textfile/0.log"
Sep 17 18:06:59.892137 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.892113    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4m7q9_42d4e790-3784-44bc-9050-1a296e108069/kube-rbac-proxy-main/0.log"
Sep 17 18:06:59.928009 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.927974    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4m7q9_42d4e790-3784-44bc-9050-1a296e108069/kube-rbac-proxy-self/0.log"
Sep 17 18:06:59.963166 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:06:59.963137    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4m7q9_42d4e790-3784-44bc-9050-1a296e108069/openshift-state-metrics/0.log"
Sep 17 18:07:00.344199 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:00.344172    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f87595769-4fngg_76496c3c-ecaa-4806-8c3a-f183e13ec9a8/telemeter-client/0.log"
Sep 17 18:07:00.372510 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:00.372481    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f87595769-4fngg_76496c3c-ecaa-4806-8c3a-f183e13ec9a8/reload/0.log"
Sep 17 18:07:00.404873 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:00.404843    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f87595769-4fngg_76496c3c-ecaa-4806-8c3a-f183e13ec9a8/kube-rbac-proxy/0.log"
Sep 17 18:07:00.462517 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:00.462489    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4bd45d6d-xs8m6_f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0/thanos-query/0.log"
Sep 17 18:07:00.498114 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:00.498086    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4bd45d6d-xs8m6_f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0/kube-rbac-proxy-web/0.log"
Sep 17 18:07:00.539810 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:00.539788    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4bd45d6d-xs8m6_f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0/kube-rbac-proxy/0.log"
Sep 17 18:07:00.576145 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:00.576123    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4bd45d6d-xs8m6_f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0/prom-label-proxy/0.log"
Sep 17 18:07:00.605516 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:00.605358    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4bd45d6d-xs8m6_f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0/kube-rbac-proxy-rules/0.log"
Sep 17 18:07:00.642113 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:00.642082    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c4bd45d6d-xs8m6_f47ec31f-dd0f-4bf7-bbd9-7b3c47c043b0/kube-rbac-proxy-metrics/0.log"
Sep 17 18:07:01.891585 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:01.891552    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-lgq2g_519129db-a7b4-4a8b-97e4-884bc0cfbd5d/networking-console-plugin/0.log"
Sep 17 18:07:02.432612 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.432581    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/1.log"
Sep 17 18:07:02.441234 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.441204    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-m8nlf_8cfa90e4-2193-4b0d-ae07-880f3dc27c4d/console-operator/2.log"
Sep 17 18:07:02.927466 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.927433    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f67467b9f-2m2qn_1e0cf574-b3e4-483a-8398-d9f7e7ca5d5a/console/0.log"
Sep 17 18:07:02.985868 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.985837    2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"]
Sep 17 18:07:02.986240 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986227    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container"
Sep 17 18:07:02.986286 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986242    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container"
Sep 17 18:07:02.986286 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986255    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent"
Sep 17 18:07:02.986286 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986262    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent"
Sep 17 18:07:02.986286 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986272    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="storage-initializer"
Sep 17 18:07:02.986286 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986277    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="storage-initializer"
Sep 17 18:07:02.986286 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986287    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65568231-b55d-4887-95b3-c908a9ebb295" containerName="kserve-container"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986293    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="65568231-b55d-4887-95b3-c908a9ebb295" containerName="kserve-container"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986301    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986306    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986317    2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65568231-b55d-4887-95b3-c908a9ebb295" containerName="kube-rbac-proxy"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986323    2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="65568231-b55d-4887-95b3-c908a9ebb295" containerName="kube-rbac-proxy"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986386    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="agent"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986394    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kserve-container"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986401    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="566006e8-90dc-459b-8e1f-15a18d002156" containerName="kube-rbac-proxy"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986406    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="65568231-b55d-4887-95b3-c908a9ebb295" containerName="kserve-container"
Sep 17 18:07:02.986479 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.986412    2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="65568231-b55d-4887-95b3-c908a9ebb295" containerName="kube-rbac-proxy"
Sep 17 18:07:02.990542 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.990525    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:02.993061 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.993032    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlfjm\"/\"kube-root-ca.crt\""
Sep 17 18:07:02.993214 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.993069    2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wlfjm\"/\"default-dockercfg-v2w9r\""
Sep 17 18:07:02.993821 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:02.993805    2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlfjm\"/\"openshift-service-ca.crt\""
Sep 17 18:07:03.006074 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.006035    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"]
Sep 17 18:07:03.031750 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.031713    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp25v\" (UniqueName: \"kubernetes.io/projected/64100f6e-b778-44bb-ab5f-89e720dececc-kube-api-access-vp25v\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.031750 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.031753    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-podres\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.031984 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.031886    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-lib-modules\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.031984 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.031918    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-proc\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.031984 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.031938    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-sys\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.132899 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.132860    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-lib-modules\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.132899 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.132899    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-proc\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.133111 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.132914    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-sys\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.133111 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.132980    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp25v\" (UniqueName: \"kubernetes.io/projected/64100f6e-b778-44bb-ab5f-89e720dececc-kube-api-access-vp25v\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.133111 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.133005    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-podres\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.133111 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.133027    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-proc\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.133111 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.133039    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-sys\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.133111 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.133085    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-lib-modules\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.133319 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.133128    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/64100f6e-b778-44bb-ab5f-89e720dececc-podres\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.141633 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.141613    2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp25v\" (UniqueName: \"kubernetes.io/projected/64100f6e-b778-44bb-ab5f-89e720dececc-kube-api-access-vp25v\") pod \"perf-node-gather-daemonset-9tphn\" (UID: \"64100f6e-b778-44bb-ab5f-89e720dececc\") " pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.304331 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.304295    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:03.578002 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.577947    2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"]
Sep 17 18:07:03.580002 ip-10-0-134-49 kubenswrapper[2586]: W0917 18:07:03.579977    2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod64100f6e_b778_44bb_ab5f_89e720dececc.slice/crio-ca27240f5d89478d39919efbcd1a3223c99fc18e93fdfe9f490302b76f40c17c WatchSource:0}: Error finding container ca27240f5d89478d39919efbcd1a3223c99fc18e93fdfe9f490302b76f40c17c: Status 404 returned error can't find the container with id ca27240f5d89478d39919efbcd1a3223c99fc18e93fdfe9f490302b76f40c17c
Sep 17 18:07:03.599726 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:03.599700    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-575dk_44aafdf2-ce1d-48b0-af0b-258a670bf634/volume-data-source-validator/0.log"
Sep 17 18:07:04.282348 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:04.282312    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn" event={"ID":"64100f6e-b778-44bb-ab5f-89e720dececc","Type":"ContainerStarted","Data":"298ca7be70991f6371cb80d060260f2929612d631b96127fdde52e1bc1463161"}
Sep 17 18:07:04.282754 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:04.282379    2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn" event={"ID":"64100f6e-b778-44bb-ab5f-89e720dececc","Type":"ContainerStarted","Data":"ca27240f5d89478d39919efbcd1a3223c99fc18e93fdfe9f490302b76f40c17c"}
Sep 17 18:07:04.282754 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:04.282533    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:04.308046 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:04.307986    2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn" podStartSLOduration=2.307944958 podStartE2EDuration="2.307944958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:07:04.307161181 +0000 UTC m=+1985.634594285" watchObservedRunningTime="2026-09-17 18:07:04.307944958 +0000 UTC m=+1985.635378062"
Sep 17 18:07:04.695746 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:04.695665    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5n874_5ceee1e7-8072-46f3-8122-49b19e223845/dns/0.log"
Sep 17 18:07:04.726139 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:04.726103    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5n874_5ceee1e7-8072-46f3-8122-49b19e223845/kube-rbac-proxy/0.log"
Sep 17 18:07:04.964817 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:04.964732    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g9ckj_333ce5a7-0e31-40c2-9929-b855616daf6a/dns-node-resolver/0.log"
Sep 17 18:07:05.517783 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:05.517752    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6f8cb86bbd-6hbsp_916d7461-7312-45d1-80fe-9d83fc853a45/registry/0.log"
Sep 17 18:07:05.662278 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:05.662250    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kkv5p_64eb3efe-305b-4efd-bcc1-1381b298e187/node-ca/0.log"
Sep 17 18:07:07.078235 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:07.078206    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2vzr4_8bdc8b8b-b61f-4bd7-9e3f-0bca2621323e/serve-healthcheck-canary/0.log"
Sep 17 18:07:07.869521 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:07.869493    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stkx7_32b3dc76-eec7-4aa0-859c-816db4eb1f20/kube-rbac-proxy/0.log"
Sep 17 18:07:07.922903 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:07.922875    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stkx7_32b3dc76-eec7-4aa0-859c-816db4eb1f20/exporter/0.log"
Sep 17 18:07:07.963128 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:07.963100    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stkx7_32b3dc76-eec7-4aa0-859c-816db4eb1f20/extractor/0.log"
Sep 17 18:07:10.298326 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:10.298302    2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wlfjm/perf-node-gather-daemonset-9tphn"
Sep 17 18:07:10.602765 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:10.602695    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-s8vw7_433414f1-374c-4527-a2e8-43f0fe209f06/server/0.log"
Sep 17 18:07:10.806549 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:10.806509    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-7b966d7984-zfpdb_2e539c8f-08c0-4fcb-b5c3-b71cc63734bb/manager/0.log"
Sep 17 18:07:10.932365 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:10.932282    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-drlsl_d60e2106-c0db-4463-8fea-ad05fddb2371/seaweedfs/0.log"
Sep 17 18:07:16.659932 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:16.659896    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-vzdgh_f921a0f5-7305-48c6-a425-9ca3aa783087/kube-storage-version-migrator-operator/1.log"
Sep 17 18:07:16.661713 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:16.661674    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-vzdgh_f921a0f5-7305-48c6-a425-9ca3aa783087/kube-storage-version-migrator-operator/0.log"
Sep 17 18:07:18.157980 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.157929    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v7xp5_8b6bcc9f-37b4-4bf3-8460-7182df774ca5/kube-multus-additional-cni-plugins/0.log"
Sep 17 18:07:18.191403 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.191375    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v7xp5_8b6bcc9f-37b4-4bf3-8460-7182df774ca5/egress-router-binary-copy/0.log"
Sep 17 18:07:18.221652 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.221622    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v7xp5_8b6bcc9f-37b4-4bf3-8460-7182df774ca5/cni-plugins/0.log"
Sep 17 18:07:18.255764 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.255733    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v7xp5_8b6bcc9f-37b4-4bf3-8460-7182df774ca5/bond-cni-plugin/0.log"
Sep 17 18:07:18.285975 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.285939    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v7xp5_8b6bcc9f-37b4-4bf3-8460-7182df774ca5/routeoverride-cni/0.log"
Sep 17 18:07:18.317067 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.317035    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v7xp5_8b6bcc9f-37b4-4bf3-8460-7182df774ca5/whereabouts-cni-bincopy/0.log"
Sep 17 18:07:18.348920 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.348863    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v7xp5_8b6bcc9f-37b4-4bf3-8460-7182df774ca5/whereabouts-cni/0.log"
Sep 17 18:07:18.437829 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.437745    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wvvrl_604f5e26-05da-4f91-8248-26987e9682ac/kube-multus/0.log"
Sep 17 18:07:18.461267 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.461239    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d5rkr_53437e34-2e7d-4e34-a8b6-6886e50a8463/network-metrics-daemon/0.log"
Sep 17 18:07:18.487324 ip-10-0-134-49 kubenswrapper[2586]: I0917 18:07:18.487296    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d5rkr_53437e34-2e7d-4e34-a8b6-6886e50a8463/kube-rbac-proxy/0.log"