Sep 17 18:39:07.353726 ip-10-0-135-229 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 18:39:10.973477 ip-10-0-135-229 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 18:39:10.973477 ip-10-0-135-229 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 18:39:10.973477 ip-10-0-135-229 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 18:39:10.973477 ip-10-0-135-229 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 18:39:10.973477 ip-10-0-135-229 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 18:39:10.974212 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.973561    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 18:39:10.978930 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978913    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 18:39:10.978930 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978931    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978935    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978938    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978941    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978945    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978948    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978951    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978954    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978959    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978963    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978967    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978970    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978973    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978976    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978979    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978982    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978985    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978988    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978991    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 18:39:10.979003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978994    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.978997    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979001    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979003    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979008    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979012    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979017    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979021    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979025    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979028    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979031    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979034    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979037    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979040    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979043    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979047    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979050    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979053    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979056    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 18:39:10.979522 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979060    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979062    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979065    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979068    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979071    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979074    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979076    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979079    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979082    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979084    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979087    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979090    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979093    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979096    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979099    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979102    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979105    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979108    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979111    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979114    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 18:39:10.980041 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979116    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979119    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979122    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979125    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979127    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979130    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979133    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979135    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979138    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979141    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979143    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979146    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979149    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979152    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979154    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979158    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979161    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979164    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979167    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979170    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979173    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 18:39:10.980588 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979175    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979179    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979182    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979184    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979187    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979190    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979194    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979197    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979200    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979203    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979206    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979208    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979211    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979214    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979217    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979219    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979222    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979225    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.979227    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981116    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 18:39:10.981175 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981124    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981129    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981133    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981136    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981145    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981149    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981152    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981155    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981157    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981160    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981163    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981166    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981168    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981171    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981174    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981177    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981180    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981182    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981186    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 18:39:10.981725 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981189    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981192    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981194    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981197    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981200    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981202    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981205    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981208    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981211    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981213    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981216    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981219    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981221    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981224    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981227    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981231    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981233    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981236    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981240    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981243    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 18:39:10.982241 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981246    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981248    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981251    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981254    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981257    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981259    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981262    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981265    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981269    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981274    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981277    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981280    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981282    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981285    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981288    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981290    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981293    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981296    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981298    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 18:39:10.982815 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981301    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981304    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981307    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981310    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981313    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981316    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981320    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981323    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981326    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981330    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981332    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981335    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981338    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981341    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981344    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981346    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981349    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981352    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981355    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 18:39:10.983316 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981357    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981360    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981363    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981366    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981383    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981386    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981390    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981393    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981396    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981399    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981401    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981405    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981407    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981411    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981413    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981416    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981419    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981422    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981425    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981427    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 18:39:10.983850 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981430    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981833    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981839    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981842    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981845    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981849    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981852    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981855    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981858    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981860    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981863    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981866    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981869    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981872    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981875    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981877    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981880    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981883    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981886    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981889    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 18:39:10.984410 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981891    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981894    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981897    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981900    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981902    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981906    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981909    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981912    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981915    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981918    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981921    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981924    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981927    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981930    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981933    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981935    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981938    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981941    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981944    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981947    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 18:39:10.984943 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981949    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981952    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981955    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981958    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981960    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981963    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981968    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981971    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981975    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981978    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981981    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981984    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981987    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981989    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981992    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.981996    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982000    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982003    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982006    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 18:39:10.985487 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982009    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982013    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982016    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982019    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982021    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982024    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982027    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982029    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982032    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982035    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982038    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982040    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982044    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982047    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982049    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982052    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982055    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982058    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982061    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982064    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 18:39:10.985996 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982066    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982069    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982072    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982075    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982077    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982080    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982085    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982089    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982092    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982095    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982098    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982101    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982104    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982107    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982112    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982115    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982118    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982121    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982123    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 18:39:10.986584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982126    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982129    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982211    2575 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982258    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982268    2575 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982272    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982277    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982281    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982286    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982290    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982294    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982297    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982302    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982307    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982312    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982316    2575 flags.go:64] FLAG: --cgroup-root=""
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982319    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982323    2575 flags.go:64] FLAG: --client-ca-file=""
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982326    2575 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982329    2575 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982333    2575 flags.go:64] FLAG: --cluster-domain=""
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982337    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982340    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982344    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 18:39:10.987108 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982348    2575 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982352    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982356    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982361    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982365    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982381    2575 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982385    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982388    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982392    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982395    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982399    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982403    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982406    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982410    2575 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982413    2575 flags.go:64] FLAG: --enable-server="true"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982417    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982423    2575 flags.go:64] FLAG: --event-burst="100"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982426    2575 flags.go:64] FLAG: --event-qps="50"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982429    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982433    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982436    2575 flags.go:64] FLAG: --eviction-hard=""
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982440    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982443    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982446    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982449    2575 flags.go:64] FLAG: --eviction-soft=""
Sep 17 18:39:10.987744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982452    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982455    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982459    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982462    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982466    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982469    2575 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982472    2575 flags.go:64] FLAG: --feature-gates=""
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982476    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982480    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982483    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982489    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982500    2575 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982504    2575 flags.go:64] FLAG: --help="false"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982507    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-135-229.ec2.internal"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982511    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982515    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982518    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982521    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982525    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982529    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982532    2575 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982535    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982538    2575 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 18:39:10.988419 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982544    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982547    2575 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982550    2575 flags.go:64] FLAG: --kube-reserved=""
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982553    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982556    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982560    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982563    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982566    2575 flags.go:64] FLAG: --lock-file=""
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982569    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982573    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982576    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982582    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982585    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982588    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982592    2575 flags.go:64] FLAG: --logging-format="text"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982595    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982598    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982602    2575 flags.go:64] FLAG: --manifest-url=""
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982605    2575 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982611    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982614    2575 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982618    2575 flags.go:64] FLAG: --max-pods="110"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982622    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982625    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982628    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 18:39:10.989058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982631    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982634    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982637    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982640    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982647    2575 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982651    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982654    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982659    2575 flags.go:64] FLAG: --pod-cidr=""
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982663    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982669    2575 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982672    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982675    2575 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982678    2575 flags.go:64] FLAG: --port="10250"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982682    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982685    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-044c74f141f462d74"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982688    2575 flags.go:64] FLAG: --qos-reserved=""
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982691    2575 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982695    2575 flags.go:64] FLAG: --register-node="true"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982698    2575 flags.go:64] FLAG: --register-with-taints=""
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982702    2575 flags.go:64] FLAG: --registry-burst="10"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982705    2575 flags.go:64] FLAG: --registry-qps="5"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982708    2575 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982711    2575 flags.go:64] FLAG: --reserved-memory=""
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982720    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982724    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 18:39:10.989751 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982727    2575 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982730    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982735    2575 flags.go:64] FLAG: --runonce="false"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982738    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982741    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982745    2575 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982748    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982752    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982755    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982759    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982762    2575 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982765    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982768    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982771    2575 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982776    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982780    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982783    2575 flags.go:64] FLAG: --system-cgroups=""
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982787    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982792    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982795    2575 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982798    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982803    2575 flags.go:64] FLAG: --tls-min-version=""
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982806    2575 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982809    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982812    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 18:39:10.990464 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982815    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982819    2575 flags.go:64] FLAG: --v="2"
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982824    2575 flags.go:64] FLAG: --version="false"
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982828    2575 flags.go:64] FLAG: --vmodule=""
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982832    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.982835    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982970    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982974    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982978    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982982    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982986    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982989    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982993    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.982996    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983000    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983003    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983006    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983009    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983013    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983016    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983019    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 18:39:10.991168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983022    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983027    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983031    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983035    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983038    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983041    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983044    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983047    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983049    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983052    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983055    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983058    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983060    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983063    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983066    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983069    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983071    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983074    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983077    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983080    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 18:39:10.991763 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983084    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983087    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983090    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983093    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983095    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983099    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983101    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983104    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983107    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983110    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983113    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983115    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983118    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983121    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983124    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983126    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983130    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983132    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983136    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983138    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 18:39:10.992291 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983141    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983144    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983147    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983150    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983153    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983155    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983158    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983161    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983164    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983167    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983170    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983172    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983177    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983179    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983182    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983185    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983188    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983191    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983194    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983197    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 18:39:10.992837 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983200    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983203    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983205    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983208    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983212    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983231    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983236    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983239    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983242    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983246    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983249    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983252    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983254    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983257    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983260    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983263    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983266    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983268    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983271    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 18:39:10.993383 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983274    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983277    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983280    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983283    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.983286    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.983295    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.992465    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.992483    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.992503    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.992510    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992581    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992587    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992590    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992594    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992597    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 18:39:10.993949 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992600    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992603    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992606    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992610    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992613    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992623    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992627    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992637    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992640    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992643    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992648    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992652    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992657    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992661    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992664    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992667    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992670    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992673    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992676    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992678    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 18:39:10.994380 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992681    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992684    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992687    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992690    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992695    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992699    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992703    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992706    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992710    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992713    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992716    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992719    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992723    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992726    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992738    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992742    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992746    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992749    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992752    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 18:39:10.994923 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992755    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992765    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992768    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992771    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992774    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992777    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992780    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992782    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992786    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992789    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992791    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992794    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992797    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992800    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992803    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992805    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992808    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992812    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992817    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992821    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 18:39:10.995443 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992825    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992830    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992833    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992836    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992839    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992842    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992845    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992848    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992851    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992853    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992856    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992859    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992862    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992865    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992876    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992879    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992883    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992886    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992891    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 18:39:10.995981 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992894    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992897    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992901    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992906    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992911    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992916    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992919    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992922    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992925    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992928    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992931    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992934    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992937    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992940    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992943    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 18:39:10.996488 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.992946    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.992952    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993144    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993150    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993156    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993161    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993165    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993169    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993172    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993175    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993178    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993181    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993183    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993193    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993196    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 18:39:10.996990 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993199    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993201    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993204    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993207    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993209    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993212    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993215    2575 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993217    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993220    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993223    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993226    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993229    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993232    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993237    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993241    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993246    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993250    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993253    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993256    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993259    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 18:39:10.997450 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993262    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993265    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993267    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993270    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993273    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993276    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993279    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993281    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993284    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993287    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993289    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993302    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993306    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993310    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993315    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993319    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993324    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993328    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993331    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993334    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 18:39:10.997993 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993337    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993339    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993342    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993345    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993348    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993351    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993354    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993357    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993360    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993363    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993365    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993380    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993385    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993391    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993397    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993401    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993405    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993408    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993411    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 18:39:10.998546 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993414    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993417    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993419    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993422    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993425    2575 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993435    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993438    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993441    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993443    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993446    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993449    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993452    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993454    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993457    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993461    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993465    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993468    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993473    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993478    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 18:39:10.999050 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993483    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993488    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993492    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993495    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993498    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993501    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993504    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:10.993507    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.993512    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.993635    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.996330    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.997252    2575 server.go:1019] "Starting client certificate rotation"
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.997405    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 18:39:10.999564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:10.997447    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 18:39:11.000883 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.000867    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 18:39:11.015078 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.015055    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 18:39:11.021522 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.021504    2575 log.go:25] "Validated CRI v1 runtime API"
Sep 17 18:39:11.023985 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.023966    2575 log.go:25] "Validated CRI v1 image API"
Sep 17 18:39:11.024887 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.024871    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 18:39:11.027410 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.027368    2575 fs.go:135] Filesystem UUIDs: map[0b3bd4bf-309e-4131-bf21-1b26c6389aa8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ec4ff344-6b89-49e2-9484-8d7c3a64cf43:/dev/nvme0n1p4]
Sep 17 18:39:11.027462 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.027411    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 18:39:11.032134 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.032011    2575 manager.go:216] Machine: {Timestamp:2026-09-17 18:39:11.031505477 +0000 UTC m=+2.103465499 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097186 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f35ed6b5b64a1e203faf597273a08 SystemUUID:ec2f35ed-6b5b-64a1-e203-faf597273a08 BootID:6fb150ed-0b3a-4d34-8531-2fa37c051889 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ee:a3:82:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ee:a3:82:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:58:f9:d4:88:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 18:39:11.032134 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.032120    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 18:39:11.032262 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.032232    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 18:39:11.033802 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.033784    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 18:39:11.034217 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.034198    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 18:39:11.034356 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.034222    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-229.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 18:39:11.036029 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.036015    2575 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 18:39:11.036100 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.036033    2575 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 18:39:11.036100 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.036041    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 18:39:11.036100 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.036052    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 18:39:11.036187 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.036126    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 18:39:11.039913 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.039900    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 18:39:11.040032 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.040022    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 18:39:11.040073 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.040053    2575 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 18:39:11.040073 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.040064    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 18:39:11.040149 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.040079    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 18:39:11.040149 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.040105    2575 kubelet.go:398] "Adding apiserver pod source"
Sep 17 18:39:11.040149 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.040114    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 18:39:11.040483 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.040471    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 18:39:11.040533 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.040493    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 18:39:11.042823 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.042804    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 18:39:11.046367 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.046351    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 18:39:11.046456 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.046401    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 18:39:11.047677 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047664    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 18:39:11.047728 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047681    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 18:39:11.047728 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047687    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 18:39:11.047728 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047700    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 18:39:11.047728 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047709    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 18:39:11.047728 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047714    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 18:39:11.047728 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047728    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 18:39:11.047907 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047734    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 18:39:11.047907 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047740    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 18:39:11.047907 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047747    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 18:39:11.047907 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047760    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 18:39:11.047907 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047765    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 18:39:11.047907 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047790    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 18:39:11.047907 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.047800    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 18:39:11.055621 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.055598    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-229.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 18:39:11.055738 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.055654    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 18:39:11.055738 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.055712    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 18:39:11.056088 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.056073    2575 server.go:1268] "Started kubelet"
Sep 17 18:39:11.056238 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.056172    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 18:39:11.056328 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.056221    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 18:39:11.056450 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.056428    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 18:39:11.057070 ip-10-0-135-229 systemd[1]: Started Kubernetes Kubelet.
Sep 17 18:39:11.057782 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.057749    2575 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 18:39:11.060753 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.060735    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 18:39:11.062532 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.062511    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 18:39:11.064600 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.064585    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-55ntl"
Sep 17 18:39:11.067989 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.067976    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 18:39:11.068057 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.067991    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 18:39:11.068057 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.068029    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.068673 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.068657    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 18:39:11.068673 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.068663    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 18:39:11.068803 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.068677    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 18:39:11.068803 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.068768    2575 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 18:39:11.068803 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.068777    2575 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 18:39:11.069202 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.069129    2575 factory.go:55] Registering systemd factory
Sep 17 18:39:11.069202 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.069148    2575 factory.go:223] Registration of the systemd container factory successfully
Sep 17 18:39:11.069475 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.069452    2575 factory.go:153] Registering CRI-O factory
Sep 17 18:39:11.069564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.069480    2575 factory.go:223] Registration of the crio container factory successfully
Sep 17 18:39:11.069564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.069538    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 18:39:11.069564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.069561    2575 factory.go:103] Registering Raw factory
Sep 17 18:39:11.069716 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.069579    2575 manager.go:1196] Started watching for new ooms in manager
Sep 17 18:39:11.070035 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.070018    2575 manager.go:349] Starting recovery of all containers
Sep 17 18:39:11.075245 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.075221    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-55ntl"
Sep 17 18:39:11.093418 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.093377    2575 manager.go:354] Recovery completed
Sep 17 18:39:11.094307 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.060969    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-229.ec2.internal.18d62fb3c3be3fa6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-229.ec2.internal,UID:ip-10-0-135-229.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-229.ec2.internal,},FirstTimestamp:2026-09-17 18:39:11.056027558 +0000 UTC m=+2.127987583,LastTimestamp:2026-09-17 18:39:11.056027558 +0000 UTC m=+2.127987583,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-229.ec2.internal,}"
Sep 17 18:39:11.094596 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.094568    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 18:39:11.099926 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.099909    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 18:39:11.101886 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.101859    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 18:39:11.102002 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.101906    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 18:39:11.102002 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.101931    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientPID"
Sep 17 18:39:11.102704 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.102684    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 18:39:11.102704 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.102702    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 18:39:11.102838 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.102719    2575 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 18:39:11.102880 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.102865    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 18:39:11.103681 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.103662    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 18:39:11.103761 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.103697    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 18:39:11.103761 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.103715    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientPID"
Sep 17 18:39:11.104234 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.104211    2575 policy_none.go:49] "None policy: Start"
Sep 17 18:39:11.104349 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.104240    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 18:39:11.104349 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.104259    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 18:39:11.105888 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.105873    2575 policy_none.go:47] "Start"
Sep 17 18:39:11.113594 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.113464    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.137948    2575 manager.go:337] "Starting Device Plugin manager"
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.137992    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.138002    2575 server.go:87] "Starting device plugin registration server"
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.138261    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.138282    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.138373    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.138449    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.138458    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.139052    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 18:39:11.141197 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.139100    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.203834 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.203801    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 18:39:11.205106 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.205090    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 18:39:11.205181 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.205146    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 18:39:11.205181 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.205172    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 18:39:11.205290 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.205211    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 18:39:11.207922 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.207904    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 18:39:11.239360 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.239284    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 18:39:11.240365 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.240345    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 18:39:11.240466 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.240372    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 18:39:11.240466 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.240383    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientPID"
Sep 17 18:39:11.240466 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.240408    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.247112 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.247096    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.247173 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.247120    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-229.ec2.internal\": node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.266651 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.266629    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.305957 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.305920    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal"]
Sep 17 18:39:11.306052 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.306005    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 18:39:11.307812 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.307797    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 18:39:11.307896 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.307828    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 18:39:11.307896 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.307839    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientPID"
Sep 17 18:39:11.309456 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.309442    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 18:39:11.309592 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.309578    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.309637 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.309610    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 18:39:11.310244 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.310230    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 18:39:11.310300 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.310258    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 18:39:11.310300 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.310277    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientPID"
Sep 17 18:39:11.310405 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.310297    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 18:39:11.310405 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.310339    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 18:39:11.310405 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.310350    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientPID"
Sep 17 18:39:11.311672 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.311656    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.311742 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.311683    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 18:39:11.312363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.312335    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 18:39:11.312363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.312364    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 18:39:11.312516 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.312374    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeHasSufficientPID"
Sep 17 18:39:11.329935 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.329917    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-229.ec2.internal\" not found" node="ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.334305 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.334288    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-229.ec2.internal\" not found" node="ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.367146 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.367120    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.370715 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.370693    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1110c1a47cc9135ed0b86b2fee148271-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal\" (UID: \"1110c1a47cc9135ed0b86b2fee148271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.370805 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.370728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1110c1a47cc9135ed0b86b2fee148271-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal\" (UID: \"1110c1a47cc9135ed0b86b2fee148271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.370805 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.370753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe1cc490e9c9f162e93a2c47a0afaf33-config\") pod \"kube-apiserver-proxy-ip-10-0-135-229.ec2.internal\" (UID: \"fe1cc490e9c9f162e93a2c47a0afaf33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.467236 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.467194    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.471847 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.471825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1110c1a47cc9135ed0b86b2fee148271-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal\" (UID: \"1110c1a47cc9135ed0b86b2fee148271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.471946 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.471859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1110c1a47cc9135ed0b86b2fee148271-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal\" (UID: \"1110c1a47cc9135ed0b86b2fee148271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.471946 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.471885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe1cc490e9c9f162e93a2c47a0afaf33-config\") pod \"kube-apiserver-proxy-ip-10-0-135-229.ec2.internal\" (UID: \"fe1cc490e9c9f162e93a2c47a0afaf33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.472051 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.471948    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1110c1a47cc9135ed0b86b2fee148271-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal\" (UID: \"1110c1a47cc9135ed0b86b2fee148271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.472051 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.471960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1110c1a47cc9135ed0b86b2fee148271-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal\" (UID: \"1110c1a47cc9135ed0b86b2fee148271\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.472051 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.472016    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe1cc490e9c9f162e93a2c47a0afaf33-config\") pod \"kube-apiserver-proxy-ip-10-0-135-229.ec2.internal\" (UID: \"fe1cc490e9c9f162e93a2c47a0afaf33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.569013 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.568908    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.638460 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.638431    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.639564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.639536    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.669685 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.669654    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.770594 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.770533    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.870694 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:11.870627    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-229.ec2.internal\" not found"
Sep 17 18:39:11.908896 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.908872    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 18:39:11.969018 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.968988    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.982098 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.982072    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 18:39:11.983651 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.983636    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal"
Sep 17 18:39:11.992617 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.992594    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 18:39:11.996688 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.996661    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 18:39:11.996802 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.996783    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 18:39:11.996860 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.996826    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 18:39:11.996860 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:11.996827    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 18:39:12.040996 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.040961    2575 apiserver.go:52] "Watching apiserver"
Sep 17 18:39:12.057322 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.056984    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 18:39:12.057540 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.057518    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-nfhrg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal","openshift-multus/multus-bjqjf","openshift-multus/network-metrics-daemon-fnh86","openshift-network-diagnostics/network-check-target-lsr2c","openshift-ovn-kubernetes/ovnkube-node-m8q7g","kube-system/konnectivity-agent-c75wd","kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f","openshift-dns/node-resolver-fg6p8","openshift-image-registry/node-ca-7csz9","openshift-multus/multus-additional-cni-plugins-6gh9d","openshift-network-operator/iptables-alerter-p4298","kube-system/global-pull-secret-syncer-xx5jd"]
Sep 17 18:39:12.059409 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.059391    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.061063 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.061043    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.061515 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.061498    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 18:39:12.061800 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.061784    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 18:39:12.062075 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.062063    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jf7jl\""
Sep 17 18:39:12.062460 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.062442    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:12.062546 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.062504    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:12.063219 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.063201    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 18:39:12.063563 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.063386    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 18:39:12.063563 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.063438    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 18:39:12.063563 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.063476    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 18:39:12.063563 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.063488    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c9tth\""
Sep 17 18:39:12.063916 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.063901    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:12.063973 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.063952    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:12.065305 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.065277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.066763 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.066746    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:12.067270 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.067255    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 18:39:12.067560 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.067545    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 18:39:12.068221 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.068205    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 18:39:12.068331 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.068317    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 18:39:12.068401 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.068363    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 18:39:12.068401 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.068377    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rrhvv\""
Sep 17 18:39:12.068499 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.068434    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 18:39:12.068499 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.068381    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 18:39:12.068672 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.068658    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 18:39:12.068732 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.068677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.069071 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.069044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 18:39:12.069334 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.069319    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-txhbq\""
Sep 17 18:39:12.070199 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.070183    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.071004 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.070988    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 18:39:12.071157 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.071142    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s9bdv\""
Sep 17 18:39:12.071223 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.071196    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 18:39:12.071435 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.071420    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 18:39:12.071685 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.071676    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.073387 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.073373    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.073922 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.073901    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 18:39:12.074067 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074046    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 18:39:12.074165 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074079    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-np227\""
Sep 17 18:39:12.074165 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074096    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 18:39:12.074165 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074115    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v6bs9\""
Sep 17 18:39:12.074341 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074192    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 18:39:12.074708 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074693    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 18:39:12.074777 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-modprobe-d\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.074777 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-systemd\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.074777 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-var-lib-openvswitch\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.074899 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-node-log\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.074899 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60d068af-a16a-4676-9b62-9d262dca963d-ovnkube-config\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.074899 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-registration-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.074899 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-kubelet\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.075049 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-slash\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.075049 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-run-ovn\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.075049 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c89642d-8115-4b12-b994-80b4fdd94aa4-tmp-dir\") pod \"node-resolver-fg6p8\" (UID: \"6c89642d-8115-4b12-b994-80b4fdd94aa4\") " pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.075049 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074955    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-multus-socket-dir-parent\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.075049 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.074972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-sysctl-d\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.075049 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075007    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-multus-cni-dir\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.075266 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9a9636d-c015-4738-9e84-e871940ac053-cni-binary-copy\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.075266 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075076    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9a9636d-c015-4738-9e84-e871940ac053-multus-daemon-config\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.075266 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:12.075266 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075126    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd88w\" (UniqueName: \"kubernetes.io/projected/c9412ee9-2a27-4eb5-b627-a455ab65eeca-kube-api-access-fd88w\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.075266 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075135    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.075266 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075152    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-run-systemd\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-etc-openvswitch\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-run-openvswitch\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hhjv\" (UniqueName: \"kubernetes.io/projected/6c89642d-8115-4b12-b994-80b4fdd94aa4-kube-api-access-8hhjv\") pod \"node-resolver-fg6p8\" (UID: \"6c89642d-8115-4b12-b994-80b4fdd94aa4\") " pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.075999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-system-cni-dir\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-var-lib-cni-bin\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-var-lib-cni-multus\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-var-lib-kubelet\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-systemd-units\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076373    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-run-netns\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076391    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076423    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076426    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pmwvn\""
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-sys-fs\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.076930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-sysconfig\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.076968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxk7f\" (UniqueName: \"kubernetes.io/projected/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-kube-api-access-fxk7f\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60d068af-a16a-4676-9b62-9d262dca963d-ovn-node-metrics-cert\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077071    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-tuned\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-tmp\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077121    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c89642d-8115-4b12-b994-80b4fdd94aa4-hosts-file\") pod \"node-resolver-fg6p8\" (UID: \"6c89642d-8115-4b12-b994-80b4fdd94aa4\") " pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-cnibin\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-var-lib-kubelet\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-kubernetes\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-run\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-hostroot\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-954f7\" (UniqueName: \"kubernetes.io/projected/d9a9636d-c015-4738-9e84-e871940ac053-kube-api-access-954f7\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077433    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-socket-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-etc-selinux\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-lib-modules\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.077759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077516    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-multus-conf-dir\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-etc-kubernetes\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-log-socket\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.077615    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077716    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-cni-bin\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077723    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60d068af-a16a-4676-9b62-9d262dca963d-env-overrides\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f686a9a-6483-47a6-85d9-7945eaec6984-agent-certs\") pod \"konnectivity-agent-c75wd\" (UID: \"8f686a9a-6483-47a6-85d9-7945eaec6984\") " pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-run-k8s-cni-cncf-io\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-run-netns\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077901    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60d068af-a16a-4676-9b62-9d262dca963d-ovnkube-script-lib\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.077999    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8d6t\" (UniqueName: \"kubernetes.io/projected/d9aa2188-f986-4999-982d-a02dde5eba1e-kube-api-access-v8d6t\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078032    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6vldp\""
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-run-multus-certs\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-device-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-sys\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.078703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-host\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.079451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-run-ovn-kubernetes\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.079451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-cni-netd\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.079451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078315    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 18:39:12.079451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swk5s\" (UniqueName: \"kubernetes.io/projected/60d068af-a16a-4676-9b62-9d262dca963d-kube-api-access-swk5s\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.079451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-sysctl-conf\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.079451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f686a9a-6483-47a6-85d9-7945eaec6984-konnectivity-ca\") pod \"konnectivity-agent-c75wd\" (UID: \"8f686a9a-6483-47a6-85d9-7945eaec6984\") " pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:12.079451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.078548    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 18:39:12.082749 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.082734    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 18:39:12.094716 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.094679    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 18:34:11 +0000 UTC" deadline="2028-07-04 04:03:41.496515698 +0000 UTC"
Sep 17 18:39:12.094716 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.094714    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15729h24m29.401804452s"
Sep 17 18:39:12.106777 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.106754    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cfr29"
Sep 17 18:39:12.114174 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.114157    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cfr29"
Sep 17 18:39:12.169260 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.169237    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 18:39:12.179555 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-multus-cni-dir\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.179692 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179559    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9a9636d-c015-4738-9e84-e871940ac053-cni-binary-copy\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.179692 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9a9636d-c015-4738-9e84-e871940ac053-multus-daemon-config\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.179692 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:12.179901 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd88w\" (UniqueName: \"kubernetes.io/projected/c9412ee9-2a27-4eb5-b627-a455ab65eeca-kube-api-access-fd88w\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.179901 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179751    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-multus-cni-dir\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.179901 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179789    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-run-systemd\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.179901 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179841    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-run-systemd\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.179901 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179854    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-etc-openvswitch\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.179901 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-run-openvswitch\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hhjv\" (UniqueName: \"kubernetes.io/projected/6c89642d-8115-4b12-b994-80b4fdd94aa4-kube-api-access-8hhjv\") pod \"node-resolver-fg6p8\" (UID: \"6c89642d-8115-4b12-b994-80b4fdd94aa4\") " pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179921    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-etc-openvswitch\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbwkm\" (UniqueName: \"kubernetes.io/projected/2bf32f3c-313e-41ec-a8de-e02bca764270-kube-api-access-xbwkm\") pod \"node-ca-7csz9\" (UID: \"2bf32f3c-313e-41ec-a8de-e02bca764270\") " pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-system-cni-dir\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179972    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-run-openvswitch\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.179989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-var-lib-cni-bin\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-var-lib-cni-multus\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180055    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-var-lib-cni-bin\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-var-lib-kubelet\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180088    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-systemd-units\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180095    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-var-lib-cni-multus\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180110    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-system-cni-dir\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180142    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-var-lib-kubelet\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-run-netns\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180166 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180161    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-systemd-units\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9a9636d-c015-4738-9e84-e871940ac053-cni-binary-copy\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/460b2252-a6cb-4e30-8f44-593a71adf004-kubelet-config\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-run-netns\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-sys-fs\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180197    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9a9636d-c015-4738-9e84-e871940ac053-multus-daemon-config\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180252    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-sysconfig\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180274    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxk7f\" (UniqueName: \"kubernetes.io/projected/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-kube-api-access-fxk7f\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180311    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-sysconfig\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180340    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-sys-fs\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180343    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60d068af-a16a-4676-9b62-9d262dca963d-ovn-node-metrics-cert\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c81dc79a-21e6-4746-9941-a28ee9440300-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-tuned\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-tmp\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c89642d-8115-4b12-b994-80b4fdd94aa4-hosts-file\") pod \"node-resolver-fg6p8\" (UID: \"6c89642d-8115-4b12-b994-80b4fdd94aa4\") " pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.180822 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c81dc79a-21e6-4746-9941-a28ee9440300-cni-binary-copy\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-cnibin\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6c89642d-8115-4b12-b994-80b4fdd94aa4-hosts-file\") pod \"node-resolver-fg6p8\" (UID: \"6c89642d-8115-4b12-b994-80b4fdd94aa4\") " pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-var-lib-kubelet\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180629    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-cnibin\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-var-lib-kubelet\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180664    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-kubernetes\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-run\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180745    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-kubernetes\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c81dc79a-21e6-4746-9941-a28ee9440300-cnibin\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180800    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-run\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42fc87b9-8d93-4a1d-958e-286e086c8b44-host-slash\") pod \"iptables-alerter-p4298\" (UID: \"42fc87b9-8d93-4a1d-958e-286e086c8b44\") " pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2bf32f3c-313e-41ec-a8de-e02bca764270-serviceca\") pod \"node-ca-7csz9\" (UID: \"2bf32f3c-313e-41ec-a8de-e02bca764270\") " pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-hostroot\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-954f7\" (UniqueName: \"kubernetes.io/projected/d9a9636d-c015-4738-9e84-e871940ac053-kube-api-access-954f7\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-socket-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.181580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180968    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-hostroot\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.180970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-etc-selinux\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-lib-modules\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-multus-conf-dir\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181051    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-etc-kubernetes\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-etc-selinux\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-log-socket\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-cni-bin\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181147    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60d068af-a16a-4676-9b62-9d262dca963d-env-overrides\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181170    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f686a9a-6483-47a6-85d9-7945eaec6984-agent-certs\") pod \"konnectivity-agent-c75wd\" (UID: \"8f686a9a-6483-47a6-85d9-7945eaec6984\") " pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-run-k8s-cni-cncf-io\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-run-netns\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60d068af-a16a-4676-9b62-9d262dca963d-ovnkube-script-lib\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181286    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8d6t\" (UniqueName: \"kubernetes.io/projected/d9aa2188-f986-4999-982d-a02dde5eba1e-kube-api-access-v8d6t\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:12.182535 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181377    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-run-multus-certs\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181398    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-socket-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-device-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-sys\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-host\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-lib-modules\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-run-ovn-kubernetes\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-cni-netd\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181530    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-run-ovn-kubernetes\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181566    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-cni-netd\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181570    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-etc-kubernetes\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-host\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181609    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-log-socket\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181654    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-device-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.181731    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.181804    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs podName:d9aa2188-f986-4999-982d-a02dde5eba1e nodeName:}" failed. No retries permitted until 2026-09-17 18:39:12.681771708 +0000 UTC m=+3.753731733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs") pod "network-metrics-daemon-fnh86" (UID: "d9aa2188-f986-4999-982d-a02dde5eba1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181915    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60d068af-a16a-4676-9b62-9d262dca963d-env-overrides\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.183363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.181966    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-cni-bin\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182142    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60d068af-a16a-4676-9b62-9d262dca963d-ovnkube-script-lib\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182170    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-run-multus-certs\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swk5s\" (UniqueName: \"kubernetes.io/projected/60d068af-a16a-4676-9b62-9d262dca963d-kube-api-access-swk5s\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182209    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-multus-conf-dir\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c81dc79a-21e6-4746-9941-a28ee9440300-system-cni-dir\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c81dc79a-21e6-4746-9941-a28ee9440300-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182256    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-run-k8s-cni-cncf-io\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182270    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42fc87b9-8d93-4a1d-958e-286e086c8b44-iptables-alerter-script\") pod \"iptables-alerter-p4298\" (UID: \"42fc87b9-8d93-4a1d-958e-286e086c8b44\") " pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182311    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bf32f3c-313e-41ec-a8de-e02bca764270-host\") pod \"node-ca-7csz9\" (UID: \"2bf32f3c-313e-41ec-a8de-e02bca764270\") " pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182337    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-sysctl-conf\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182353    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-host-run-netns\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f686a9a-6483-47a6-85d9-7945eaec6984-konnectivity-ca\") pod \"konnectivity-agent-c75wd\" (UID: \"8f686a9a-6483-47a6-85d9-7945eaec6984\") " pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182344    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-sys\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c81dc79a-21e6-4746-9941-a28ee9440300-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrlt7\" (UniqueName: \"kubernetes.io/projected/42fc87b9-8d93-4a1d-958e-286e086c8b44-kube-api-access-wrlt7\") pod \"iptables-alerter-p4298\" (UID: \"42fc87b9-8d93-4a1d-958e-286e086c8b44\") " pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-modprobe-d\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.184135 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182500    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-systemd\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-var-lib-openvswitch\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-node-log\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-var-lib-openvswitch\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-systemd\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60d068af-a16a-4676-9b62-9d262dca963d-ovnkube-config\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-registration-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182687    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-modprobe-d\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-kubelet\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-slash\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182768    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-run-ovn\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182783    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-sysctl-conf\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c89642d-8115-4b12-b994-80b4fdd94aa4-tmp-dir\") pod \"node-resolver-fg6p8\" (UID: \"6c89642d-8115-4b12-b994-80b4fdd94aa4\") " pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182836    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f686a9a-6483-47a6-85d9-7945eaec6984-konnectivity-ca\") pod \"konnectivity-agent-c75wd\" (UID: \"8f686a9a-6483-47a6-85d9-7945eaec6984\") " pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-multus-socket-dir-parent\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182845    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-slash\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182892    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9412ee9-2a27-4eb5-b627-a455ab65eeca-registration-dir\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.184690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182892    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9a9636d-c015-4738-9e84-e871940ac053-multus-socket-dir-parent\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-sysctl-d\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-node-log\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182972    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-host-kubelet\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.182975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60d068af-a16a-4676-9b62-9d262dca963d-run-ovn\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.183004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4jk\" (UniqueName: \"kubernetes.io/projected/c81dc79a-21e6-4746-9941-a28ee9440300-kube-api-access-dh4jk\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.183028    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/460b2252-a6cb-4e30-8f44-593a71adf004-dbus\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.183052    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-sysctl-d\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.183261    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c89642d-8115-4b12-b994-80b4fdd94aa4-tmp-dir\") pod \"node-resolver-fg6p8\" (UID: \"6c89642d-8115-4b12-b994-80b4fdd94aa4\") " pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.183573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60d068af-a16a-4676-9b62-9d262dca963d-ovnkube-config\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.183880    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-etc-tuned\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.183990    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-tmp\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.184119    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60d068af-a16a-4676-9b62-9d262dca963d-ovn-node-metrics-cert\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.185286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.185198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f686a9a-6483-47a6-85d9-7945eaec6984-agent-certs\") pod \"konnectivity-agent-c75wd\" (UID: \"8f686a9a-6483-47a6-85d9-7945eaec6984\") " pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:12.190984 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.190956    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd88w\" (UniqueName: \"kubernetes.io/projected/c9412ee9-2a27-4eb5-b627-a455ab65eeca-kube-api-access-fd88w\") pod \"aws-ebs-csi-driver-node-sc25f\" (UID: \"c9412ee9-2a27-4eb5-b627-a455ab65eeca\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.191125 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.191102    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 18:39:12.191125 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.191128    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 18:39:12.191289 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.191142    2575 projected.go:196] Error preparing data for projected volume kube-api-access-v9cts for pod openshift-network-diagnostics/network-check-target-lsr2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:12.191289 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.191206    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts podName:36555ce9-b17b-4157-9d11-357b392cb318 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:12.691186218 +0000 UTC m=+3.763146228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v9cts" (UniqueName: "kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts") pod "network-check-target-lsr2c" (UID: "36555ce9-b17b-4157-9d11-357b392cb318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:12.191289 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.191215    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxk7f\" (UniqueName: \"kubernetes.io/projected/9bd66254-a50a-4592-9f6b-7dfe0fefd2bb-kube-api-access-fxk7f\") pod \"tuned-nfhrg\" (UID: \"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb\") " pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.191289 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.191216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hhjv\" (UniqueName: \"kubernetes.io/projected/6c89642d-8115-4b12-b994-80b4fdd94aa4-kube-api-access-8hhjv\") pod \"node-resolver-fg6p8\" (UID: \"6c89642d-8115-4b12-b994-80b4fdd94aa4\") " pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.191289 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.191216    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8d6t\" (UniqueName: \"kubernetes.io/projected/d9aa2188-f986-4999-982d-a02dde5eba1e-kube-api-access-v8d6t\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:12.192417 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.192399    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-954f7\" (UniqueName: \"kubernetes.io/projected/d9a9636d-c015-4738-9e84-e871940ac053-kube-api-access-954f7\") pod \"multus-bjqjf\" (UID: \"d9a9636d-c015-4738-9e84-e871940ac053\") " pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.192629 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.192614    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swk5s\" (UniqueName: \"kubernetes.io/projected/60d068af-a16a-4676-9b62-9d262dca963d-kube-api-access-swk5s\") pod \"ovnkube-node-m8q7g\" (UID: \"60d068af-a16a-4676-9b62-9d262dca963d\") " pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.263433 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.263401    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1110c1a47cc9135ed0b86b2fee148271.slice/crio-743d94e9f102490e89d49fb2e0d3be7a8ef53795ddd3b9c152eb832f8f8c714f WatchSource:0}: Error finding container 743d94e9f102490e89d49fb2e0d3be7a8ef53795ddd3b9c152eb832f8f8c714f: Status 404 returned error can't find the container with id 743d94e9f102490e89d49fb2e0d3be7a8ef53795ddd3b9c152eb832f8f8c714f
Sep 17 18:39:12.268430 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.268413    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 18:39:12.284018 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.283997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4jk\" (UniqueName: \"kubernetes.io/projected/c81dc79a-21e6-4746-9941-a28ee9440300-kube-api-access-dh4jk\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284134 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/460b2252-a6cb-4e30-8f44-593a71adf004-dbus\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.284134 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwkm\" (UniqueName: \"kubernetes.io/projected/2bf32f3c-313e-41ec-a8de-e02bca764270-kube-api-access-xbwkm\") pod \"node-ca-7csz9\" (UID: \"2bf32f3c-313e-41ec-a8de-e02bca764270\") " pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.284134 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/460b2252-a6cb-4e30-8f44-593a71adf004-dbus\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.284314 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284158    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/460b2252-a6cb-4e30-8f44-593a71adf004-kubelet-config\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.284314 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c81dc79a-21e6-4746-9941-a28ee9440300-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284314 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c81dc79a-21e6-4746-9941-a28ee9440300-cni-binary-copy\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284314 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284232    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c81dc79a-21e6-4746-9941-a28ee9440300-cnibin\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284314 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42fc87b9-8d93-4a1d-958e-286e086c8b44-host-slash\") pod \"iptables-alerter-p4298\" (UID: \"42fc87b9-8d93-4a1d-958e-286e086c8b44\") " pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.284314 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2bf32f3c-313e-41ec-a8de-e02bca764270-serviceca\") pod \"node-ca-7csz9\" (UID: \"2bf32f3c-313e-41ec-a8de-e02bca764270\") " pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.284314 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284286    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/460b2252-a6cb-4e30-8f44-593a71adf004-kubelet-config\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.284314 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284324    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c81dc79a-21e6-4746-9941-a28ee9440300-cnibin\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284314 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284365    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c81dc79a-21e6-4746-9941-a28ee9440300-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42fc87b9-8d93-4a1d-958e-286e086c8b44-host-slash\") pod \"iptables-alerter-p4298\" (UID: \"42fc87b9-8d93-4a1d-958e-286e086c8b44\") " pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c81dc79a-21e6-4746-9941-a28ee9440300-system-cni-dir\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.284446    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c81dc79a-21e6-4746-9941-a28ee9440300-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42fc87b9-8d93-4a1d-958e-286e086c8b44-iptables-alerter-script\") pod \"iptables-alerter-p4298\" (UID: \"42fc87b9-8d93-4a1d-958e-286e086c8b44\") " pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284493    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c81dc79a-21e6-4746-9941-a28ee9440300-system-cni-dir\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.284509    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret podName:460b2252-a6cb-4e30-8f44-593a71adf004 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:12.784488691 +0000 UTC m=+3.856448716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret") pod "global-pull-secret-syncer-xx5jd" (UID: "460b2252-a6cb-4e30-8f44-593a71adf004") : object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bf32f3c-313e-41ec-a8de-e02bca764270-host\") pod \"node-ca-7csz9\" (UID: \"2bf32f3c-313e-41ec-a8de-e02bca764270\") " pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c81dc79a-21e6-4746-9941-a28ee9440300-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlt7\" (UniqueName: \"kubernetes.io/projected/42fc87b9-8d93-4a1d-958e-286e086c8b44-kube-api-access-wrlt7\") pod \"iptables-alerter-p4298\" (UID: \"42fc87b9-8d93-4a1d-958e-286e086c8b44\") " pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.284772 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2bf32f3c-313e-41ec-a8de-e02bca764270-host\") pod \"node-ca-7csz9\" (UID: \"2bf32f3c-313e-41ec-a8de-e02bca764270\") " pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.285196 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284800    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2bf32f3c-313e-41ec-a8de-e02bca764270-serviceca\") pod \"node-ca-7csz9\" (UID: \"2bf32f3c-313e-41ec-a8de-e02bca764270\") " pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.285196 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284811    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c81dc79a-21e6-4746-9941-a28ee9440300-cni-binary-copy\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.285196 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.284913    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c81dc79a-21e6-4746-9941-a28ee9440300-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.285196 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.285028    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42fc87b9-8d93-4a1d-958e-286e086c8b44-iptables-alerter-script\") pod \"iptables-alerter-p4298\" (UID: \"42fc87b9-8d93-4a1d-958e-286e086c8b44\") " pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.285196 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.285099    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c81dc79a-21e6-4746-9941-a28ee9440300-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.294367 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.294349    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbwkm\" (UniqueName: \"kubernetes.io/projected/2bf32f3c-313e-41ec-a8de-e02bca764270-kube-api-access-xbwkm\") pod \"node-ca-7csz9\" (UID: \"2bf32f3c-313e-41ec-a8de-e02bca764270\") " pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.295165 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.295149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrlt7\" (UniqueName: \"kubernetes.io/projected/42fc87b9-8d93-4a1d-958e-286e086c8b44-kube-api-access-wrlt7\") pod \"iptables-alerter-p4298\" (UID: \"42fc87b9-8d93-4a1d-958e-286e086c8b44\") " pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.296014 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.295998    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4jk\" (UniqueName: \"kubernetes.io/projected/c81dc79a-21e6-4746-9941-a28ee9440300-kube-api-access-dh4jk\") pod \"multus-additional-cni-plugins-6gh9d\" (UID: \"c81dc79a-21e6-4746-9941-a28ee9440300\") " pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.329353 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.329328    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1cc490e9c9f162e93a2c47a0afaf33.slice/crio-ec73d81ca0606ec6ebda847dd9101fd45185eafc27a703f8670eeaacac25285c WatchSource:0}: Error finding container ec73d81ca0606ec6ebda847dd9101fd45185eafc27a703f8670eeaacac25285c: Status 404 returned error can't find the container with id ec73d81ca0606ec6ebda847dd9101fd45185eafc27a703f8670eeaacac25285c
Sep 17 18:39:12.338176 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.338156    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 18:39:12.388692 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.388617    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nfhrg"
Sep 17 18:39:12.396761 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.396735    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd66254_a50a_4592_9f6b_7dfe0fefd2bb.slice/crio-debcaccd7eb4ee3ac47ff978c2bcfe97a207691c5ea08cee8dc18af816499681 WatchSource:0}: Error finding container debcaccd7eb4ee3ac47ff978c2bcfe97a207691c5ea08cee8dc18af816499681: Status 404 returned error can't find the container with id debcaccd7eb4ee3ac47ff978c2bcfe97a207691c5ea08cee8dc18af816499681
Sep 17 18:39:12.411227 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.411205    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bjqjf"
Sep 17 18:39:12.418811 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.418787    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a9636d_c015_4738_9e84_e871940ac053.slice/crio-74683ed4f1ce907012a431f27bb812b9a29084b357ebde7ad0e1a462e40a1d63 WatchSource:0}: Error finding container 74683ed4f1ce907012a431f27bb812b9a29084b357ebde7ad0e1a462e40a1d63: Status 404 returned error can't find the container with id 74683ed4f1ce907012a431f27bb812b9a29084b357ebde7ad0e1a462e40a1d63
Sep 17 18:39:12.438472 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.438421    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:12.445765 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.445742    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d068af_a16a_4676_9b62_9d262dca963d.slice/crio-7adb7838e770634c2db296eece1322b8c574fc6779a8c873b474047da901a54c WatchSource:0}: Error finding container 7adb7838e770634c2db296eece1322b8c574fc6779a8c873b474047da901a54c: Status 404 returned error can't find the container with id 7adb7838e770634c2db296eece1322b8c574fc6779a8c873b474047da901a54c
Sep 17 18:39:12.451000 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.450981    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:12.458524 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.458502    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f686a9a_6483_47a6_85d9_7945eaec6984.slice/crio-7f025f39781840fa42df7663f313a6c09ab09fe05ddade739c3d13448532bfbb WatchSource:0}: Error finding container 7f025f39781840fa42df7663f313a6c09ab09fe05ddade739c3d13448532bfbb: Status 404 returned error can't find the container with id 7f025f39781840fa42df7663f313a6c09ab09fe05ddade739c3d13448532bfbb
Sep 17 18:39:12.468739 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.468719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f"
Sep 17 18:39:12.476569 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.476547    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9412ee9_2a27_4eb5_b627_a455ab65eeca.slice/crio-1a6f7841e9dd876cf06b776edd10aa52d3d3dce90627eb6f98538eeba361ffa3 WatchSource:0}: Error finding container 1a6f7841e9dd876cf06b776edd10aa52d3d3dce90627eb6f98538eeba361ffa3: Status 404 returned error can't find the container with id 1a6f7841e9dd876cf06b776edd10aa52d3d3dce90627eb6f98538eeba361ffa3
Sep 17 18:39:12.485666 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.485647    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fg6p8"
Sep 17 18:39:12.492778 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.492754    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c89642d_8115_4b12_b994_80b4fdd94aa4.slice/crio-d102138e178b9f83371d1db58ad41058fdbed06b3a4ef315d9492b8173583966 WatchSource:0}: Error finding container d102138e178b9f83371d1db58ad41058fdbed06b3a4ef315d9492b8173583966: Status 404 returned error can't find the container with id d102138e178b9f83371d1db58ad41058fdbed06b3a4ef315d9492b8173583966
Sep 17 18:39:12.516038 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.516003    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7csz9"
Sep 17 18:39:12.522215 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.522195    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6gh9d"
Sep 17 18:39:12.523673 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.523631    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf32f3c_313e_41ec_a8de_e02bca764270.slice/crio-a7d2d49e01b55338a6a67be48517d052efa971a243f21be4b78123f36ad1a0b6 WatchSource:0}: Error finding container a7d2d49e01b55338a6a67be48517d052efa971a243f21be4b78123f36ad1a0b6: Status 404 returned error can't find the container with id a7d2d49e01b55338a6a67be48517d052efa971a243f21be4b78123f36ad1a0b6
Sep 17 18:39:12.526766 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.526749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p4298"
Sep 17 18:39:12.529926 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.529903    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81dc79a_21e6_4746_9941_a28ee9440300.slice/crio-12ffbd9961872696063d40ec3524b3754e9f23f11e6deca56d2d9581b4ca80b5 WatchSource:0}: Error finding container 12ffbd9961872696063d40ec3524b3754e9f23f11e6deca56d2d9581b4ca80b5: Status 404 returned error can't find the container with id 12ffbd9961872696063d40ec3524b3754e9f23f11e6deca56d2d9581b4ca80b5
Sep 17 18:39:12.535003 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:39:12.534974    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fc87b9_8d93_4a1d_958e_286e086c8b44.slice/crio-16e543f39c3dc07b513a0a9b4eaf29700a38a8a515db157f921352b2e840a2d3 WatchSource:0}: Error finding container 16e543f39c3dc07b513a0a9b4eaf29700a38a8a515db157f921352b2e840a2d3: Status 404 returned error can't find the container with id 16e543f39c3dc07b513a0a9b4eaf29700a38a8a515db157f921352b2e840a2d3
Sep 17 18:39:12.687835 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.687754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:12.687997 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.687899    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:12.687997 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.687961    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs podName:d9aa2188-f986-4999-982d-a02dde5eba1e nodeName:}" failed. No retries permitted until 2026-09-17 18:39:13.687941377 +0000 UTC m=+4.759901399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs") pod "network-metrics-daemon-fnh86" (UID: "d9aa2188-f986-4999-982d-a02dde5eba1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:12.788484 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.788451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:12.788642 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:12.788521    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:12.788719 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.788639    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 18:39:12.788719 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.788668    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 18:39:12.788719 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.788681    2575 projected.go:196] Error preparing data for projected volume kube-api-access-v9cts for pod openshift-network-diagnostics/network-check-target-lsr2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:12.788854 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.788742    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts podName:36555ce9-b17b-4157-9d11-357b392cb318 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:13.788723115 +0000 UTC m=+4.860683174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9cts" (UniqueName: "kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts") pod "network-check-target-lsr2c" (UID: "36555ce9-b17b-4157-9d11-357b392cb318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:12.788854 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.788643    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:12.788961 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:12.788862    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret podName:460b2252-a6cb-4e30-8f44-593a71adf004 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:13.7888253 +0000 UTC m=+4.860785322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret") pod "global-pull-secret-syncer-xx5jd" (UID: "460b2252-a6cb-4e30-8f44-593a71adf004") : object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:13.056717 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.056636    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 18:39:13.116234 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.116115    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 18:34:12 +0000 UTC" deadline="2028-03-22 04:09:31.603512037 +0000 UTC"
Sep 17 18:39:13.116234 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.116174    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13233h30m18.487342246s"
Sep 17 18:39:13.218554 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.218525    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 18:39:13.234509 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.234448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7csz9" event={"ID":"2bf32f3c-313e-41ec-a8de-e02bca764270","Type":"ContainerStarted","Data":"a7d2d49e01b55338a6a67be48517d052efa971a243f21be4b78123f36ad1a0b6"}
Sep 17 18:39:13.253575 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.253458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fg6p8" event={"ID":"6c89642d-8115-4b12-b994-80b4fdd94aa4","Type":"ContainerStarted","Data":"d102138e178b9f83371d1db58ad41058fdbed06b3a4ef315d9492b8173583966"}
Sep 17 18:39:13.260771 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.260737    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f" event={"ID":"c9412ee9-2a27-4eb5-b627-a455ab65eeca","Type":"ContainerStarted","Data":"1a6f7841e9dd876cf06b776edd10aa52d3d3dce90627eb6f98538eeba361ffa3"}
Sep 17 18:39:13.275389 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.275332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nfhrg" event={"ID":"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb","Type":"ContainerStarted","Data":"debcaccd7eb4ee3ac47ff978c2bcfe97a207691c5ea08cee8dc18af816499681"}
Sep 17 18:39:13.284359 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.283451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p4298" event={"ID":"42fc87b9-8d93-4a1d-958e-286e086c8b44","Type":"ContainerStarted","Data":"16e543f39c3dc07b513a0a9b4eaf29700a38a8a515db157f921352b2e840a2d3"}
Sep 17 18:39:13.287966 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.287615    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6gh9d" event={"ID":"c81dc79a-21e6-4746-9941-a28ee9440300","Type":"ContainerStarted","Data":"12ffbd9961872696063d40ec3524b3754e9f23f11e6deca56d2d9581b4ca80b5"}
Sep 17 18:39:13.289835 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.289497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c75wd" event={"ID":"8f686a9a-6483-47a6-85d9-7945eaec6984","Type":"ContainerStarted","Data":"7f025f39781840fa42df7663f313a6c09ab09fe05ddade739c3d13448532bfbb"}
Sep 17 18:39:13.305032 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.304919    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" event={"ID":"60d068af-a16a-4676-9b62-9d262dca963d","Type":"ContainerStarted","Data":"7adb7838e770634c2db296eece1322b8c574fc6779a8c873b474047da901a54c"}
Sep 17 18:39:13.316474 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.316397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bjqjf" event={"ID":"d9a9636d-c015-4738-9e84-e871940ac053","Type":"ContainerStarted","Data":"74683ed4f1ce907012a431f27bb812b9a29084b357ebde7ad0e1a462e40a1d63"}
Sep 17 18:39:13.324206 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.324173    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal" event={"ID":"fe1cc490e9c9f162e93a2c47a0afaf33","Type":"ContainerStarted","Data":"ec73d81ca0606ec6ebda847dd9101fd45185eafc27a703f8670eeaacac25285c"}
Sep 17 18:39:13.346811 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.346767    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal" event={"ID":"1110c1a47cc9135ed0b86b2fee148271","Type":"ContainerStarted","Data":"743d94e9f102490e89d49fb2e0d3be7a8ef53795ddd3b9c152eb832f8f8c714f"}
Sep 17 18:39:13.626516 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.626428    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 18:39:13.710058 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.705027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:13.710058 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:13.705196    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:13.710058 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:13.705257    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs podName:d9aa2188-f986-4999-982d-a02dde5eba1e nodeName:}" failed. No retries permitted until 2026-09-17 18:39:15.705239182 +0000 UTC m=+6.777199194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs") pod "network-metrics-daemon-fnh86" (UID: "d9aa2188-f986-4999-982d-a02dde5eba1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:13.807828 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.807792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:13.808007 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:13.807863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:13.808069 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:13.808015    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:13.808119 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:13.808075    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret podName:460b2252-a6cb-4e30-8f44-593a71adf004 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:15.808057012 +0000 UTC m=+6.880017021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret") pod "global-pull-secret-syncer-xx5jd" (UID: "460b2252-a6cb-4e30-8f44-593a71adf004") : object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:13.808537 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:13.808496    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 18:39:13.808537 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:13.808519    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 18:39:13.808537 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:13.808533    2575 projected.go:196] Error preparing data for projected volume kube-api-access-v9cts for pod openshift-network-diagnostics/network-check-target-lsr2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:13.808738 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:13.808579    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts podName:36555ce9-b17b-4157-9d11-357b392cb318 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:15.808564764 +0000 UTC m=+6.880524785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9cts" (UniqueName: "kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts") pod "network-check-target-lsr2c" (UID: "36555ce9-b17b-4157-9d11-357b392cb318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:14.117430 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:14.117284    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 18:34:12 +0000 UTC" deadline="2028-03-30 15:01:17.821385607 +0000 UTC"
Sep 17 18:39:14.117430 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:14.117387    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13436h22m3.704004358s"
Sep 17 18:39:14.206355 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:14.206321    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:14.206545 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:14.206366    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:14.206545 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:14.206454    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:14.206679 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:14.206649    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:14.206679 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:14.206324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:14.206790 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:14.206744    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:15.725558 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:15.725527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:15.726033 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:15.725695    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:15.726033 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:15.725769    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs podName:d9aa2188-f986-4999-982d-a02dde5eba1e nodeName:}" failed. No retries permitted until 2026-09-17 18:39:19.725747602 +0000 UTC m=+10.797707611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs") pod "network-metrics-daemon-fnh86" (UID: "d9aa2188-f986-4999-982d-a02dde5eba1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:15.826496 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:15.826456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:15.826689 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:15.826535    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:15.826759 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:15.826727    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:15.826818 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:15.826794    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret podName:460b2252-a6cb-4e30-8f44-593a71adf004 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:19.826773192 +0000 UTC m=+10.898733210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret") pod "global-pull-secret-syncer-xx5jd" (UID: "460b2252-a6cb-4e30-8f44-593a71adf004") : object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:15.827008 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:15.826937    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 18:39:15.827008 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:15.826964    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 18:39:15.827008 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:15.826976    2575 projected.go:196] Error preparing data for projected volume kube-api-access-v9cts for pod openshift-network-diagnostics/network-check-target-lsr2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:15.827183 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:15.827019    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts podName:36555ce9-b17b-4157-9d11-357b392cb318 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:19.82700543 +0000 UTC m=+10.898965449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9cts" (UniqueName: "kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts") pod "network-check-target-lsr2c" (UID: "36555ce9-b17b-4157-9d11-357b392cb318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:16.206062 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:16.205947    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:16.206197 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:16.206078    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:16.206197 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:16.206151    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:16.206344 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:16.206258    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:16.206344 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:16.206335    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:16.206458 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:16.206422    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:18.206224 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:18.205779    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:18.206224 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:18.205916    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:18.206224 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:18.206036    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:18.206224 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:18.206039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:18.206224 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:18.206149    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:18.206876 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:18.206243    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:19.761427 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:19.760853    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:19.761427 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:19.761013    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:19.761427 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:19.761076    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs podName:d9aa2188-f986-4999-982d-a02dde5eba1e nodeName:}" failed. No retries permitted until 2026-09-17 18:39:27.761057947 +0000 UTC m=+18.833017960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs") pod "network-metrics-daemon-fnh86" (UID: "d9aa2188-f986-4999-982d-a02dde5eba1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:19.861559 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:19.861524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:19.861714 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:19.861583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:19.861714 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:19.861675    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:19.861714 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:19.861694    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 18:39:19.861879 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:19.861718    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 18:39:19.861879 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:19.861725    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret podName:460b2252-a6cb-4e30-8f44-593a71adf004 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:27.86171056 +0000 UTC m=+18.933670565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret") pod "global-pull-secret-syncer-xx5jd" (UID: "460b2252-a6cb-4e30-8f44-593a71adf004") : object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:19.861879 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:19.861728    2575 projected.go:196] Error preparing data for projected volume kube-api-access-v9cts for pod openshift-network-diagnostics/network-check-target-lsr2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:19.861879 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:19.861781    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts podName:36555ce9-b17b-4157-9d11-357b392cb318 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:27.861769583 +0000 UTC m=+18.933729589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9cts" (UniqueName: "kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts") pod "network-check-target-lsr2c" (UID: "36555ce9-b17b-4157-9d11-357b392cb318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:20.205703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:20.205629    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:20.205863 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:20.205755    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:20.205863 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:20.205754    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:20.205969 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:20.205863    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:20.205969 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:20.205883    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:20.206041 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:20.206024    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:22.205901 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:22.205856    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:22.205901 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:22.205903    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:22.206381 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:22.205865    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:22.206381 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:22.205974    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:22.206381 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:22.206058    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:22.206381 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:22.206132    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:24.205596 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:24.205533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:24.205596 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:24.205569    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:24.205596 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:24.205571    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:24.206145 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:24.205651    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:24.206145 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:24.205766    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:24.206145 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:24.205862    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:26.206141 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:26.206099    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:26.206676 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:26.206099    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:26.206676 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:26.206249    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:26.206676 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:26.206119    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:26.206676 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:26.206338    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:26.206676 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:26.206403    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:27.817727 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:27.817690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:27.818259 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:27.817857    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:27.818259 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:27.817926    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs podName:d9aa2188-f986-4999-982d-a02dde5eba1e nodeName:}" failed. No retries permitted until 2026-09-17 18:39:43.817909462 +0000 UTC m=+34.889869471 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs") pod "network-metrics-daemon-fnh86" (UID: "d9aa2188-f986-4999-982d-a02dde5eba1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:27.918619 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:27.918582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:27.918878 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:27.918657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:27.918878 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:27.918721    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:27.918878 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:27.918789    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 18:39:27.918878 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:27.918809    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 18:39:27.918878 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:27.918822    2575 projected.go:196] Error preparing data for projected volume kube-api-access-v9cts for pod openshift-network-diagnostics/network-check-target-lsr2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:27.918878 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:27.918791    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret podName:460b2252-a6cb-4e30-8f44-593a71adf004 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:43.918775344 +0000 UTC m=+34.990735350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret") pod "global-pull-secret-syncer-xx5jd" (UID: "460b2252-a6cb-4e30-8f44-593a71adf004") : object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:27.918878 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:27.918877    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts podName:36555ce9-b17b-4157-9d11-357b392cb318 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:43.918862936 +0000 UTC m=+34.990822943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9cts" (UniqueName: "kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts") pod "network-check-target-lsr2c" (UID: "36555ce9-b17b-4157-9d11-357b392cb318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:28.206155 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:28.206068    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:28.206155 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:28.206121    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:28.206155 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:28.206122    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:28.206523 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:28.206197    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:28.206523 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:28.206311    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:28.206523 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:28.206398    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:30.206418 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:30.206378    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:30.206418 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:30.206400    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:30.206418 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:30.206396    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:30.206968 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:30.206514    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:30.206968 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:30.206578    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:30.206968 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:30.206699    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:31.388861 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.388521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c75wd" event={"ID":"8f686a9a-6483-47a6-85d9-7945eaec6984","Type":"ContainerStarted","Data":"20239add8e6f0adf203698faf804be1e6b6a8d21b7b201ce4c8c115cf40c89e5"}
Sep 17 18:39:31.391451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.391426    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" event={"ID":"60d068af-a16a-4676-9b62-9d262dca963d","Type":"ContainerStarted","Data":"6fcacb130d167a38ddb2c43df22bf1ef548d0257042ef46d0e6c2bf905874496"}
Sep 17 18:39:31.391575 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.391502    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" event={"ID":"60d068af-a16a-4676-9b62-9d262dca963d","Type":"ContainerStarted","Data":"114f7952600accfd7dc24af323a9bb8e32030b900ca3dadb0c4da34be1c32f4f"}
Sep 17 18:39:31.391575 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.391552    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" event={"ID":"60d068af-a16a-4676-9b62-9d262dca963d","Type":"ContainerStarted","Data":"484c1044f0c76ebd27c74883d093f2aaa6e7500ccc77651f53f5ac02922a9fce"}
Sep 17 18:39:31.391701 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.391606    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" event={"ID":"60d068af-a16a-4676-9b62-9d262dca963d","Type":"ContainerStarted","Data":"b383786bf0daeffe1e6ea6565978b16e32b80bb84c20a8f563bf1916cfba2681"}
Sep 17 18:39:31.391701 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.391655    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" event={"ID":"60d068af-a16a-4676-9b62-9d262dca963d","Type":"ContainerStarted","Data":"dcdb80f2c76f0033cf2e4cf921828ea1e6735e4702b0c52de3d9710b6b829684"}
Sep 17 18:39:31.393047 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.393025    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bjqjf" event={"ID":"d9a9636d-c015-4738-9e84-e871940ac053","Type":"ContainerStarted","Data":"a307d86bab7c9a8e051a8008bd64bddb844126a65349e12e3453e6a5e8d6e5c8"}
Sep 17 18:39:31.394649 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.394624    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal" event={"ID":"fe1cc490e9c9f162e93a2c47a0afaf33","Type":"ContainerStarted","Data":"544150a351d5066d8c544e6aee4f566df88ba664fd04ae4512e0b81523dd32fc"}
Sep 17 18:39:31.396092 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.396069    2575 generic.go:356] "Generic (PLEG): container finished" podID="1110c1a47cc9135ed0b86b2fee148271" containerID="a2724898ec32e837ec560c33b9245be50ea24b8c4bac7e9f60aeb7ecf85c7eb4" exitCode=0
Sep 17 18:39:31.396170 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.396102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal" event={"ID":"1110c1a47cc9135ed0b86b2fee148271","Type":"ContainerDied","Data":"a2724898ec32e837ec560c33b9245be50ea24b8c4bac7e9f60aeb7ecf85c7eb4"}
Sep 17 18:39:31.397626 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.397603    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7csz9" event={"ID":"2bf32f3c-313e-41ec-a8de-e02bca764270","Type":"ContainerStarted","Data":"c443f1e731f910652aa65339dfe14ca03d0f852286657fac70a1e0654bf81ea9"}
Sep 17 18:39:31.399082 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.399057    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fg6p8" event={"ID":"6c89642d-8115-4b12-b994-80b4fdd94aa4","Type":"ContainerStarted","Data":"20cea83c3887ee78c28f090a7513779fd90d6a2438af3feaf260ee293c9ef8b7"}
Sep 17 18:39:31.400674 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.400649    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f" event={"ID":"c9412ee9-2a27-4eb5-b627-a455ab65eeca","Type":"ContainerStarted","Data":"f96b1bbe0b5082e2fbe55921e2e9cd318b12d48a00be39bc8e791a63e608e34d"}
Sep 17 18:39:31.402059 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.402040    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nfhrg" event={"ID":"9bd66254-a50a-4592-9f6b-7dfe0fefd2bb","Type":"ContainerStarted","Data":"83761b1396eb199690a62832d055c2dc5dece510abd1044007b18afcbdacd09b"}
Sep 17 18:39:31.403482 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.403461    2575 generic.go:356] "Generic (PLEG): container finished" podID="c81dc79a-21e6-4746-9941-a28ee9440300" containerID="a3b66409ad5edd2e88e9753e6924318dd5a675784193db96378b2accd8d1b7e6" exitCode=0
Sep 17 18:39:31.403558 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.403495    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6gh9d" event={"ID":"c81dc79a-21e6-4746-9941-a28ee9440300","Type":"ContainerDied","Data":"a3b66409ad5edd2e88e9753e6924318dd5a675784193db96378b2accd8d1b7e6"}
Sep 17 18:39:31.440674 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.440622    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c75wd" podStartSLOduration=6.250644746 podStartE2EDuration="20.440605553s" totalImagesPullingTime="14.189960807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:31.408099642 +0000 UTC m=+22.480059670" watchObservedRunningTime="2026-09-17 18:39:31.440605553 +0000 UTC m=+22.512565582"
Sep 17 18:39:31.440861 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.440810    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fg6p8" podStartSLOduration=2.127264999 podStartE2EDuration="20.440802514s" totalImagesPullingTime="18.313537515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:31.440599327 +0000 UTC m=+22.512559354" watchObservedRunningTime="2026-09-17 18:39:31.440802514 +0000 UTC m=+22.512762542"
Sep 17 18:39:31.503106 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.503062    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7csz9" podStartSLOduration=2.214701765 podStartE2EDuration="20.503044021s" totalImagesPullingTime="18.288342256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:31.502789153 +0000 UTC m=+22.574749182" watchObservedRunningTime="2026-09-17 18:39:31.503044021 +0000 UTC m=+22.575004050"
Sep 17 18:39:31.546825 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.546662    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-229.ec2.internal" podStartSLOduration=20.546646342 podStartE2EDuration="20.546646342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:31.51984352 +0000 UTC m=+22.591803548" watchObservedRunningTime="2026-09-17 18:39:31.546646342 +0000 UTC m=+22.618606713"
Sep 17 18:39:31.547095 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:31.547076    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nfhrg" podStartSLOduration=2.135073126 podStartE2EDuration="20.547066752s" totalImagesPullingTime="18.411993626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:31.546453669 +0000 UTC m=+22.618413707" watchObservedRunningTime="2026-09-17 18:39:31.547066752 +0000 UTC m=+22.619026802"
Sep 17 18:39:32.140804 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.140780    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 18:39:32.151333 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.151234    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T18:39:32.140801291Z","UUID":"a345e9b5-ef77-451c-aade-e421ea385046","Handler":null,"Name":"","Endpoint":""}
Sep 17 18:39:32.153137 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.153118    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 18:39:32.153245 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.153147    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 18:39:32.205661 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.205627    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:32.205661 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.205660    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:32.205878 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.205738    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:32.205878 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:32.205744    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:32.205878 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:32.205819    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:32.205995 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:32.205902    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:32.408240 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.408159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f" event={"ID":"c9412ee9-2a27-4eb5-b627-a455ab65eeca","Type":"ContainerStarted","Data":"c9a0bab6c91eabf2f969ad953e186fb4f9f5b789ec6454650b11baa8d178f359"}
Sep 17 18:39:32.409858 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.409817    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p4298" event={"ID":"42fc87b9-8d93-4a1d-958e-286e086c8b44","Type":"ContainerStarted","Data":"665007bf262f55748edc784021b47072d06277e4f3f619784bc05a1aebaaf75e"}
Sep 17 18:39:32.413521 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.413488    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" event={"ID":"60d068af-a16a-4676-9b62-9d262dca963d","Type":"ContainerStarted","Data":"43893dd27cf5c7107308311f51bf00f9a6b31b2cbf63c91f2bad59264d943701"}
Sep 17 18:39:32.415490 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.415450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal" event={"ID":"1110c1a47cc9135ed0b86b2fee148271","Type":"ContainerStarted","Data":"5fc94d67162e196d7145d6d73ac24a367f91734f1b0c0bbc529efb750dded247"}
Sep 17 18:39:32.427512 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.427460    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p4298" podStartSLOduration=3.182109899 podStartE2EDuration="21.427442021s" totalImagesPullingTime="18.245332122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:32.427262617 +0000 UTC m=+23.499222658" watchObservedRunningTime="2026-09-17 18:39:32.427442021 +0000 UTC m=+23.499402052"
Sep 17 18:39:32.427695 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:32.427669    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bjqjf" podStartSLOduration=2.9983768729999998 podStartE2EDuration="21.42766134s" totalImagesPullingTime="18.429284467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:31.579212805 +0000 UTC m=+22.651172833" watchObservedRunningTime="2026-09-17 18:39:32.42766134 +0000 UTC m=+23.499621370"
Sep 17 18:39:33.420594 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:33.420492    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f" event={"ID":"c9412ee9-2a27-4eb5-b627-a455ab65eeca","Type":"ContainerStarted","Data":"0f88cc5e332d33b722814d2438a5cde4264d3409963ff4897f76c65d7186b745"}
Sep 17 18:39:33.441357 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:33.441311    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-229.ec2.internal" podStartSLOduration=22.441271667 podStartE2EDuration="22.441271667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:32.443992079 +0000 UTC m=+23.515952107" watchObservedRunningTime="2026-09-17 18:39:33.441271667 +0000 UTC m=+24.513231677"
Sep 17 18:39:33.441740 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:33.441714    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc25f" podStartSLOduration=2.512190847 podStartE2EDuration="22.44170422s" totalImagesPullingTime="19.929513373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:33.441436283 +0000 UTC m=+24.513396307" watchObservedRunningTime="2026-09-17 18:39:33.44170422 +0000 UTC m=+24.513664248"
Sep 17 18:39:34.206194 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:34.206160    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:34.206194 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:34.206177    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:34.206476 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:34.206325    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:34.206476 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:34.206347    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:34.206476 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:34.206446    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:34.206614 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:34.206525    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:34.427010 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:34.426964    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" event={"ID":"60d068af-a16a-4676-9b62-9d262dca963d","Type":"ContainerStarted","Data":"f6449de3e4435394343c6e85fe9a290d5de9f639f360a5b8f8064eb3513838a4"}
Sep 17 18:39:36.206101 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:36.205875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:36.206630 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:36.205925    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:36.206630 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:36.206130    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:36.206630 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:36.205945    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:36.206630 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:36.206192    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:36.206630 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:36.206264    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:36.343082 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:36.343050    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:36.343660 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:36.343642    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:36.433308 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:36.433266    2575 generic.go:356] "Generic (PLEG): container finished" podID="c81dc79a-21e6-4746-9941-a28ee9440300" containerID="dcb4c002309cdecb66597c6d0561bae4dc744cb4be7f4fa0fe59f1978d74c2e7" exitCode=0
Sep 17 18:39:36.433447 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:36.433349    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6gh9d" event={"ID":"c81dc79a-21e6-4746-9941-a28ee9440300","Type":"ContainerDied","Data":"dcb4c002309cdecb66597c6d0561bae4dc744cb4be7f4fa0fe59f1978d74c2e7"}
Sep 17 18:39:36.437516 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:36.437490    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" event={"ID":"60d068af-a16a-4676-9b62-9d262dca963d","Type":"ContainerStarted","Data":"633d1b44502557b6fc4b36806dbb8891bd38cbab626b094970771ae9acfa8183"}
Sep 17 18:39:36.496024 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:36.495943    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g" podStartSLOduration=7.107211345 podStartE2EDuration="25.495930925s" totalImagesPullingTime="18.38871958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:36.495560525 +0000 UTC m=+27.567520554" watchObservedRunningTime="2026-09-17 18:39:36.495930925 +0000 UTC m=+27.567890982"
Sep 17 18:39:37.442255 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.442220    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:37.442839 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.442339    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:37.442839 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.442373    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:37.457676 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.457652    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:37.457830 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.457814    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:39:37.764720 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.764476    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lsr2c"]
Sep 17 18:39:37.764879 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.764751    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:37.764879 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:37.764855    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:37.772516 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.772492    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fnh86"]
Sep 17 18:39:37.772656 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.772593    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:37.772714 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:37.772682    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:37.773124 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.773100    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xx5jd"]
Sep 17 18:39:37.773209 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:37.773201    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:37.773330 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:37.773291    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:38.445918 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:38.445878    2575 generic.go:356] "Generic (PLEG): container finished" podID="c81dc79a-21e6-4746-9941-a28ee9440300" containerID="622f9f8f22a74fff75721fcb52780da9ccc7e80282ce5f8d345f5445d3b04c00" exitCode=0
Sep 17 18:39:38.446448 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:38.445946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6gh9d" event={"ID":"c81dc79a-21e6-4746-9941-a28ee9440300","Type":"ContainerDied","Data":"622f9f8f22a74fff75721fcb52780da9ccc7e80282ce5f8d345f5445d3b04c00"}
Sep 17 18:39:39.209081 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:39.209050    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:39.209348 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:39.209144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:39.209348 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:39.209160    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:39.209348 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:39.209177    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:39.209348 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:39.209287    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:39.209512 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:39.209359    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:40.452859 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:40.452824    2575 generic.go:356] "Generic (PLEG): container finished" podID="c81dc79a-21e6-4746-9941-a28ee9440300" containerID="8a8502f20d45f88df70e392dfb01aaad990cf7da8498b67871f2c41cba9f57be" exitCode=0
Sep 17 18:39:40.453200 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:40.452881    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6gh9d" event={"ID":"c81dc79a-21e6-4746-9941-a28ee9440300","Type":"ContainerDied","Data":"8a8502f20d45f88df70e392dfb01aaad990cf7da8498b67871f2c41cba9f57be"}
Sep 17 18:39:41.208921 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:41.208889    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:41.209129 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:41.208982    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:41.209129 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:41.208990    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:41.209129 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:41.209017    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:41.209129 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:41.209114    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:41.209363 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:41.209202    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:42.166463 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:42.166418    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:42.166903 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:42.166563    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 18:39:42.167079 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:42.167058    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c75wd"
Sep 17 18:39:43.209043 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.209009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:43.209547 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.209049    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:43.209547 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.209103    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:43.209547 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.209117    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lsr2c" podUID="36555ce9-b17b-4157-9d11-357b392cb318"
Sep 17 18:39:43.209547 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.209193    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xx5jd" podUID="460b2252-a6cb-4e30-8f44-593a71adf004"
Sep 17 18:39:43.209547 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.209275    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnh86" podUID="d9aa2188-f986-4999-982d-a02dde5eba1e"
Sep 17 18:39:43.709198 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.709168    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-229.ec2.internal" event="NodeReady"
Sep 17 18:39:43.709405 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.709354    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 18:39:43.800816 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.800777    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jlvrl"]
Sep 17 18:39:43.830082 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.830051    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nrx6t"]
Sep 17 18:39:43.830251 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.830192    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:43.833743 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.833558    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 18:39:43.833743 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.833721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:43.833955 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.833879    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 18:39:43.834035 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.833878    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:43.834107 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.834042    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f9x8j\""
Sep 17 18:39:43.834107 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.834091    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs podName:d9aa2188-f986-4999-982d-a02dde5eba1e nodeName:}" failed. No retries permitted until 2026-09-17 18:40:15.834069937 +0000 UTC m=+66.906029944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs") pod "network-metrics-daemon-fnh86" (UID: "d9aa2188-f986-4999-982d-a02dde5eba1e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 18:39:43.846113 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.846087    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jlvrl"]
Sep 17 18:39:43.846230 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.846135    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrx6t"]
Sep 17 18:39:43.846230 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.846201    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrx6t"
Sep 17 18:39:43.850891 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.850870    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 18:39:43.851008 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.850870    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5pvxj\""
Sep 17 18:39:43.851008 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.850873    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 18:39:43.851206 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.851185    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 18:39:43.934580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.934501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:43.934754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.934577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqxqq\" (UniqueName: \"kubernetes.io/projected/065fa123-2fc5-43e9-920d-c34363925630-kube-api-access-kqxqq\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:43.934754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.934631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:43.934754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.934672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/065fa123-2fc5-43e9-920d-c34363925630-config-volume\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:43.934754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.934696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp5vc\" (UniqueName: \"kubernetes.io/projected/5e4f444b-7085-4351-970d-0cedab60e0e8-kube-api-access-fp5vc\") pod \"ingress-canary-nrx6t\" (UID: \"5e4f444b-7085-4351-970d-0cedab60e0e8\") " pod="openshift-ingress-canary/ingress-canary-nrx6t"
Sep 17 18:39:43.934754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.934735    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e4f444b-7085-4351-970d-0cedab60e0e8-cert\") pod \"ingress-canary-nrx6t\" (UID: \"5e4f444b-7085-4351-970d-0cedab60e0e8\") " pod="openshift-ingress-canary/ingress-canary-nrx6t"
Sep 17 18:39:43.934754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.934755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:43.935049 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:43.934769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/065fa123-2fc5-43e9-920d-c34363925630-tmp-dir\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:43.935049 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.934864    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:43.935049 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.934881    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 18:39:43.935049 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.934904    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 18:39:43.935049 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.934917    2575 projected.go:196] Error preparing data for projected volume kube-api-access-v9cts for pod openshift-network-diagnostics/network-check-target-lsr2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:43.935049 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.934930    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret podName:460b2252-a6cb-4e30-8f44-593a71adf004 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:15.934914319 +0000 UTC m=+67.006874343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret") pod "global-pull-secret-syncer-xx5jd" (UID: "460b2252-a6cb-4e30-8f44-593a71adf004") : object "kube-system"/"original-pull-secret" not registered
Sep 17 18:39:43.935049 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:43.934965    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts podName:36555ce9-b17b-4157-9d11-357b392cb318 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:15.934949567 +0000 UTC m=+67.006909572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9cts" (UniqueName: "kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts") pod "network-check-target-lsr2c" (UID: "36555ce9-b17b-4157-9d11-357b392cb318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 18:39:44.035788 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.035748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:44.036007 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.035809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqxqq\" (UniqueName: \"kubernetes.io/projected/065fa123-2fc5-43e9-920d-c34363925630-kube-api-access-kqxqq\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:44.036007 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.035880    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/065fa123-2fc5-43e9-920d-c34363925630-config-volume\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:44.036007 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:44.035893    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 18:39:44.036007 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.035906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp5vc\" (UniqueName: \"kubernetes.io/projected/5e4f444b-7085-4351-970d-0cedab60e0e8-kube-api-access-fp5vc\") pod \"ingress-canary-nrx6t\" (UID: \"5e4f444b-7085-4351-970d-0cedab60e0e8\") " pod="openshift-ingress-canary/ingress-canary-nrx6t"
Sep 17 18:39:44.036007 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.035942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e4f444b-7085-4351-970d-0cedab60e0e8-cert\") pod \"ingress-canary-nrx6t\" (UID: \"5e4f444b-7085-4351-970d-0cedab60e0e8\") " pod="openshift-ingress-canary/ingress-canary-nrx6t"
Sep 17 18:39:44.036007 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:44.035966    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls podName:065fa123-2fc5-43e9-920d-c34363925630 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:44.535945489 +0000 UTC m=+35.607905522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls") pod "dns-default-jlvrl" (UID: "065fa123-2fc5-43e9-920d-c34363925630") : secret "dns-default-metrics-tls" not found
Sep 17 18:39:44.036333 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.036017    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/065fa123-2fc5-43e9-920d-c34363925630-tmp-dir\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:44.036387 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.036366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/065fa123-2fc5-43e9-920d-c34363925630-tmp-dir\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:44.036594 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.036546    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/065fa123-2fc5-43e9-920d-c34363925630-config-volume\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:44.040831 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.040810    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e4f444b-7085-4351-970d-0cedab60e0e8-cert\") pod \"ingress-canary-nrx6t\" (UID: \"5e4f444b-7085-4351-970d-0cedab60e0e8\") " pod="openshift-ingress-canary/ingress-canary-nrx6t"
Sep 17 18:39:44.046048 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.046023    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqxqq\" (UniqueName: \"kubernetes.io/projected/065fa123-2fc5-43e9-920d-c34363925630-kube-api-access-kqxqq\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:44.046382 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.046362    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp5vc\" (UniqueName: \"kubernetes.io/projected/5e4f444b-7085-4351-970d-0cedab60e0e8-kube-api-access-fp5vc\") pod \"ingress-canary-nrx6t\" (UID: \"5e4f444b-7085-4351-970d-0cedab60e0e8\") " pod="openshift-ingress-canary/ingress-canary-nrx6t"
Sep 17 18:39:44.155510 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.155468    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nrx6t"
Sep 17 18:39:44.540347 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.539995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:44.540712 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:44.540455    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 18:39:44.540712 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:44.540533    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls podName:065fa123-2fc5-43e9-920d-c34363925630 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:45.540511074 +0000 UTC m=+36.612471096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls") pod "dns-default-jlvrl" (UID: "065fa123-2fc5-43e9-920d-c34363925630") : secret "dns-default-metrics-tls" not found
Sep 17 18:39:44.757250 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:44.757142    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nrx6t"]
Sep 17 18:39:45.205892 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.205853    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:39:45.205892 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.205853    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:39:45.206091 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.205893    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:39:45.210246 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.210222    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 18:39:45.210451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.210305    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 18:39:45.210451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.210307    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 18:39:45.210451 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.210378    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 18:39:45.211455 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.211435    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nghzc\""
Sep 17 18:39:45.211686 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.211668    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-shgtw\""
Sep 17 18:39:45.466101 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.466069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrx6t" event={"ID":"5e4f444b-7085-4351-970d-0cedab60e0e8","Type":"ContainerStarted","Data":"567237756e2aa402ed7d0a1fd1d0b65ee857be98637b59d26ca3fdafa496bcfa"}
Sep 17 18:39:45.469363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.469337    2575 generic.go:356] "Generic (PLEG): container finished" podID="c81dc79a-21e6-4746-9941-a28ee9440300" containerID="09166cc53095f13d1f5d19b722004cf96a1e1023fc5333fe2485f975529f00aa" exitCode=0
Sep 17 18:39:45.469493 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.469389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6gh9d" event={"ID":"c81dc79a-21e6-4746-9941-a28ee9440300","Type":"ContainerDied","Data":"09166cc53095f13d1f5d19b722004cf96a1e1023fc5333fe2485f975529f00aa"}
Sep 17 18:39:45.548995 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:45.548961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:45.549527 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:45.549139    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 18:39:45.549527 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:45.549211    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls podName:065fa123-2fc5-43e9-920d-c34363925630 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:47.549188255 +0000 UTC m=+38.621148276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls") pod "dns-default-jlvrl" (UID: "065fa123-2fc5-43e9-920d-c34363925630") : secret "dns-default-metrics-tls" not found
Sep 17 18:39:46.475648 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:46.475610    2575 generic.go:356] "Generic (PLEG): container finished" podID="c81dc79a-21e6-4746-9941-a28ee9440300" containerID="ea95319b7fa4e8bc2ab985354fe67636827724483eb04a1c26d9169cb87bb0d9" exitCode=0
Sep 17 18:39:46.475648 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:46.475646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6gh9d" event={"ID":"c81dc79a-21e6-4746-9941-a28ee9440300","Type":"ContainerDied","Data":"ea95319b7fa4e8bc2ab985354fe67636827724483eb04a1c26d9169cb87bb0d9"}
Sep 17 18:39:47.480583 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:47.480547    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6gh9d" event={"ID":"c81dc79a-21e6-4746-9941-a28ee9440300","Type":"ContainerStarted","Data":"3c011bc8fd35bd71a99beb89cf9d726cdcc91a3c2ef0914ec90b78fb4ec373b4"}
Sep 17 18:39:47.505917 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:47.505866    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6gh9d" podStartSLOduration=7.434973593 podStartE2EDuration="36.505850063s" totalImagesPullingTime="29.07087647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:47.504259621 +0000 UTC m=+38.576219648" watchObservedRunningTime="2026-09-17 18:39:47.505850063 +0000 UTC m=+38.577810091"
Sep 17 18:39:47.565063 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:47.565031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:47.565196 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:47.565174    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 18:39:47.565273 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:47.565260    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls podName:065fa123-2fc5-43e9-920d-c34363925630 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:51.565239655 +0000 UTC m=+42.637199675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls") pod "dns-default-jlvrl" (UID: "065fa123-2fc5-43e9-920d-c34363925630") : secret "dns-default-metrics-tls" not found
Sep 17 18:39:48.485071 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:48.484868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nrx6t" event={"ID":"5e4f444b-7085-4351-970d-0cedab60e0e8","Type":"ContainerStarted","Data":"451f8cef36676567491e90140c5d66751022f9eaaf08d5f974cd8f0fd9a287e0"}
Sep 17 18:39:48.505990 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:48.505946    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nrx6t" podStartSLOduration=2.817112742 podStartE2EDuration="5.505931133s" totalImagesPullingTime="2.688818391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:39:48.505527522 +0000 UTC m=+39.577487554" watchObservedRunningTime="2026-09-17 18:39:48.505931133 +0000 UTC m=+39.577891172"
Sep 17 18:39:51.590689 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:51.590638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:51.591076 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:51.590794    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 18:39:51.591076 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:51.590859    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls podName:065fa123-2fc5-43e9-920d-c34363925630 nodeName:}" failed. No retries permitted until 2026-09-17 18:39:59.590842812 +0000 UTC m=+50.662802818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls") pod "dns-default-jlvrl" (UID: "065fa123-2fc5-43e9-920d-c34363925630") : secret "dns-default-metrics-tls" not found
Sep 17 18:39:59.643699 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:39:59.643657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:39:59.644069 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:59.643809    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 18:39:59.644069 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:39:59.643889    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls podName:065fa123-2fc5-43e9-920d-c34363925630 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:15.643869053 +0000 UTC m=+66.715829058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls") pod "dns-default-jlvrl" (UID: "065fa123-2fc5-43e9-920d-c34363925630") : secret "dns-default-metrics-tls" not found
Sep 17 18:40:03.524401 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.524373    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"]
Sep 17 18:40:03.558728 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.558701    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-tchqh"]
Sep 17 18:40:03.558884 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.558820    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.563362 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.563336    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 18:40:03.563362 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.563349    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z8fc8\""
Sep 17 18:40:03.563927 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.563904    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 18:40:03.564208 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.564188    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 18:40:03.564335 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.564228    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 18:40:03.580425 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.580398    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"]
Sep 17 18:40:03.580516 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.580434    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-tchqh"]
Sep 17 18:40:03.580516 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.580510    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.582908 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.582892    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xxrsx\""
Sep 17 18:40:03.583452 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.583435    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 17 18:40:03.583452 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.583458    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 18:40:03.583627 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.583519    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 18:40:03.584160 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.584145    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 17 18:40:03.605048 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.605025    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 17 18:40:03.671188 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.671158    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzxnn\" (UniqueName: \"kubernetes.io/projected/d330bf08-bb0d-4d21-b470-a18e54ba2c2e-kube-api-access-tzxnn\") pod \"service-ca-operator-57cdc4b768-bzz97\" (UID: \"d330bf08-bb0d-4d21-b470-a18e54ba2c2e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.671329 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.671242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d330bf08-bb0d-4d21-b470-a18e54ba2c2e-serving-cert\") pod \"service-ca-operator-57cdc4b768-bzz97\" (UID: \"d330bf08-bb0d-4d21-b470-a18e54ba2c2e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.671329 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.671267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d330bf08-bb0d-4d21-b470-a18e54ba2c2e-config\") pod \"service-ca-operator-57cdc4b768-bzz97\" (UID: \"d330bf08-bb0d-4d21-b470-a18e54ba2c2e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.723592 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.723564    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59d6448f8d-b9czb"]
Sep 17 18:40:03.736962 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.736941    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.739643 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.739624    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6grnc\""
Sep 17 18:40:03.739865 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.739850    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 18:40:03.740124 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.740109    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 18:40:03.740199 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.740171    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 18:40:03.748128 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.748105    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 18:40:03.749237 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.749216    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59d6448f8d-b9czb"]
Sep 17 18:40:03.772332 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6cf6711-d48f-4b3b-a994-d49bc70626df-tmp\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.772414 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772336    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6cf6711-d48f-4b3b-a994-d49bc70626df-serving-cert\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.772453 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d330bf08-bb0d-4d21-b470-a18e54ba2c2e-serving-cert\") pod \"service-ca-operator-57cdc4b768-bzz97\" (UID: \"d330bf08-bb0d-4d21-b470-a18e54ba2c2e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.772453 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d330bf08-bb0d-4d21-b470-a18e54ba2c2e-config\") pod \"service-ca-operator-57cdc4b768-bzz97\" (UID: \"d330bf08-bb0d-4d21-b470-a18e54ba2c2e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.772527 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6cf6711-d48f-4b3b-a994-d49bc70626df-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.772597 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbmv9\" (UniqueName: \"kubernetes.io/projected/c6cf6711-d48f-4b3b-a994-d49bc70626df-kube-api-access-dbmv9\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.772651 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzxnn\" (UniqueName: \"kubernetes.io/projected/d330bf08-bb0d-4d21-b470-a18e54ba2c2e-kube-api-access-tzxnn\") pod \"service-ca-operator-57cdc4b768-bzz97\" (UID: \"d330bf08-bb0d-4d21-b470-a18e54ba2c2e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.772704 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c6cf6711-d48f-4b3b-a994-d49bc70626df-snapshots\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.772760 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6cf6711-d48f-4b3b-a994-d49bc70626df-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.772945 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.772929    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d330bf08-bb0d-4d21-b470-a18e54ba2c2e-config\") pod \"service-ca-operator-57cdc4b768-bzz97\" (UID: \"d330bf08-bb0d-4d21-b470-a18e54ba2c2e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.775626 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.775581    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d330bf08-bb0d-4d21-b470-a18e54ba2c2e-serving-cert\") pod \"service-ca-operator-57cdc4b768-bzz97\" (UID: \"d330bf08-bb0d-4d21-b470-a18e54ba2c2e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.783676 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.783656    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzxnn\" (UniqueName: \"kubernetes.io/projected/d330bf08-bb0d-4d21-b470-a18e54ba2c2e-kube-api-access-tzxnn\") pod \"service-ca-operator-57cdc4b768-bzz97\" (UID: \"d330bf08-bb0d-4d21-b470-a18e54ba2c2e\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.871031 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.871002    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"
Sep 17 18:40:03.873281 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6cf6711-d48f-4b3b-a994-d49bc70626df-tmp\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.873433 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6cf6711-d48f-4b3b-a994-d49bc70626df-serving-cert\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.873433 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-image-registry-private-configuration\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.873433 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873361    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-registry-certificates\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.873433 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873383    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-trusted-ca\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.873433 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.873690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbb12915-3e73-4a80-851b-4d122b20b391-ca-trust-extracted\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.873690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-installation-pull-secrets\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.873690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6cf6711-d48f-4b3b-a994-d49bc70626df-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.873690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873551    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbmv9\" (UniqueName: \"kubernetes.io/projected/c6cf6711-d48f-4b3b-a994-d49bc70626df-kube-api-access-dbmv9\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.873690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c6cf6711-d48f-4b3b-a994-d49bc70626df-snapshots\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.873690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6cf6711-d48f-4b3b-a994-d49bc70626df-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.873690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-bound-sa-token\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.873690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qlnf\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-kube-api-access-4qlnf\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.873973 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.873706    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6cf6711-d48f-4b3b-a994-d49bc70626df-tmp\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.874130 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.874113    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c6cf6711-d48f-4b3b-a994-d49bc70626df-snapshots\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.874193 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.874172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6cf6711-d48f-4b3b-a994-d49bc70626df-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.874277 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.874262    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6cf6711-d48f-4b3b-a994-d49bc70626df-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.875619 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.875593    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c6cf6711-d48f-4b3b-a994-d49bc70626df-serving-cert\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.882264 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.882242    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbmv9\" (UniqueName: \"kubernetes.io/projected/c6cf6711-d48f-4b3b-a994-d49bc70626df-kube-api-access-dbmv9\") pod \"insights-operator-6f9c644dd9-tchqh\" (UID: \"c6cf6711-d48f-4b3b-a994-d49bc70626df\") " pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.889069 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.889051    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-tchqh"
Sep 17 18:40:03.974875 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.974772    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-bound-sa-token\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.974875 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.974804    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qlnf\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-kube-api-access-4qlnf\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.974875 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.974843    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-image-registry-private-configuration\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.974875 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.974860    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-registry-certificates\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.974875 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.974881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-trusted-ca\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.975144 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.974906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.975144 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.974921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbb12915-3e73-4a80-851b-4d122b20b391-ca-trust-extracted\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.975144 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.974937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-installation-pull-secrets\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.975448 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:03.975421    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 18:40:03.975513 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:03.975455    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d6448f8d-b9czb: secret "image-registry-tls" not found
Sep 17 18:40:03.975566 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:03.975532    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls podName:dbb12915-3e73-4a80-851b-4d122b20b391 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:04.475509393 +0000 UTC m=+55.547469414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls") pod "image-registry-59d6448f8d-b9czb" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391") : secret "image-registry-tls" not found
Sep 17 18:40:03.975758 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.975734    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-registry-certificates\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.975957 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.975936    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbb12915-3e73-4a80-851b-4d122b20b391-ca-trust-extracted\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.976992 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.976964    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-trusted-ca\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.978401 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.978379    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-image-registry-private-configuration\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.978640 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.978621    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-installation-pull-secrets\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.986703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.986681    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-bound-sa-token\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:03.986921 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:03.986906    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qlnf\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-kube-api-access-4qlnf\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:04.170028 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:04.169817    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97"]
Sep 17 18:40:04.172772 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:04.172734    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd330bf08_bb0d_4d21_b470_a18e54ba2c2e.slice/crio-a094cb2fd2045aa5f95a3093c0020678999acd3132761572868ca385f2b5121a WatchSource:0}: Error finding container a094cb2fd2045aa5f95a3093c0020678999acd3132761572868ca385f2b5121a: Status 404 returned error can't find the container with id a094cb2fd2045aa5f95a3093c0020678999acd3132761572868ca385f2b5121a
Sep 17 18:40:04.190997 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:04.190973    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-tchqh"]
Sep 17 18:40:04.193560 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:04.193536    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6cf6711_d48f_4b3b_a994_d49bc70626df.slice/crio-4122788e0e3273a04b54ee24dd1272349819608f87f4c292bf79cb9bfaf24b38 WatchSource:0}: Error finding container 4122788e0e3273a04b54ee24dd1272349819608f87f4c292bf79cb9bfaf24b38: Status 404 returned error can't find the container with id 4122788e0e3273a04b54ee24dd1272349819608f87f4c292bf79cb9bfaf24b38
Sep 17 18:40:04.478554 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:04.478513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:04.478729 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:04.478683    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 18:40:04.478729 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:04.478698    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d6448f8d-b9czb: secret "image-registry-tls" not found
Sep 17 18:40:04.478803 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:04.478756    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls podName:dbb12915-3e73-4a80-851b-4d122b20b391 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:05.478738 +0000 UTC m=+56.550698009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls") pod "image-registry-59d6448f8d-b9czb" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391") : secret "image-registry-tls" not found
Sep 17 18:40:04.523580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:04.523543    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-tchqh" event={"ID":"c6cf6711-d48f-4b3b-a994-d49bc70626df","Type":"ContainerStarted","Data":"4122788e0e3273a04b54ee24dd1272349819608f87f4c292bf79cb9bfaf24b38"}
Sep 17 18:40:04.524595 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:04.524575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97" event={"ID":"d330bf08-bb0d-4d21-b470-a18e54ba2c2e","Type":"ContainerStarted","Data":"a094cb2fd2045aa5f95a3093c0020678999acd3132761572868ca385f2b5121a"}
Sep 17 18:40:05.485525 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:05.485482    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:05.485726 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:05.485640    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 18:40:05.485726 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:05.485660    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d6448f8d-b9czb: secret "image-registry-tls" not found
Sep 17 18:40:05.485831 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:05.485731    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls podName:dbb12915-3e73-4a80-851b-4d122b20b391 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:07.485709215 +0000 UTC m=+58.557669235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls") pod "image-registry-59d6448f8d-b9czb" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391") : secret "image-registry-tls" not found
Sep 17 18:40:07.501550 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:07.501516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:07.502041 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:07.501710    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 18:40:07.502041 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:07.501735    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d6448f8d-b9czb: secret "image-registry-tls" not found
Sep 17 18:40:07.502041 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:07.501805    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls podName:dbb12915-3e73-4a80-851b-4d122b20b391 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:11.501783985 +0000 UTC m=+62.573744010 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls") pod "image-registry-59d6448f8d-b9czb" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391") : secret "image-registry-tls" not found
Sep 17 18:40:07.534659 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:07.534622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-tchqh" event={"ID":"c6cf6711-d48f-4b3b-a994-d49bc70626df","Type":"ContainerStarted","Data":"b4a125624e5de24dfb666e092033f90389b6dfbbff5b9ae6081baa8141148673"}
Sep 17 18:40:07.536374 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:07.536326    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97" event={"ID":"d330bf08-bb0d-4d21-b470-a18e54ba2c2e","Type":"ContainerStarted","Data":"b8a090854a46cc293cde766e09a311da42887141a8203b8fe0eed357951d768b"}
Sep 17 18:40:07.562978 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:07.562919    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-tchqh" podStartSLOduration=1.5729706289999998 podStartE2EDuration="4.562899004s" totalImagesPullingTime="2.989928375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:07.56185293 +0000 UTC m=+58.633812958" watchObservedRunningTime="2026-09-17 18:40:07.562899004 +0000 UTC m=+58.634859037"
Sep 17 18:40:08.289199 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.289140    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97" podStartSLOduration=2.283662987 podStartE2EDuration="5.289120928s" totalImagesPullingTime="3.005457941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:07.582002289 +0000 UTC m=+58.653962317" watchObservedRunningTime="2026-09-17 18:40:08.289120928 +0000 UTC m=+59.361080985"
Sep 17 18:40:08.289399 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.289384    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mqc79"]
Sep 17 18:40:08.317735 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.317708    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqc79"]
Sep 17 18:40:08.317907 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.317837    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.343594 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.343566    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 18:40:08.356467 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.356440    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 18:40:08.356574 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.356442    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vr4zj\""
Sep 17 18:40:08.409033 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.408997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.409179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.409085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24871cd7-bf2a-4e53-984f-0d7a603c266a-crio-socket\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.409179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.409111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.409179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.409134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2sd2\" (UniqueName: \"kubernetes.io/projected/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-api-access-h2sd2\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.409361 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.409231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24871cd7-bf2a-4e53-984f-0d7a603c266a-data-volume\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.509754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.509722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24871cd7-bf2a-4e53-984f-0d7a603c266a-crio-socket\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.509754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.509756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.510217 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.509772    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sd2\" (UniqueName: \"kubernetes.io/projected/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-api-access-h2sd2\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.510217 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:08.509862    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 18:40:08.510217 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.509873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24871cd7-bf2a-4e53-984f-0d7a603c266a-data-volume\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.510217 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:08.509942    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:09.009923052 +0000 UTC m=+60.081883058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : configmap "kube-rbac-proxy" not found
Sep 17 18:40:08.510217 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.509965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.510217 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.509969    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/24871cd7-bf2a-4e53-984f-0d7a603c266a-crio-socket\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.510217 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:08.510103    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:08.510217 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:08.510156    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:09.010142734 +0000 UTC m=+60.082102740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:08.510551 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.510226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/24871cd7-bf2a-4e53-984f-0d7a603c266a-data-volume\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.522861 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.522833    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq"]
Sep 17 18:40:08.529240 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.529214    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2sd2\" (UniqueName: \"kubernetes.io/projected/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-api-access-h2sd2\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:08.543261 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.543207    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq"]
Sep 17 18:40:08.543395 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.543285    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq"
Sep 17 18:40:08.545939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.545894    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 18:40:08.545939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.545924    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lxm8v\""
Sep 17 18:40:08.546097 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.545963    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 18:40:08.610662 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.610627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgjkr\" (UniqueName: \"kubernetes.io/projected/39275510-0f5f-430a-8dc8-bf7aa9e9e0a3-kube-api-access-wgjkr\") pod \"migrator-76794cbd6c-6t8vq\" (UID: \"39275510-0f5f-430a-8dc8-bf7aa9e9e0a3\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq"
Sep 17 18:40:08.711495 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.711464    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgjkr\" (UniqueName: \"kubernetes.io/projected/39275510-0f5f-430a-8dc8-bf7aa9e9e0a3-kube-api-access-wgjkr\") pod \"migrator-76794cbd6c-6t8vq\" (UID: \"39275510-0f5f-430a-8dc8-bf7aa9e9e0a3\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq"
Sep 17 18:40:08.722148 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.722114    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgjkr\" (UniqueName: \"kubernetes.io/projected/39275510-0f5f-430a-8dc8-bf7aa9e9e0a3-kube-api-access-wgjkr\") pod \"migrator-76794cbd6c-6t8vq\" (UID: \"39275510-0f5f-430a-8dc8-bf7aa9e9e0a3\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq"
Sep 17 18:40:08.856657 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:08.856570    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq"
Sep 17 18:40:09.016162 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:09.016125    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:09.016355 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:09.016184    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:09.016355 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:09.016254    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 18:40:09.016355 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:09.016278    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:09.016464 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:09.016361    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:10.016338284 +0000 UTC m=+61.088298303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:09.016464 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:09.016377    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:10.016370921 +0000 UTC m=+61.088330927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : configmap "kube-rbac-proxy" not found
Sep 17 18:40:09.136947 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:09.136898    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq"]
Sep 17 18:40:09.139092 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:09.139063    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39275510_0f5f_430a_8dc8_bf7aa9e9e0a3.slice/crio-b562c1769b8286b84e39d97bba1cdfd8d9ba296f929feeda84b34b507b0c7ce0 WatchSource:0}: Error finding container b562c1769b8286b84e39d97bba1cdfd8d9ba296f929feeda84b34b507b0c7ce0: Status 404 returned error can't find the container with id b562c1769b8286b84e39d97bba1cdfd8d9ba296f929feeda84b34b507b0c7ce0
Sep 17 18:40:09.463180 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:09.463157    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m8q7g"
Sep 17 18:40:09.544106 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:09.544075    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq" event={"ID":"39275510-0f5f-430a-8dc8-bf7aa9e9e0a3","Type":"ContainerStarted","Data":"b562c1769b8286b84e39d97bba1cdfd8d9ba296f929feeda84b34b507b0c7ce0"}
Sep 17 18:40:10.025445 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:10.025407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:10.025630 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:10.025483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:10.025630 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:10.025549    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 18:40:10.025630 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:10.025612    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:10.025630 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:10.025624    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:12.025604237 +0000 UTC m=+63.097564246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : configmap "kube-rbac-proxy" not found
Sep 17 18:40:10.025790 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:10.025654    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:12.025642385 +0000 UTC m=+63.097602411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:10.249729 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:10.249698    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fg6p8_6c89642d-8115-4b12-b994-80b4fdd94aa4/dns-node-resolver/0.log"
Sep 17 18:40:11.255248 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:11.255184    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7csz9_2bf32f3c-313e-41ec-a8de-e02bca764270/node-ca/0.log"
Sep 17 18:40:11.536168 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:11.536077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:11.536375 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:11.536239    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 18:40:11.536375 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:11.536263    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d6448f8d-b9czb: secret "image-registry-tls" not found
Sep 17 18:40:11.536375 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:11.536355    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls podName:dbb12915-3e73-4a80-851b-4d122b20b391 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:19.536334597 +0000 UTC m=+70.608294618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls") pod "image-registry-59d6448f8d-b9czb" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391") : secret "image-registry-tls" not found
Sep 17 18:40:11.550891 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:11.550858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq" event={"ID":"39275510-0f5f-430a-8dc8-bf7aa9e9e0a3","Type":"ContainerStarted","Data":"4dc21c5caa318ff5d34b660bbdeac74d1b470b9ef4b26e06b9266c31e7826680"}
Sep 17 18:40:11.551021 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:11.550909    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq" event={"ID":"39275510-0f5f-430a-8dc8-bf7aa9e9e0a3","Type":"ContainerStarted","Data":"1cc72cdf68b4c688dd78d8f0c4b17ace992595f77898f30c6735030c0ae270cf"}
Sep 17 18:40:11.577185 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:11.577140    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6t8vq" podStartSLOduration=1.768693761 podStartE2EDuration="3.577128277s" totalImagesPullingTime="1.808434516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:11.575842855 +0000 UTC m=+62.647802882" watchObservedRunningTime="2026-09-17 18:40:11.577128277 +0000 UTC m=+62.649088305"
Sep 17 18:40:12.040107 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:12.040073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:12.040269 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:12.040131    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:12.040269 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:12.040188    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 18:40:12.040269 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:12.040218    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:12.040269 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:12.040258    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:16.04024174 +0000 UTC m=+67.112201763 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : configmap "kube-rbac-proxy" not found
Sep 17 18:40:12.040433 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:12.040273    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:16.04026686 +0000 UTC m=+67.112226867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:12.052693 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:12.052670    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrx6t_5e4f444b-7085-4351-970d-0cedab60e0e8/serve-healthcheck-canary/0.log"
Sep 17 18:40:15.668665 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.668630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:40:15.669037 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:15.668792    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 18:40:15.669037 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:15.668863    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls podName:065fa123-2fc5-43e9-920d-c34363925630 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:47.668845932 +0000 UTC m=+98.740805938 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls") pod "dns-default-jlvrl" (UID: "065fa123-2fc5-43e9-920d-c34363925630") : secret "dns-default-metrics-tls" not found
Sep 17 18:40:15.870491 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.870458    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:40:15.873507 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.873485    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 18:40:15.880930 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:15.880909    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 18:40:15.881043 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:15.880978    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs podName:d9aa2188-f986-4999-982d-a02dde5eba1e nodeName:}" failed. No retries permitted until 2026-09-17 18:41:19.880957988 +0000 UTC m=+130.952917994 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs") pod "network-metrics-daemon-fnh86" (UID: "d9aa2188-f986-4999-982d-a02dde5eba1e") : secret "metrics-daemon-secret" not found
Sep 17 18:40:15.971188 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.971152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:40:15.971385 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.971213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:40:15.976125 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.976100    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 18:40:15.976198 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.976170    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 18:40:15.983966 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.983943    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/460b2252-a6cb-4e30-8f44-593a71adf004-original-pull-secret\") pod \"global-pull-secret-syncer-xx5jd\" (UID: \"460b2252-a6cb-4e30-8f44-593a71adf004\") " pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:40:15.984349 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.984329    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 18:40:15.994483 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:15.994459    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9cts\" (UniqueName: \"kubernetes.io/projected/36555ce9-b17b-4157-9d11-357b392cb318-kube-api-access-v9cts\") pod \"network-check-target-lsr2c\" (UID: \"36555ce9-b17b-4157-9d11-357b392cb318\") " pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:40:16.072279 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:16.072238    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:16.072506 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:16.072313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:16.072506 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:16.072385    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 18:40:16.072506 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:16.072424    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:16.072506 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:16.072465    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:24.072442745 +0000 UTC m=+75.144402767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : configmap "kube-rbac-proxy" not found
Sep 17 18:40:16.072506 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:16.072486    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:24.072477592 +0000 UTC m=+75.144437598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:16.115696 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:16.115663    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xx5jd"
Sep 17 18:40:16.127625 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:16.127596    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-shgtw\""
Sep 17 18:40:16.131741 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:16.131714    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:40:16.393561 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:16.393492    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xx5jd"]
Sep 17 18:40:16.417466 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:16.417443    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lsr2c"]
Sep 17 18:40:16.420019 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:16.419986    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36555ce9_b17b_4157_9d11_357b392cb318.slice/crio-87764e954b8e73e90c1a9f162a1cb4098b5acb1b9d1c28e7092a5adaa396a0f5 WatchSource:0}: Error finding container 87764e954b8e73e90c1a9f162a1cb4098b5acb1b9d1c28e7092a5adaa396a0f5: Status 404 returned error can't find the container with id 87764e954b8e73e90c1a9f162a1cb4098b5acb1b9d1c28e7092a5adaa396a0f5
Sep 17 18:40:16.564291 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:16.564252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xx5jd" event={"ID":"460b2252-a6cb-4e30-8f44-593a71adf004","Type":"ContainerStarted","Data":"3271fc4e0811024d66e8df059794c14318d6ab8677531daca54e56807218b34d"}
Sep 17 18:40:16.565321 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:16.565283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lsr2c" event={"ID":"36555ce9-b17b-4157-9d11-357b392cb318","Type":"ContainerStarted","Data":"87764e954b8e73e90c1a9f162a1cb4098b5acb1b9d1c28e7092a5adaa396a0f5"}
Sep 17 18:40:19.600903 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:19.600861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls\") pod \"image-registry-59d6448f8d-b9czb\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") " pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:19.601336 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:19.601039    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 18:40:19.601336 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:19.601061    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59d6448f8d-b9czb: secret "image-registry-tls" not found
Sep 17 18:40:19.601336 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:19.601140    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls podName:dbb12915-3e73-4a80-851b-4d122b20b391 nodeName:}" failed. No retries permitted until 2026-09-17 18:40:35.601120817 +0000 UTC m=+86.673080827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls") pod "image-registry-59d6448f8d-b9czb" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391") : secret "image-registry-tls" not found
Sep 17 18:40:21.582004 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:21.581869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xx5jd" event={"ID":"460b2252-a6cb-4e30-8f44-593a71adf004","Type":"ContainerStarted","Data":"1b55e59421dd0156f263b43325dbb9e74d80a1f5e67c0c7408f7e4cc788f9ce1"}
Sep 17 18:40:21.583236 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:21.583207    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lsr2c" event={"ID":"36555ce9-b17b-4157-9d11-357b392cb318","Type":"ContainerStarted","Data":"366902db467bc0dcbbf072604a083166fca3316a9db5872dbea8189dbeee76ac"}
Sep 17 18:40:21.583377 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:21.583361    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:40:21.598468 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:21.598426    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xx5jd" podStartSLOduration=66.320492121 podStartE2EDuration="1m10.59841338s" totalImagesPullingTime="4.277921259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:21.597861661 +0000 UTC m=+72.669821681" watchObservedRunningTime="2026-09-17 18:40:21.59841338 +0000 UTC m=+72.670373445"
Sep 17 18:40:21.615253 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:21.615209    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lsr2c" podStartSLOduration=66.364936524 podStartE2EDuration="1m10.615195177s" totalImagesPullingTime="4.250258653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:21.615063623 +0000 UTC m=+72.687023651" watchObservedRunningTime="2026-09-17 18:40:21.615195177 +0000 UTC m=+72.687155206"
Sep 17 18:40:24.133893 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:24.133847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:24.134292 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:24.133920    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:24.134292 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:24.134050    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:24.134292 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:24.134114    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls podName:24871cd7-bf2a-4e53-984f-0d7a603c266a nodeName:}" failed. No retries permitted until 2026-09-17 18:40:40.134099134 +0000 UTC m=+91.206059145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqc79" (UID: "24871cd7-bf2a-4e53-984f-0d7a603c266a") : secret "insights-runtime-extractor-tls" not found
Sep 17 18:40:24.134442 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:24.134418    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/24871cd7-bf2a-4e53-984f-0d7a603c266a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:32.726411 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.726378    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"]
Sep 17 18:40:32.729346 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.729330    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"
Sep 17 18:40:32.732442 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.732417    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 18:40:32.732562 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.732417    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 18:40:32.733469 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.733449    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 18:40:32.733581 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.733496    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 17 18:40:32.733581 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.733503    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cd7rw\""
Sep 17 18:40:32.745692 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.745666    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"]
Sep 17 18:40:32.772111 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.772079    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59d6448f8d-b9czb"]
Sep 17 18:40:32.772286 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:40:32.772269    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-59d6448f8d-b9czb" podUID="dbb12915-3e73-4a80-851b-4d122b20b391"
Sep 17 18:40:32.801549 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.801513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e75fbad6-74fb-4bff-bb23-a7dd0b6b371d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8\" (UID: \"e75fbad6-74fb-4bff-bb23-a7dd0b6b371d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"
Sep 17 18:40:32.801698 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.801589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvw7h\" (UniqueName: \"kubernetes.io/projected/e75fbad6-74fb-4bff-bb23-a7dd0b6b371d-kube-api-access-qvw7h\") pod \"managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8\" (UID: \"e75fbad6-74fb-4bff-bb23-a7dd0b6b371d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"
Sep 17 18:40:32.822281 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.822252    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-9msnw"]
Sep 17 18:40:32.824382 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.824363    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c55876d5b-j7w8h"]
Sep 17 18:40:32.824502 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.824486    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-9msnw"
Sep 17 18:40:32.826260 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.826244    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:32.826932 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.826916    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 18:40:32.827590 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.827573    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 18:40:32.827643 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.827616    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2b9s7\""
Sep 17 18:40:32.845593 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.845567    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-9msnw"]
Sep 17 18:40:32.846426 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.846404    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c55876d5b-j7w8h"]
Sep 17 18:40:32.902117 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902087    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4e40c48-505d-4001-8726-a0cc7ac3160f-image-registry-private-configuration\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:32.902275 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4e40c48-505d-4001-8726-a0cc7ac3160f-ca-trust-extracted\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:32.902275 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvw7h\" (UniqueName: \"kubernetes.io/projected/e75fbad6-74fb-4bff-bb23-a7dd0b6b371d-kube-api-access-qvw7h\") pod \"managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8\" (UID: \"e75fbad6-74fb-4bff-bb23-a7dd0b6b371d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"
Sep 17 18:40:32.902275 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902253    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4e40c48-505d-4001-8726-a0cc7ac3160f-trusted-ca\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:32.902397 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902340    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4e40c48-505d-4001-8726-a0cc7ac3160f-registry-tls\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:32.902431 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902416    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e75fbad6-74fb-4bff-bb23-a7dd0b6b371d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8\" (UID: \"e75fbad6-74fb-4bff-bb23-a7dd0b6b371d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"
Sep 17 18:40:32.902465 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjf8r\" (UniqueName: \"kubernetes.io/projected/ed52ef77-6f12-46bb-bef3-b11695a3c0d6-kube-api-access-wjf8r\") pod \"downloads-6594f4c75-9msnw\" (UID: \"ed52ef77-6f12-46bb-bef3-b11695a3c0d6\") " pod="openshift-console/downloads-6594f4c75-9msnw"
Sep 17 18:40:32.902498 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902469    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4e40c48-505d-4001-8726-a0cc7ac3160f-bound-sa-token\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:32.902498 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcjmv\" (UniqueName: \"kubernetes.io/projected/e4e40c48-505d-4001-8726-a0cc7ac3160f-kube-api-access-pcjmv\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:32.902580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902559    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4e40c48-505d-4001-8726-a0cc7ac3160f-registry-certificates\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:32.902615 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.902591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4e40c48-505d-4001-8726-a0cc7ac3160f-installation-pull-secrets\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:32.904811 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.904784    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e75fbad6-74fb-4bff-bb23-a7dd0b6b371d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8\" (UID: \"e75fbad6-74fb-4bff-bb23-a7dd0b6b371d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"
Sep 17 18:40:32.910651 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:32.910625    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvw7h\" (UniqueName: \"kubernetes.io/projected/e75fbad6-74fb-4bff-bb23-a7dd0b6b371d-kube-api-access-qvw7h\") pod \"managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8\" (UID: \"e75fbad6-74fb-4bff-bb23-a7dd0b6b371d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"
Sep 17 18:40:33.003003 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.002913    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjf8r\" (UniqueName: \"kubernetes.io/projected/ed52ef77-6f12-46bb-bef3-b11695a3c0d6-kube-api-access-wjf8r\") pod \"downloads-6594f4c75-9msnw\" (UID: \"ed52ef77-6f12-46bb-bef3-b11695a3c0d6\") " pod="openshift-console/downloads-6594f4c75-9msnw"
Sep 17 18:40:33.003003 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.002947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4e40c48-505d-4001-8726-a0cc7ac3160f-bound-sa-token\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.003003 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.002974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcjmv\" (UniqueName: \"kubernetes.io/projected/e4e40c48-505d-4001-8726-a0cc7ac3160f-kube-api-access-pcjmv\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.003003 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.003004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4e40c48-505d-4001-8726-a0cc7ac3160f-registry-certificates\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.003350 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.003024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4e40c48-505d-4001-8726-a0cc7ac3160f-installation-pull-secrets\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.003350 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.003054    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4e40c48-505d-4001-8726-a0cc7ac3160f-image-registry-private-configuration\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.003350 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.003086    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4e40c48-505d-4001-8726-a0cc7ac3160f-ca-trust-extracted\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.003350 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.003114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4e40c48-505d-4001-8726-a0cc7ac3160f-trusted-ca\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.003350 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.003149    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4e40c48-505d-4001-8726-a0cc7ac3160f-registry-tls\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.003615 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.003591    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e4e40c48-505d-4001-8726-a0cc7ac3160f-ca-trust-extracted\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.004035 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.004008    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e4e40c48-505d-4001-8726-a0cc7ac3160f-registry-certificates\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.004142 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.004097    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4e40c48-505d-4001-8726-a0cc7ac3160f-trusted-ca\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.005745 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.005723    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e4e40c48-505d-4001-8726-a0cc7ac3160f-registry-tls\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.005854 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.005729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e4e40c48-505d-4001-8726-a0cc7ac3160f-installation-pull-secrets\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.005854 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.005771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e4e40c48-505d-4001-8726-a0cc7ac3160f-image-registry-private-configuration\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.025578 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.025547    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjf8r\" (UniqueName: \"kubernetes.io/projected/ed52ef77-6f12-46bb-bef3-b11695a3c0d6-kube-api-access-wjf8r\") pod \"downloads-6594f4c75-9msnw\" (UID: \"ed52ef77-6f12-46bb-bef3-b11695a3c0d6\") " pod="openshift-console/downloads-6594f4c75-9msnw"
Sep 17 18:40:33.027243 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.027221    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcjmv\" (UniqueName: \"kubernetes.io/projected/e4e40c48-505d-4001-8726-a0cc7ac3160f-kube-api-access-pcjmv\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.036122 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.036101    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e4e40c48-505d-4001-8726-a0cc7ac3160f-bound-sa-token\") pod \"image-registry-7c55876d5b-j7w8h\" (UID: \"e4e40c48-505d-4001-8726-a0cc7ac3160f\") " pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.047156 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.047137    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"
Sep 17 18:40:33.133658 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.133623    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-9msnw"
Sep 17 18:40:33.140531 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.140510    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6grnc\""
Sep 17 18:40:33.148656 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.148632    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.316984 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.316903    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8"]
Sep 17 18:40:33.319628 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:33.319599    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode75fbad6_74fb_4bff_bb23_a7dd0b6b371d.slice/crio-6d9307f938537a4cb9b41e9ac0bc35d22d0f04dedb93bab11c6adc2c08ddce71 WatchSource:0}: Error finding container 6d9307f938537a4cb9b41e9ac0bc35d22d0f04dedb93bab11c6adc2c08ddce71: Status 404 returned error can't find the container with id 6d9307f938537a4cb9b41e9ac0bc35d22d0f04dedb93bab11c6adc2c08ddce71
Sep 17 18:40:33.402333 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.402281    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-9msnw"]
Sep 17 18:40:33.407235 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:33.407194    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded52ef77_6f12_46bb_bef3_b11695a3c0d6.slice/crio-b03e9785cbf101355b4507393606328e6f0c4d8c61c4793d33bb7163bf78e261 WatchSource:0}: Error finding container b03e9785cbf101355b4507393606328e6f0c4d8c61c4793d33bb7163bf78e261: Status 404 returned error can't find the container with id b03e9785cbf101355b4507393606328e6f0c4d8c61c4793d33bb7163bf78e261
Sep 17 18:40:33.431138 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.431110    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c55876d5b-j7w8h"]
Sep 17 18:40:33.433835 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:33.433808    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e40c48_505d_4001_8726_a0cc7ac3160f.slice/crio-116e3f33e52c377343a9ec6ff8b60bbade3c47ec59cfb7b795a32d963d85f296 WatchSource:0}: Error finding container 116e3f33e52c377343a9ec6ff8b60bbade3c47ec59cfb7b795a32d963d85f296: Status 404 returned error can't find the container with id 116e3f33e52c377343a9ec6ff8b60bbade3c47ec59cfb7b795a32d963d85f296
Sep 17 18:40:33.620406 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.620315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h" event={"ID":"e4e40c48-505d-4001-8726-a0cc7ac3160f","Type":"ContainerStarted","Data":"37e0dbda785e0d7fcb914f1142a09c28115019abd76cea90737468d23178ce75"}
Sep 17 18:40:33.620406 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.620371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h" event={"ID":"e4e40c48-505d-4001-8726-a0cc7ac3160f","Type":"ContainerStarted","Data":"116e3f33e52c377343a9ec6ff8b60bbade3c47ec59cfb7b795a32d963d85f296"}
Sep 17 18:40:33.620635 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.620413    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:33.621560 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.621534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-9msnw" event={"ID":"ed52ef77-6f12-46bb-bef3-b11695a3c0d6","Type":"ContainerStarted","Data":"b03e9785cbf101355b4507393606328e6f0c4d8c61c4793d33bb7163bf78e261"}
Sep 17 18:40:33.622621 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.622594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8" event={"ID":"e75fbad6-74fb-4bff-bb23-a7dd0b6b371d","Type":"ContainerStarted","Data":"6d9307f938537a4cb9b41e9ac0bc35d22d0f04dedb93bab11c6adc2c08ddce71"}
Sep 17 18:40:33.622621 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.622611    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:33.628395 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.628375    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:33.647893 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.647849    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h" podStartSLOduration=1.647834362 podStartE2EDuration="1.647834362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:33.647485816 +0000 UTC m=+84.719445844" watchObservedRunningTime="2026-09-17 18:40:33.647834362 +0000 UTC m=+84.719794380"
Sep 17 18:40:33.709554 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.709515    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbb12915-3e73-4a80-851b-4d122b20b391-ca-trust-extracted\") pod \"dbb12915-3e73-4a80-851b-4d122b20b391\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") "
Sep 17 18:40:33.709721 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.709618    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-image-registry-private-configuration\") pod \"dbb12915-3e73-4a80-851b-4d122b20b391\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") "
Sep 17 18:40:33.709721 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.709646    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-bound-sa-token\") pod \"dbb12915-3e73-4a80-851b-4d122b20b391\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") "
Sep 17 18:40:33.709721 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.709678    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-trusted-ca\") pod \"dbb12915-3e73-4a80-851b-4d122b20b391\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") "
Sep 17 18:40:33.709869 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.709748    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-installation-pull-secrets\") pod \"dbb12915-3e73-4a80-851b-4d122b20b391\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") "
Sep 17 18:40:33.709869 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.709784    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb12915-3e73-4a80-851b-4d122b20b391-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dbb12915-3e73-4a80-851b-4d122b20b391" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:40:33.709869 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.709794    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qlnf\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-kube-api-access-4qlnf\") pod \"dbb12915-3e73-4a80-851b-4d122b20b391\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") "
Sep 17 18:40:33.709869 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.709866    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-registry-certificates\") pod \"dbb12915-3e73-4a80-851b-4d122b20b391\" (UID: \"dbb12915-3e73-4a80-851b-4d122b20b391\") "
Sep 17 18:40:33.712388 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.710652    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dbb12915-3e73-4a80-851b-4d122b20b391" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:40:33.712388 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.710765    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-registry-certificates\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:40:33.712388 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.710646    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dbb12915-3e73-4a80-851b-4d122b20b391" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:40:33.712610 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.710791    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbb12915-3e73-4a80-851b-4d122b20b391-ca-trust-extracted\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:40:33.715363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.714513    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-kube-api-access-4qlnf" (OuterVolumeSpecName: "kube-api-access-4qlnf") pod "dbb12915-3e73-4a80-851b-4d122b20b391" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391"). InnerVolumeSpecName "kube-api-access-4qlnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:40:33.715498 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.715373    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dbb12915-3e73-4a80-851b-4d122b20b391" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:40:33.715885 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.715841    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dbb12915-3e73-4a80-851b-4d122b20b391" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:40:33.716044 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.716020    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dbb12915-3e73-4a80-851b-4d122b20b391" (UID: "dbb12915-3e73-4a80-851b-4d122b20b391"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:40:33.813928 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.813882    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-image-registry-private-configuration\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:40:33.813928 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.813913    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-bound-sa-token\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:40:33.813928 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.813924    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbb12915-3e73-4a80-851b-4d122b20b391-trusted-ca\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:40:33.813928 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.813932    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbb12915-3e73-4a80-851b-4d122b20b391-installation-pull-secrets\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:40:33.813928 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:33.813942    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qlnf\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-kube-api-access-4qlnf\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:40:34.626538 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:34.626503    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59d6448f8d-b9czb"
Sep 17 18:40:34.686986 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:34.686930    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59d6448f8d-b9czb"]
Sep 17 18:40:34.699382 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:34.699321    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59d6448f8d-b9czb"]
Sep 17 18:40:34.823615 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:34.823561    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbb12915-3e73-4a80-851b-4d122b20b391-registry-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:40:35.211381 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:35.211327    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb12915-3e73-4a80-851b-4d122b20b391" path="/var/lib/kubelet/pods/dbb12915-3e73-4a80-851b-4d122b20b391/volumes"
Sep 17 18:40:36.635586 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:36.635492    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8" event={"ID":"e75fbad6-74fb-4bff-bb23-a7dd0b6b371d","Type":"ContainerStarted","Data":"0918504d36ef1dd223d561890603b379907acda78dc0783334364627819acf5b"}
Sep 17 18:40:36.652375 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:36.652315    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cbb4dbcd8-vqqz8" podStartSLOduration=1.7630270000000001 podStartE2EDuration="4.652285122s" totalImagesPullingTime="2.889258122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:36.651481998 +0000 UTC m=+87.723442039" watchObservedRunningTime="2026-09-17 18:40:36.652285122 +0000 UTC m=+87.724245149"
Sep 17 18:40:40.169349 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:40.169304    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:40.172099 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:40.172069    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/24871cd7-bf2a-4e53-984f-0d7a603c266a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqc79\" (UID: \"24871cd7-bf2a-4e53-984f-0d7a603c266a\") " pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:40.430052 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:40.429958    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vr4zj\""
Sep 17 18:40:40.437280 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:40.437249    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqc79"
Sep 17 18:40:40.759543 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:40.759506    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqc79"]
Sep 17 18:40:40.764148 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:40.764113    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24871cd7_bf2a_4e53_984f_0d7a603c266a.slice/crio-f230b72a16f10c1394965ebaca8414a91116fb12cf752b599bb4730564162a0e WatchSource:0}: Error finding container f230b72a16f10c1394965ebaca8414a91116fb12cf752b599bb4730564162a0e: Status 404 returned error can't find the container with id f230b72a16f10c1394965ebaca8414a91116fb12cf752b599bb4730564162a0e
Sep 17 18:40:41.659549 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:41.659460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqc79" event={"ID":"24871cd7-bf2a-4e53-984f-0d7a603c266a","Type":"ContainerStarted","Data":"9c1d2742e1bbcc169e8d7ab24beef4c5529daa1e6f588503389168f4da497afe"}
Sep 17 18:40:41.659549 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:41.659521    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqc79" event={"ID":"24871cd7-bf2a-4e53-984f-0d7a603c266a","Type":"ContainerStarted","Data":"9e2de1b76734e1841bac4b506f57b0db07c9da7faab0db9c85fb57b32adfd667"}
Sep 17 18:40:41.659549 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:41.659541    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqc79" event={"ID":"24871cd7-bf2a-4e53-984f-0d7a603c266a","Type":"ContainerStarted","Data":"f230b72a16f10c1394965ebaca8414a91116fb12cf752b599bb4730564162a0e"}
Sep 17 18:40:46.531832 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.531791    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dd8464d78-m4hkm"]
Sep 17 18:40:46.536035 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.536011    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.538506 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.538486    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 18:40:46.539492 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.539423    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 18:40:46.539598 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.539531    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 18:40:46.539678 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.539597    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z6x4k\""
Sep 17 18:40:46.539737 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.539687    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 18:40:46.539807 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.539785    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 18:40:46.548436 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.548414    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd8464d78-m4hkm"]
Sep 17 18:40:46.721825 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.721784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-oauth-config\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.722014 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.721831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-config\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.722014 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.721865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-service-ca\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.722014 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.721910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqcxh\" (UniqueName: \"kubernetes.io/projected/a40e0d2a-e19a-4181-b6d0-27676c58f084-kube-api-access-gqcxh\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.722014 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.721968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-oauth-serving-cert\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.722235 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.722060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-serving-cert\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.822966 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.822884    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-config\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.822966 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.822925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-service-ca\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.822966 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.822953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqcxh\" (UniqueName: \"kubernetes.io/projected/a40e0d2a-e19a-4181-b6d0-27676c58f084-kube-api-access-gqcxh\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.823214 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.823004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-oauth-serving-cert\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.823420 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.823402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-serving-cert\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.823468 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.823446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-oauth-config\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.823700 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.823678    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-service-ca\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.823748 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.823705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-config\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.823748 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.823705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-oauth-serving-cert\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.826087 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.826062    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-oauth-config\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.826203 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.826149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-serving-cert\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.832430 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.832402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqcxh\" (UniqueName: \"kubernetes.io/projected/a40e0d2a-e19a-4181-b6d0-27676c58f084-kube-api-access-gqcxh\") pod \"console-5dd8464d78-m4hkm\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") " pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:46.847956 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:46.847932    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:40:47.731970 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.731928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:40:47.734552 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.734522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/065fa123-2fc5-43e9-920d-c34363925630-metrics-tls\") pod \"dns-default-jlvrl\" (UID: \"065fa123-2fc5-43e9-920d-c34363925630\") " pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:40:47.743798 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.743775    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f9x8j\""
Sep 17 18:40:47.751846 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.751813    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:40:47.871542 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.871504    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"]
Sep 17 18:40:47.874977 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.874955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:47.879357 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.879331    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 17 18:40:47.879943 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.879916    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 18:40:47.880037 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.879921    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 17 18:40:47.880692 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.880508    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 18:40:47.880692 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.880537    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 18:40:47.880692 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.880609    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pmkpq\""
Sep 17 18:40:47.891036 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.891015    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"]
Sep 17 18:40:47.896833 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.896812    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dh24d"]
Sep 17 18:40:47.900087 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.900064    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:47.902492 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.902443    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 18:40:47.902724 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.902699    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l9q9n\""
Sep 17 18:40:47.902834 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.902734    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 18:40:47.902899 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:47.902829    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 18:40:48.034711 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.034627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f579336-884f-4505-8520-d917a7b16132-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.034711 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.034683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.034955 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.034743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f579336-884f-4505-8520-d917a7b16132-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.034955 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.034786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-tls\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.034955 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.034813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-accelerators-collector-config\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.034955 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.034871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-wtmp\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.034955 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.034931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d6d91b6-6f96-48bd-84e9-b8de46779922-sys\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.035175 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.034975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmp7g\" (UniqueName: \"kubernetes.io/projected/4f579336-884f-4505-8520-d917a7b16132-kube-api-access-rmp7g\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.035175 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.035021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d6d91b6-6f96-48bd-84e9-b8de46779922-metrics-client-ca\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.035175 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.035059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d6d91b6-6f96-48bd-84e9-b8de46779922-root\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.035175 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.035150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f579336-884f-4505-8520-d917a7b16132-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.035336 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.035194    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf4rr\" (UniqueName: \"kubernetes.io/projected/7d6d91b6-6f96-48bd-84e9-b8de46779922-kube-api-access-sf4rr\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.035336 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.035229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-textfile\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.135935 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.135897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f579336-884f-4505-8520-d917a7b16132-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.136129 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.135948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-tls\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136129 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.135970    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-accelerators-collector-config\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136129 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.135999    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-wtmp\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136129 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d6d91b6-6f96-48bd-84e9-b8de46779922-sys\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136370 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmp7g\" (UniqueName: \"kubernetes.io/projected/4f579336-884f-4505-8520-d917a7b16132-kube-api-access-rmp7g\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.136370 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d6d91b6-6f96-48bd-84e9-b8de46779922-metrics-client-ca\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136370 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136210    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d6d91b6-6f96-48bd-84e9-b8de46779922-sys\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136370 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d6d91b6-6f96-48bd-84e9-b8de46779922-root\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136370 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d6d91b6-6f96-48bd-84e9-b8de46779922-root\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136370 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f579336-884f-4505-8520-d917a7b16132-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.136370 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136177    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-wtmp\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136370 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf4rr\" (UniqueName: \"kubernetes.io/projected/7d6d91b6-6f96-48bd-84e9-b8de46779922-kube-api-access-sf4rr\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136370 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-textfile\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136811 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f579336-884f-4505-8520-d917a7b16132-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.136811 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136811 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-accelerators-collector-config\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.136811 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136800    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d6d91b6-6f96-48bd-84e9-b8de46779922-metrics-client-ca\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.137008 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.136945    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-textfile\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.137558 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.137535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f579336-884f-4505-8520-d917a7b16132-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.138871 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.138804    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-tls\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.138992 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.138927    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f579336-884f-4505-8520-d917a7b16132-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.138992 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.138965    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d6d91b6-6f96-48bd-84e9-b8de46779922-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.139418 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.139397    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f579336-884f-4505-8520-d917a7b16132-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.151114 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.151081    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf4rr\" (UniqueName: \"kubernetes.io/projected/7d6d91b6-6f96-48bd-84e9-b8de46779922-kube-api-access-sf4rr\") pod \"node-exporter-dh24d\" (UID: \"7d6d91b6-6f96-48bd-84e9-b8de46779922\") " pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:48.151250 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.151116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmp7g\" (UniqueName: \"kubernetes.io/projected/4f579336-884f-4505-8520-d917a7b16132-kube-api-access-rmp7g\") pod \"openshift-state-metrics-86c5bc79d6-q7t8j\" (UID: \"4f579336-884f-4505-8520-d917a7b16132\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.186103 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.186067    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"
Sep 17 18:40:48.209570 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:48.209537    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dh24d"
Sep 17 18:40:49.162445 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.162404    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 18:40:49.166661 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.166635    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.172002 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.171856    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 18:40:49.172002 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.171864    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 18:40:49.172002 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.171864    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 18:40:49.172002 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.171913    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 18:40:49.172575 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.172549    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 18:40:49.172702 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.172592    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 18:40:49.172768 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.172759    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 18:40:49.172823 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.172773    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 18:40:49.172823 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.172784    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-72zfz\""
Sep 17 18:40:49.172930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.172784    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 18:40:49.202111 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.202084    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 18:40:49.345591 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345555    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.345780 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345609    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.345780 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-config-out\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.345780 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.345780 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345718    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-config-volume\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.345780 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4hfd\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-kube-api-access-k4hfd\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.346024 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.346024 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.346024 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.346024 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.345987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.346024 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.346016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.346264 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.346109    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.346264 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.346153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-web-config\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447126 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-web-config\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447126 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447126 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447398 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447258    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-config-out\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447398 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447329    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447398 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-config-volume\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447550 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4hfd\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-kube-api-access-k4hfd\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447601 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447557    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447657 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447725 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447725 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447830 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447830 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.447830 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.447803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.448705 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.448676    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.450664 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.450622    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.451386 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.450804    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-config-volume\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.451386 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.450875    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.451386 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.450882    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.451386 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.451278    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.451386 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.451280    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-config-out\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.452003 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.451981    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-web-config\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.452351 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.452329    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.452615 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.452596    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.452786 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.452767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.468714 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.468688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4hfd\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-kube-api-access-k4hfd\") pod \"alertmanager-main-0\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.477357 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.477334    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:40:49.683860 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:49.683830    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6d91b6_6f96_48bd_84e9_b8de46779922.slice/crio-0097619641b7b69ad7f27be71e922d8c8fb77569fb6a3f9fe05cb2ae8a06bcfa WatchSource:0}: Error finding container 0097619641b7b69ad7f27be71e922d8c8fb77569fb6a3f9fe05cb2ae8a06bcfa: Status 404 returned error can't find the container with id 0097619641b7b69ad7f27be71e922d8c8fb77569fb6a3f9fe05cb2ae8a06bcfa
Sep 17 18:40:49.986288 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:49.986201    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jlvrl"]
Sep 17 18:40:49.995168 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:49.995135    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod065fa123_2fc5_43e9_920d_c34363925630.slice/crio-778fd20f9d9a312d1cda5f7fc49aaccf23274e24cbdf8ec8c4c2a4687a5f5bdd WatchSource:0}: Error finding container 778fd20f9d9a312d1cda5f7fc49aaccf23274e24cbdf8ec8c4c2a4687a5f5bdd: Status 404 returned error can't find the container with id 778fd20f9d9a312d1cda5f7fc49aaccf23274e24cbdf8ec8c4c2a4687a5f5bdd
Sep 17 18:40:50.011630 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.011602    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd8464d78-m4hkm"]
Sep 17 18:40:50.014050 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.014022    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 18:40:50.019816 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.018533    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j"]
Sep 17 18:40:50.025082 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:50.025039    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f579336_884f_4505_8520_d917a7b16132.slice/crio-6d0f16486060e0f3e82df3cf0982ac4117096df5751dd39f74321fdbf4a213fe WatchSource:0}: Error finding container 6d0f16486060e0f3e82df3cf0982ac4117096df5751dd39f74321fdbf4a213fe: Status 404 returned error can't find the container with id 6d0f16486060e0f3e82df3cf0982ac4117096df5751dd39f74321fdbf4a213fe
Sep 17 18:40:50.699460 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.699337    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerStarted","Data":"673311237e876d8f9e821f544a786271f7e8cb6cbf7e80ee9da9d0873bd0e84b"}
Sep 17 18:40:50.701447 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.701414    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd8464d78-m4hkm" event={"ID":"a40e0d2a-e19a-4181-b6d0-27676c58f084","Type":"ContainerStarted","Data":"a0bd8e57c70bb63918f72a18c87ab95b4fe94515f7612fafa5605426ba31528c"}
Sep 17 18:40:50.707118 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.707076    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh24d" event={"ID":"7d6d91b6-6f96-48bd-84e9-b8de46779922","Type":"ContainerStarted","Data":"0097619641b7b69ad7f27be71e922d8c8fb77569fb6a3f9fe05cb2ae8a06bcfa"}
Sep 17 18:40:50.715479 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.714506    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqc79" event={"ID":"24871cd7-bf2a-4e53-984f-0d7a603c266a","Type":"ContainerStarted","Data":"4d26664d2282fe35e744bc48290d895858f4924bb0afac5e743ac10b7d948af8"}
Sep 17 18:40:50.721117 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.720924    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j" event={"ID":"4f579336-884f-4505-8520-d917a7b16132","Type":"ContainerStarted","Data":"7048437a3a158d2764aec6af1fa939f04f5a130bfac5a7593e0acbcaccb99ddf"}
Sep 17 18:40:50.721117 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.720985    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j" event={"ID":"4f579336-884f-4505-8520-d917a7b16132","Type":"ContainerStarted","Data":"1631cfc354b9724b5333b91a153404511e6509c447a887ef6450039bc5f9fb60"}
Sep 17 18:40:50.721117 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.721015    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j" event={"ID":"4f579336-884f-4505-8520-d917a7b16132","Type":"ContainerStarted","Data":"6d0f16486060e0f3e82df3cf0982ac4117096df5751dd39f74321fdbf4a213fe"}
Sep 17 18:40:50.726321 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.726182    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-9msnw" event={"ID":"ed52ef77-6f12-46bb-bef3-b11695a3c0d6","Type":"ContainerStarted","Data":"61f424e36f4a9bcec7900f4511940e2ceaa808297353cba277ea4391b69c0807"}
Sep 17 18:40:50.727268 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.727199    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-9msnw"
Sep 17 18:40:50.729802 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.729744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jlvrl" event={"ID":"065fa123-2fc5-43e9-920d-c34363925630","Type":"ContainerStarted","Data":"778fd20f9d9a312d1cda5f7fc49aaccf23274e24cbdf8ec8c4c2a4687a5f5bdd"}
Sep 17 18:40:50.740221 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.740174    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-9msnw"
Sep 17 18:40:50.752906 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.752814    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mqc79" podStartSLOduration=33.971130569 podStartE2EDuration="42.752795339s" totalImagesPullingTime="8.78166477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:40:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:50.7495068 +0000 UTC m=+101.821466829" watchObservedRunningTime="2026-09-17 18:40:50.752795339 +0000 UTC m=+101.824755379"
Sep 17 18:40:50.789320 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:50.788503    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-9msnw" podStartSLOduration=2.446268071 podStartE2EDuration="18.788481433s" totalImagesPullingTime="16.342213362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:50.786895263 +0000 UTC m=+101.858855305" watchObservedRunningTime="2026-09-17 18:40:50.788481433 +0000 UTC m=+101.860441463"
Sep 17 18:40:51.746628 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.745379    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cb8b78d6d-hf62q"]
Sep 17 18:40:51.753180 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.752592    2575 generic.go:356] "Generic (PLEG): container finished" podID="7d6d91b6-6f96-48bd-84e9-b8de46779922" containerID="c467e92d1a700e95d0a62b5cec4741a70f0f06e0aa987d453822c28ab1d31528" exitCode=0
Sep 17 18:40:51.785094 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.784460    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb8b78d6d-hf62q"]
Sep 17 18:40:51.785094 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.784508    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh24d" event={"ID":"7d6d91b6-6f96-48bd-84e9-b8de46779922","Type":"ContainerDied","Data":"c467e92d1a700e95d0a62b5cec4741a70f0f06e0aa987d453822c28ab1d31528"}
Sep 17 18:40:51.785094 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.784606    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.806080 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.806049    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 18:40:51.884452 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.884004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-trusted-ca-bundle\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.884452 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.884053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-oauth-config\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.884452 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.884110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-service-ca\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.884452 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.884146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-oauth-serving-cert\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.884452 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.884214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7267\" (UniqueName: \"kubernetes.io/projected/b750729d-d06c-4dca-894d-c2515543a2b1-kube-api-access-c7267\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.884452 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.884241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-console-config\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.884452 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.884324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-serving-cert\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.985372 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.984856    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-trusted-ca-bundle\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.985372 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.984899    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-oauth-config\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.985372 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.984946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-service-ca\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.985372 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.984979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-oauth-serving-cert\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.985372 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.985038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7267\" (UniqueName: \"kubernetes.io/projected/b750729d-d06c-4dca-894d-c2515543a2b1-kube-api-access-c7267\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.985372 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.985062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-console-config\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.985372 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.985117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-serving-cert\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.986141 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.986037    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-trusted-ca-bundle\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.986915 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.986653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-oauth-serving-cert\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.986915 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.986859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-service-ca\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.987207 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.987149    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-console-config\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.994153 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.994124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-serving-cert\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.996923 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.996853    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-oauth-config\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:51.998245 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:51.998171    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7267\" (UniqueName: \"kubernetes.io/projected/b750729d-d06c-4dca-894d-c2515543a2b1-kube-api-access-c7267\") pod \"console-6cb8b78d6d-hf62q\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") " pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:52.109175 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:52.109139    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:40:52.458440 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:52.458408    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb8b78d6d-hf62q"]
Sep 17 18:40:52.589546 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:52.588714    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lsr2c"
Sep 17 18:40:52.761318 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:52.760505    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh24d" event={"ID":"7d6d91b6-6f96-48bd-84e9-b8de46779922","Type":"ContainerStarted","Data":"6b4a10b7c68c89890f442f198f023a7e64e318359a50b56986487491c1355ff8"}
Sep 17 18:40:52.761318 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:52.760575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh24d" event={"ID":"7d6d91b6-6f96-48bd-84e9-b8de46779922","Type":"ContainerStarted","Data":"2e7ccf7aa90a9755e5ba5dbbeea790446487ec75271a786b053349d1c12a8d9d"}
Sep 17 18:40:52.788142 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:52.788084    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dh24d" podStartSLOduration=4.153269076 podStartE2EDuration="5.788066136s" totalImagesPullingTime="1.513150978s" totalInitContainerRuntime="121.646082ms" isStatefulPod=true podCreationTimestamp="2026-09-17 18:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:52.786235898 +0000 UTC m=+103.858195928" watchObservedRunningTime="2026-09-17 18:40:52.788066136 +0000 UTC m=+103.860026164"
Sep 17 18:40:52.792593 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:52.792547    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb750729d_d06c_4dca_894d_c2515543a2b1.slice/crio-f118ac3770bfe5d8a8e6cbb00ab8de0348904d2dc1f9680d68719233107a80e5 WatchSource:0}: Error finding container f118ac3770bfe5d8a8e6cbb00ab8de0348904d2dc1f9680d68719233107a80e5: Status 404 returned error can't find the container with id f118ac3770bfe5d8a8e6cbb00ab8de0348904d2dc1f9680d68719233107a80e5
Sep 17 18:40:53.357771 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.357664    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd8464d78-m4hkm"]
Sep 17 18:40:53.399712 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.399656    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-869fd4dc4d-rv482"]
Sep 17 18:40:53.427149 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.427116    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869fd4dc4d-rv482"]
Sep 17 18:40:53.427339 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.427247    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.499097 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.499060    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-oauth-serving-cert\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.499286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.499131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-oauth-config\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.499286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.499165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-serving-cert\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.499286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.499192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-service-ca\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.499286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.499224    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-config\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.499286 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.499272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-trusted-ca-bundle\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.499552 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.499328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2qd\" (UniqueName: \"kubernetes.io/projected/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-kube-api-access-2n2qd\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.600524 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.600486    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-oauth-serving-cert\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.600703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.600556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-oauth-config\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.600703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.600592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-serving-cert\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.600703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.600617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-service-ca\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.600703 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.600674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-config\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.600920 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.600743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-trusted-ca-bundle\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.600920 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.600793    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2qd\" (UniqueName: \"kubernetes.io/projected/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-kube-api-access-2n2qd\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.601398 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.601376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-service-ca\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.601515 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.601416    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-config\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.602124 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.602071    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-oauth-serving-cert\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.602331 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.602226    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-trusted-ca-bundle\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.603954 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.603929    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-serving-cert\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.604868 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.604819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-oauth-config\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.613981 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.613912    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2qd\" (UniqueName: \"kubernetes.io/projected/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-kube-api-access-2n2qd\") pod \"console-869fd4dc4d-rv482\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") " pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.738573 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.738359    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:40:53.767704 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:53.767658    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb8b78d6d-hf62q" event={"ID":"b750729d-d06c-4dca-894d-c2515543a2b1","Type":"ContainerStarted","Data":"f118ac3770bfe5d8a8e6cbb00ab8de0348904d2dc1f9680d68719233107a80e5"}
Sep 17 18:40:54.632677 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:54.632643    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c55876d5b-j7w8h"
Sep 17 18:40:58.485341 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.485239    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869fd4dc4d-rv482"]
Sep 17 18:40:58.516005 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:40:58.515968    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5ff0b1_9dda_484a_b8ee_c9fb6a8dde9a.slice/crio-3d76c3d0bb59c794a8f9ab838e288cbcace7d449efd82579a4e15b13f49a5e2a WatchSource:0}: Error finding container 3d76c3d0bb59c794a8f9ab838e288cbcace7d449efd82579a4e15b13f49a5e2a: Status 404 returned error can't find the container with id 3d76c3d0bb59c794a8f9ab838e288cbcace7d449efd82579a4e15b13f49a5e2a
Sep 17 18:40:58.793549 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.793111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb8b78d6d-hf62q" event={"ID":"b750729d-d06c-4dca-894d-c2515543a2b1","Type":"ContainerStarted","Data":"eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0"}
Sep 17 18:40:58.795440 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.795408    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869fd4dc4d-rv482" event={"ID":"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a","Type":"ContainerStarted","Data":"3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f"}
Sep 17 18:40:58.795588 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.795458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869fd4dc4d-rv482" event={"ID":"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a","Type":"ContainerStarted","Data":"3d76c3d0bb59c794a8f9ab838e288cbcace7d449efd82579a4e15b13f49a5e2a"}
Sep 17 18:40:58.797806 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.797720    2575 generic.go:356] "Generic (PLEG): container finished" podID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerID="fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9" exitCode=0
Sep 17 18:40:58.797806 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.797785    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerDied","Data":"fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9"}
Sep 17 18:40:58.801486 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.801402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd8464d78-m4hkm" event={"ID":"a40e0d2a-e19a-4181-b6d0-27676c58f084","Type":"ContainerStarted","Data":"fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b"}
Sep 17 18:40:58.804251 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.804098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j" event={"ID":"4f579336-884f-4505-8520-d917a7b16132","Type":"ContainerStarted","Data":"96e5a90e69069cb8a5383a5fa2531ada90e49e89a7335e43190eca048537051a"}
Sep 17 18:40:58.806531 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.806419    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jlvrl" event={"ID":"065fa123-2fc5-43e9-920d-c34363925630","Type":"ContainerStarted","Data":"fbe16dfd1aec50be8642696b8f91c8de7e0783f33cd99719acc3e42473f25458"}
Sep 17 18:40:58.806531 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.806471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jlvrl" event={"ID":"065fa123-2fc5-43e9-920d-c34363925630","Type":"ContainerStarted","Data":"d3aa1c97ad42f9e0b50e5172e605b55cf18b5f2393853fa8c8481885a64df9f6"}
Sep 17 18:40:58.807093 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.807068    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:40:58.818525 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.818456    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cb8b78d6d-hf62q" podStartSLOduration=1.984920637 podStartE2EDuration="7.818441842s" totalImagesPullingTime="5.833521205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:58.817780821 +0000 UTC m=+109.889740863" watchObservedRunningTime="2026-09-17 18:40:58.818441842 +0000 UTC m=+109.890401869"
Sep 17 18:40:58.843841 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.843787    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dd8464d78-m4hkm" podStartSLOduration=4.239587965 podStartE2EDuration="12.84376896s" totalImagesPullingTime="8.604180995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:58.843050937 +0000 UTC m=+109.915010966" watchObservedRunningTime="2026-09-17 18:40:58.84376896 +0000 UTC m=+109.915728990"
Sep 17 18:40:58.875033 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.874980    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-869fd4dc4d-rv482" podStartSLOduration=5.874963173 podStartE2EDuration="5.874963173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:58.873588596 +0000 UTC m=+109.945548623" watchObservedRunningTime="2026-09-17 18:40:58.874963173 +0000 UTC m=+109.946923200"
Sep 17 18:40:58.905254 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.905194    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-q7t8j" podStartSLOduration=5.461390732 podStartE2EDuration="11.905177012s" totalImagesPullingTime="6.44378628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:58.904692503 +0000 UTC m=+109.976652532" watchObservedRunningTime="2026-09-17 18:40:58.905177012 +0000 UTC m=+109.977137040"
Sep 17 18:40:58.937032 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:40:58.936972    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jlvrl" podStartSLOduration=67.732405065 podStartE2EDuration="1m15.936956287s" totalImagesPullingTime="8.204551222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:40:58.936515443 +0000 UTC m=+110.008475484" watchObservedRunningTime="2026-09-17 18:40:58.936956287 +0000 UTC m=+110.008916315"
Sep 17 18:41:00.816736 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:00.816707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerStarted","Data":"f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e"}
Sep 17 18:41:00.817117 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:00.816789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerStarted","Data":"b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33"}
Sep 17 18:41:01.822995 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:01.822955    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerStarted","Data":"f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2"}
Sep 17 18:41:01.823389 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:01.823023    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerStarted","Data":"c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b"}
Sep 17 18:41:01.823389 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:01.823049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerStarted","Data":"d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53"}
Sep 17 18:41:02.110140 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:02.110059    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:41:02.110140 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:02.110128    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:41:02.115004 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:02.114979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:41:02.829881 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:02.829845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerStarted","Data":"124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac"}
Sep 17 18:41:02.833853 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:02.833826    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:41:02.878597 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:02.878549    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.927228477 podStartE2EDuration="13.878533709s" totalImagesPullingTime="10.935918335s" totalInitContainerRuntime="15.386897ms" isStatefulPod=false podCreationTimestamp="2026-09-17 18:40:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:41:02.877798416 +0000 UTC m=+113.949758443" watchObservedRunningTime="2026-09-17 18:41:02.878533709 +0000 UTC m=+113.950493737"
Sep 17 18:41:03.738896 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:03.738862    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:41:03.739087 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:03.738951    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:41:03.743588 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:03.743568    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:41:03.837225 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:03.837199    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:41:03.888785 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:03.888755    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb8b78d6d-hf62q"]
Sep 17 18:41:06.848723 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:06.848689    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:41:08.812639 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:08.812610    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jlvrl"
Sep 17 18:41:17.888414 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:17.888329    2575 generic.go:356] "Generic (PLEG): container finished" podID="d330bf08-bb0d-4d21-b470-a18e54ba2c2e" containerID="b8a090854a46cc293cde766e09a311da42887141a8203b8fe0eed357951d768b" exitCode=0
Sep 17 18:41:17.888414 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:17.888388    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97" event={"ID":"d330bf08-bb0d-4d21-b470-a18e54ba2c2e","Type":"ContainerDied","Data":"b8a090854a46cc293cde766e09a311da42887141a8203b8fe0eed357951d768b"}
Sep 17 18:41:17.888816 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:17.888716    2575 scope.go:117] "RemoveContainer" containerID="b8a090854a46cc293cde766e09a311da42887141a8203b8fe0eed357951d768b"
Sep 17 18:41:18.894120 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:18.894086    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-bzz97" event={"ID":"d330bf08-bb0d-4d21-b470-a18e54ba2c2e","Type":"ContainerStarted","Data":"0b47a647395b4ba36c9521dba4ee8612cac20c8a9fa3fff5dbf5b87742126b95"}
Sep 17 18:41:19.943350 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:19.943287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:41:19.945663 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:19.945636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9aa2188-f986-4999-982d-a02dde5eba1e-metrics-certs\") pod \"network-metrics-daemon-fnh86\" (UID: \"d9aa2188-f986-4999-982d-a02dde5eba1e\") " pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:41:20.029507 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:20.029478    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nghzc\""
Sep 17 18:41:20.036652 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:20.036633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnh86"
Sep 17 18:41:20.322159 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:20.322127    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fnh86"]
Sep 17 18:41:20.325166 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:41:20.325130    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9aa2188_f986_4999_982d_a02dde5eba1e.slice/crio-bc215a914d8b3b7d19ebf8bb8e9f9c8a2501e1feb3046a4c4801dce8d7f39138 WatchSource:0}: Error finding container bc215a914d8b3b7d19ebf8bb8e9f9c8a2501e1feb3046a4c4801dce8d7f39138: Status 404 returned error can't find the container with id bc215a914d8b3b7d19ebf8bb8e9f9c8a2501e1feb3046a4c4801dce8d7f39138
Sep 17 18:41:20.902875 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:20.902841    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fnh86" event={"ID":"d9aa2188-f986-4999-982d-a02dde5eba1e","Type":"ContainerStarted","Data":"bc215a914d8b3b7d19ebf8bb8e9f9c8a2501e1feb3046a4c4801dce8d7f39138"}
Sep 17 18:41:21.907511 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:21.907483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fnh86" event={"ID":"d9aa2188-f986-4999-982d-a02dde5eba1e","Type":"ContainerStarted","Data":"77f016fe3ea2b94dec3b8ecf361d43a54c7af13744240f3185e926da723af902"}
Sep 17 18:41:22.913700 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:22.913666    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fnh86" event={"ID":"d9aa2188-f986-4999-982d-a02dde5eba1e","Type":"ContainerStarted","Data":"c371897ef3fa942dbe27afb236ba9dc6247db9a576d573628ff81cdc9fc2c013"}
Sep 17 18:41:22.943232 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:22.943186    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fnh86" podStartSLOduration=130.596486319 podStartE2EDuration="2m11.943171233s" totalImagesPullingTime="1.346684914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:41:22.942891059 +0000 UTC m=+134.014851086" watchObservedRunningTime="2026-09-17 18:41:22.943171233 +0000 UTC m=+134.015131303"
Sep 17 18:41:23.828947 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:23.828901    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dd8464d78-m4hkm" podUID="a40e0d2a-e19a-4181-b6d0-27676c58f084" containerName="console" containerID="cri-o://fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b" gracePeriod=15
Sep 17 18:41:24.109684 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.109622    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:41:24.277485 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.277450    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-oauth-serving-cert\") pod \"a40e0d2a-e19a-4181-b6d0-27676c58f084\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") "
Sep 17 18:41:24.277485 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.277491    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-config\") pod \"a40e0d2a-e19a-4181-b6d0-27676c58f084\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") "
Sep 17 18:41:24.277716 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.277513    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-oauth-config\") pod \"a40e0d2a-e19a-4181-b6d0-27676c58f084\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") "
Sep 17 18:41:24.277716 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.277542    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqcxh\" (UniqueName: \"kubernetes.io/projected/a40e0d2a-e19a-4181-b6d0-27676c58f084-kube-api-access-gqcxh\") pod \"a40e0d2a-e19a-4181-b6d0-27676c58f084\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") "
Sep 17 18:41:24.277716 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.277583    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-service-ca\") pod \"a40e0d2a-e19a-4181-b6d0-27676c58f084\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") "
Sep 17 18:41:24.277716 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.277606    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-serving-cert\") pod \"a40e0d2a-e19a-4181-b6d0-27676c58f084\" (UID: \"a40e0d2a-e19a-4181-b6d0-27676c58f084\") "
Sep 17 18:41:24.277959 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.277930    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a40e0d2a-e19a-4181-b6d0-27676c58f084" (UID: "a40e0d2a-e19a-4181-b6d0-27676c58f084"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:41:24.278022 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.277933    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-config" (OuterVolumeSpecName: "console-config") pod "a40e0d2a-e19a-4181-b6d0-27676c58f084" (UID: "a40e0d2a-e19a-4181-b6d0-27676c58f084"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:41:24.278091 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.278038    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-service-ca" (OuterVolumeSpecName: "service-ca") pod "a40e0d2a-e19a-4181-b6d0-27676c58f084" (UID: "a40e0d2a-e19a-4181-b6d0-27676c58f084"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:41:24.279850 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.279826    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a40e0d2a-e19a-4181-b6d0-27676c58f084" (UID: "a40e0d2a-e19a-4181-b6d0-27676c58f084"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:41:24.279926 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.279880    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a40e0d2a-e19a-4181-b6d0-27676c58f084" (UID: "a40e0d2a-e19a-4181-b6d0-27676c58f084"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:41:24.279926 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.279895    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a40e0d2a-e19a-4181-b6d0-27676c58f084-kube-api-access-gqcxh" (OuterVolumeSpecName: "kube-api-access-gqcxh") pod "a40e0d2a-e19a-4181-b6d0-27676c58f084" (UID: "a40e0d2a-e19a-4181-b6d0-27676c58f084"). InnerVolumeSpecName "kube-api-access-gqcxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:41:24.378445 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.378371    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:24.378445 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.378399    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-oauth-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:24.378445 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.378409    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqcxh\" (UniqueName: \"kubernetes.io/projected/a40e0d2a-e19a-4181-b6d0-27676c58f084-kube-api-access-gqcxh\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:24.378445 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.378420    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-service-ca\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:24.378445 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.378429    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40e0d2a-e19a-4181-b6d0-27676c58f084-console-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:24.378445 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.378436    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40e0d2a-e19a-4181-b6d0-27676c58f084-oauth-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:24.922390 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.922353    2575 generic.go:356] "Generic (PLEG): container finished" podID="a40e0d2a-e19a-4181-b6d0-27676c58f084" containerID="fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b" exitCode=0
Sep 17 18:41:24.922583 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.922400    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd8464d78-m4hkm"
Sep 17 18:41:24.922583 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.922421    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd8464d78-m4hkm" event={"ID":"a40e0d2a-e19a-4181-b6d0-27676c58f084","Type":"ContainerDied","Data":"fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b"}
Sep 17 18:41:24.922583 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.922468    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd8464d78-m4hkm" event={"ID":"a40e0d2a-e19a-4181-b6d0-27676c58f084","Type":"ContainerDied","Data":"a0bd8e57c70bb63918f72a18c87ab95b4fe94515f7612fafa5605426ba31528c"}
Sep 17 18:41:24.922583 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.922493    2575 scope.go:117] "RemoveContainer" containerID="fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b"
Sep 17 18:41:24.938177 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.938155    2575 scope.go:117] "RemoveContainer" containerID="fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b"
Sep 17 18:41:24.938478 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:41:24.938453    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b\": container with ID starting with fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b not found: ID does not exist" containerID="fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b"
Sep 17 18:41:24.938570 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.938489    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b"} err="failed to get container status \"fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b\": rpc error: code = NotFound desc = could not find container \"fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b\": container with ID starting with fe624e378f21e539ef77e1da06a9543eb67c7d6711d719ce5caa2270f0fccb1b not found: ID does not exist"
Sep 17 18:41:24.942755 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.942733    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd8464d78-m4hkm"]
Sep 17 18:41:24.949763 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:24.949743    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dd8464d78-m4hkm"]
Sep 17 18:41:25.210892 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:25.210864    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a40e0d2a-e19a-4181-b6d0-27676c58f084" path="/var/lib/kubelet/pods/a40e0d2a-e19a-4181-b6d0-27676c58f084/volumes"
Sep 17 18:41:29.855776 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:29.855733    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cb8b78d6d-hf62q" podUID="b750729d-d06c-4dca-894d-c2515543a2b1" containerName="console" containerID="cri-o://eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0" gracePeriod=15
Sep 17 18:41:30.157637 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.157609    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:41:30.324054 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324015    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-service-ca\") pod \"b750729d-d06c-4dca-894d-c2515543a2b1\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") "
Sep 17 18:41:30.324246 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324068    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-oauth-config\") pod \"b750729d-d06c-4dca-894d-c2515543a2b1\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") "
Sep 17 18:41:30.324246 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324093    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-oauth-serving-cert\") pod \"b750729d-d06c-4dca-894d-c2515543a2b1\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") "
Sep 17 18:41:30.324246 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324209    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-console-config\") pod \"b750729d-d06c-4dca-894d-c2515543a2b1\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") "
Sep 17 18:41:30.324454 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324255    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7267\" (UniqueName: \"kubernetes.io/projected/b750729d-d06c-4dca-894d-c2515543a2b1-kube-api-access-c7267\") pod \"b750729d-d06c-4dca-894d-c2515543a2b1\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") "
Sep 17 18:41:30.324454 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324342    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-serving-cert\") pod \"b750729d-d06c-4dca-894d-c2515543a2b1\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") "
Sep 17 18:41:30.324454 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324359    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-trusted-ca-bundle\") pod \"b750729d-d06c-4dca-894d-c2515543a2b1\" (UID: \"b750729d-d06c-4dca-894d-c2515543a2b1\") "
Sep 17 18:41:30.324606 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324522    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-service-ca" (OuterVolumeSpecName: "service-ca") pod "b750729d-d06c-4dca-894d-c2515543a2b1" (UID: "b750729d-d06c-4dca-894d-c2515543a2b1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:41:30.324606 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324538    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b750729d-d06c-4dca-894d-c2515543a2b1" (UID: "b750729d-d06c-4dca-894d-c2515543a2b1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:41:30.324606 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324594    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-console-config" (OuterVolumeSpecName: "console-config") pod "b750729d-d06c-4dca-894d-c2515543a2b1" (UID: "b750729d-d06c-4dca-894d-c2515543a2b1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:41:30.324754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324630    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-service-ca\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:30.324754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324649    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-oauth-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:30.324933 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.324912    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b750729d-d06c-4dca-894d-c2515543a2b1" (UID: "b750729d-d06c-4dca-894d-c2515543a2b1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:41:30.326412 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.326385    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b750729d-d06c-4dca-894d-c2515543a2b1-kube-api-access-c7267" (OuterVolumeSpecName: "kube-api-access-c7267") pod "b750729d-d06c-4dca-894d-c2515543a2b1" (UID: "b750729d-d06c-4dca-894d-c2515543a2b1"). InnerVolumeSpecName "kube-api-access-c7267". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:41:30.326412 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.326407    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b750729d-d06c-4dca-894d-c2515543a2b1" (UID: "b750729d-d06c-4dca-894d-c2515543a2b1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:41:30.326562 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.326391    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b750729d-d06c-4dca-894d-c2515543a2b1" (UID: "b750729d-d06c-4dca-894d-c2515543a2b1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:41:30.426060 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.425983    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-oauth-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:30.426060 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.426013    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-console-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:30.426060 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.426025    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7267\" (UniqueName: \"kubernetes.io/projected/b750729d-d06c-4dca-894d-c2515543a2b1-kube-api-access-c7267\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:30.426060 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.426034    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b750729d-d06c-4dca-894d-c2515543a2b1-console-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:30.426060 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.426043    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b750729d-d06c-4dca-894d-c2515543a2b1-trusted-ca-bundle\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:41:30.946558 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.946520    2575 generic.go:356] "Generic (PLEG): container finished" podID="b750729d-d06c-4dca-894d-c2515543a2b1" containerID="eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0" exitCode=0
Sep 17 18:41:30.947016 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.946568    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb8b78d6d-hf62q"
Sep 17 18:41:30.947016 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.946577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb8b78d6d-hf62q" event={"ID":"b750729d-d06c-4dca-894d-c2515543a2b1","Type":"ContainerDied","Data":"eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0"}
Sep 17 18:41:30.947016 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.946617    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb8b78d6d-hf62q" event={"ID":"b750729d-d06c-4dca-894d-c2515543a2b1","Type":"ContainerDied","Data":"f118ac3770bfe5d8a8e6cbb00ab8de0348904d2dc1f9680d68719233107a80e5"}
Sep 17 18:41:30.947016 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.946636    2575 scope.go:117] "RemoveContainer" containerID="eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0"
Sep 17 18:41:30.954797 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.954778    2575 scope.go:117] "RemoveContainer" containerID="eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0"
Sep 17 18:41:30.955084 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:41:30.955065    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0\": container with ID starting with eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0 not found: ID does not exist" containerID="eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0"
Sep 17 18:41:30.955153 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.955099    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0"} err="failed to get container status \"eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0\": rpc error: code = NotFound desc = could not find container \"eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0\": container with ID starting with eefa64675f725bbb22d030f290a15dc54e24785fb1f3d6d4d5b6d9cc8623dbc0 not found: ID does not exist"
Sep 17 18:41:30.971030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.971004    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb8b78d6d-hf62q"]
Sep 17 18:41:30.973003 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:30.972985    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cb8b78d6d-hf62q"]
Sep 17 18:41:31.210511 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:31.210482    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b750729d-d06c-4dca-894d-c2515543a2b1" path="/var/lib/kubelet/pods/b750729d-d06c-4dca-894d-c2515543a2b1/volumes"
Sep 17 18:41:42.995183 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:42.995102    2575 generic.go:356] "Generic (PLEG): container finished" podID="c6cf6711-d48f-4b3b-a994-d49bc70626df" containerID="b4a125624e5de24dfb666e092033f90389b6dfbbff5b9ae6081baa8141148673" exitCode=0
Sep 17 18:41:42.995580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:42.995177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-tchqh" event={"ID":"c6cf6711-d48f-4b3b-a994-d49bc70626df","Type":"ContainerDied","Data":"b4a125624e5de24dfb666e092033f90389b6dfbbff5b9ae6081baa8141148673"}
Sep 17 18:41:42.995580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:42.995515    2575 scope.go:117] "RemoveContainer" containerID="b4a125624e5de24dfb666e092033f90389b6dfbbff5b9ae6081baa8141148673"
Sep 17 18:41:44.001273 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:41:44.001237    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-tchqh" event={"ID":"c6cf6711-d48f-4b3b-a994-d49bc70626df","Type":"ContainerStarted","Data":"19decf23aec47249267366e1d92e9455c0d44a87256bfe777d7ecd19b4e373b9"}
Sep 17 18:42:08.644787 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:08.644706    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 18:42:08.645322 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:08.645004    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="alertmanager" containerID="cri-o://b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33" gracePeriod=120
Sep 17 18:42:08.645322 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:08.645070    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy-metric" containerID="cri-o://f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2" gracePeriod=120
Sep 17 18:42:08.645322 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:08.645098    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="prom-label-proxy" containerID="cri-o://124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac" gracePeriod=120
Sep 17 18:42:08.645322 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:08.645116    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy-web" containerID="cri-o://d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53" gracePeriod=120
Sep 17 18:42:08.645322 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:08.645128    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy" containerID="cri-o://c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b" gracePeriod=120
Sep 17 18:42:08.645322 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:08.645140    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="config-reloader" containerID="cri-o://f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e" gracePeriod=120
Sep 17 18:42:09.099476 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099443    2575 generic.go:356] "Generic (PLEG): container finished" podID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerID="124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac" exitCode=0
Sep 17 18:42:09.099476 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099466    2575 generic.go:356] "Generic (PLEG): container finished" podID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerID="f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2" exitCode=0
Sep 17 18:42:09.099476 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099474    2575 generic.go:356] "Generic (PLEG): container finished" podID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerID="c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b" exitCode=0
Sep 17 18:42:09.099476 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099480    2575 generic.go:356] "Generic (PLEG): container finished" podID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerID="f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e" exitCode=0
Sep 17 18:42:09.099737 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099485    2575 generic.go:356] "Generic (PLEG): container finished" podID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerID="b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33" exitCode=0
Sep 17 18:42:09.099737 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerDied","Data":"124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac"}
Sep 17 18:42:09.099737 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerDied","Data":"f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2"}
Sep 17 18:42:09.099737 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099600    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerDied","Data":"c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b"}
Sep 17 18:42:09.099737 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099661    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerDied","Data":"f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e"}
Sep 17 18:42:09.099737 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.099688    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerDied","Data":"b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33"}
Sep 17 18:42:09.889310 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:09.889280    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.026371 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026271    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-web-config\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026371 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026331    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-config-out\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026371 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026362    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-tls-assets\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026378    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-metrics-client-ca\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026406    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-cluster-tls-config\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026444    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-trusted-ca-bundle\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026483    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-web\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026529    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-metric\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026569    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-config-volume\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026598    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4hfd\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-kube-api-access-k4hfd\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026973 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026627    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-main-tls\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026973 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026652    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026973 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026703    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-main-db\") pod \"aaabfbf6-59af-42a0-9edb-cf187b286549\" (UID: \"aaabfbf6-59af-42a0-9edb-cf187b286549\") "
Sep 17 18:42:10.026973 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026787    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:42:10.026973 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.026831    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:42:10.027221 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.027046    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:42:10.027221 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.027073    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-metrics-client-ca\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.027221 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.027097    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.029454 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.029427    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-config-volume" (OuterVolumeSpecName: "config-volume") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:42:10.029895 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.029869    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-config-out" (OuterVolumeSpecName: "config-out") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:42:10.030044 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.030026    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-kube-api-access-k4hfd" (OuterVolumeSpecName: "kube-api-access-k4hfd") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "kube-api-access-k4hfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:42:10.030116 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.030025    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:42:10.030241 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.030213    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:42:10.030365 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.030243    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:42:10.030441 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.030418    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:42:10.030895 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.030874    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:42:10.033335 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.033308    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:42:10.039850 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.039828    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-web-config" (OuterVolumeSpecName: "web-config") pod "aaabfbf6-59af-42a0-9edb-cf187b286549" (UID: "aaabfbf6-59af-42a0-9edb-cf187b286549"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:42:10.106042 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.106006    2575 generic.go:356] "Generic (PLEG): container finished" podID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerID="d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53" exitCode=0
Sep 17 18:42:10.106178 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.106066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerDied","Data":"d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53"}
Sep 17 18:42:10.106178 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.106083    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.106178 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.106123    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaabfbf6-59af-42a0-9edb-cf187b286549","Type":"ContainerDied","Data":"673311237e876d8f9e821f544a786271f7e8cb6cbf7e80ee9da9d0873bd0e84b"}
Sep 17 18:42:10.106178 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.106157    2575 scope.go:117] "RemoveContainer" containerID="124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac"
Sep 17 18:42:10.113795 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.113779    2575 scope.go:117] "RemoveContainer" containerID="f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2"
Sep 17 18:42:10.121241 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.121221    2575 scope.go:117] "RemoveContainer" containerID="c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b"
Sep 17 18:42:10.127546 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127532    2575 scope.go:117] "RemoveContainer" containerID="d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53"
Sep 17 18:42:10.127787 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127767    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-web-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127787 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127789    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-config-out\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127801    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-tls-assets\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127812    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-cluster-tls-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127826    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127840    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127853    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-config-volume\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127866    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4hfd\" (UniqueName: \"kubernetes.io/projected/aaabfbf6-59af-42a0-9edb-cf187b286549-kube-api-access-k4hfd\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127878    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-main-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127891    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaabfbf6-59af-42a0-9edb-cf187b286549-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.127939 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.127907    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaabfbf6-59af-42a0-9edb-cf187b286549-alertmanager-main-db\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:10.136727 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.136704    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 18:42:10.136919 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.136869    2575 scope.go:117] "RemoveContainer" containerID="f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e"
Sep 17 18:42:10.141309 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.141279    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 18:42:10.144633 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.144617    2575 scope.go:117] "RemoveContainer" containerID="b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33"
Sep 17 18:42:10.151470 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.151450    2575 scope.go:117] "RemoveContainer" containerID="fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9"
Sep 17 18:42:10.158075 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.158060    2575 scope.go:117] "RemoveContainer" containerID="124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac"
Sep 17 18:42:10.158351 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:42:10.158326    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac\": container with ID starting with 124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac not found: ID does not exist" containerID="124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac"
Sep 17 18:42:10.158462 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.158364    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac"} err="failed to get container status \"124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac\": rpc error: code = NotFound desc = could not find container \"124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac\": container with ID starting with 124a25db785905bd4371dcfd42da3c50753d6b70464ebaad88f2cc2773afc0ac not found: ID does not exist"
Sep 17 18:42:10.158462 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.158388    2575 scope.go:117] "RemoveContainer" containerID="f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2"
Sep 17 18:42:10.158643 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:42:10.158625    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2\": container with ID starting with f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2 not found: ID does not exist" containerID="f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2"
Sep 17 18:42:10.158682 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.158650    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2"} err="failed to get container status \"f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2\": rpc error: code = NotFound desc = could not find container \"f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2\": container with ID starting with f9373442efe1552375933f2c2f87c4c7737330d2b0b2695c546b9021d31928c2 not found: ID does not exist"
Sep 17 18:42:10.158682 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.158665    2575 scope.go:117] "RemoveContainer" containerID="c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b"
Sep 17 18:42:10.158896 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:42:10.158882    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b\": container with ID starting with c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b not found: ID does not exist" containerID="c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b"
Sep 17 18:42:10.158936 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.158898    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b"} err="failed to get container status \"c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b\": rpc error: code = NotFound desc = could not find container \"c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b\": container with ID starting with c3c9ff0af07a2ae43024a3feb8f9c777b40473e370a15658f3d2bc3b8e105e9b not found: ID does not exist"
Sep 17 18:42:10.158936 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.158921    2575 scope.go:117] "RemoveContainer" containerID="d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53"
Sep 17 18:42:10.159120 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:42:10.159106    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53\": container with ID starting with d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53 not found: ID does not exist" containerID="d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53"
Sep 17 18:42:10.159160 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.159122    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53"} err="failed to get container status \"d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53\": rpc error: code = NotFound desc = could not find container \"d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53\": container with ID starting with d92acf1836ef65e30ff121ad4a6de0487aa75c949bf3742ad363015ed4e14c53 not found: ID does not exist"
Sep 17 18:42:10.159160 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.159133    2575 scope.go:117] "RemoveContainer" containerID="f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e"
Sep 17 18:42:10.159346 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:42:10.159330    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e\": container with ID starting with f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e not found: ID does not exist" containerID="f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e"
Sep 17 18:42:10.159391 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.159350    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e"} err="failed to get container status \"f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e\": rpc error: code = NotFound desc = could not find container \"f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e\": container with ID starting with f57f6042cd41d272785a8f1e6581bf535ab29122d3d8d3be21d43df0353d1a6e not found: ID does not exist"
Sep 17 18:42:10.159391 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.159362    2575 scope.go:117] "RemoveContainer" containerID="b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33"
Sep 17 18:42:10.159566 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:42:10.159547    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33\": container with ID starting with b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33 not found: ID does not exist" containerID="b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33"
Sep 17 18:42:10.159607 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.159573    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33"} err="failed to get container status \"b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33\": rpc error: code = NotFound desc = could not find container \"b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33\": container with ID starting with b09f09bec936598d73dd5c4676796d5fbbf37a759871e684a180755528ac6c33 not found: ID does not exist"
Sep 17 18:42:10.159607 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.159587    2575 scope.go:117] "RemoveContainer" containerID="fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9"
Sep 17 18:42:10.159849 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:42:10.159822    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9\": container with ID starting with fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9 not found: ID does not exist" containerID="fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9"
Sep 17 18:42:10.159903 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.159851    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9"} err="failed to get container status \"fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9\": rpc error: code = NotFound desc = could not find container \"fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9\": container with ID starting with fac6f721965c60a3077fa4f1c952ab34f6c975cec53d47b771417a4853023ba9 not found: ID does not exist"
Sep 17 18:42:10.172363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172341    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 18:42:10.172631 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172616    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b750729d-d06c-4dca-894d-c2515543a2b1" containerName="console"
Sep 17 18:42:10.172705 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172634    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b750729d-d06c-4dca-894d-c2515543a2b1" containerName="console"
Sep 17 18:42:10.172705 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172654    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy-web"
Sep 17 18:42:10.172705 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172665    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy-web"
Sep 17 18:42:10.172705 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172677    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy"
Sep 17 18:42:10.172705 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172686    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy"
Sep 17 18:42:10.172705 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172698    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="prom-label-proxy"
Sep 17 18:42:10.172705 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172707    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="prom-label-proxy"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172718    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="alertmanager"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172727    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="alertmanager"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172739    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="init-config-reloader"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172748    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="init-config-reloader"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172757    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy-metric"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172764    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy-metric"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172777    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40e0d2a-e19a-4181-b6d0-27676c58f084" containerName="console"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172785    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40e0d2a-e19a-4181-b6d0-27676c58f084" containerName="console"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172801    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="config-reloader"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172808    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="config-reloader"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172871    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="alertmanager"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172882    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172891    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="prom-label-proxy"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172901    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40e0d2a-e19a-4181-b6d0-27676c58f084" containerName="console"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172908    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b750729d-d06c-4dca-894d-c2515543a2b1" containerName="console"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172915    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy-web"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172924    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="config-reloader"
Sep 17 18:42:10.173030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.172931    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" containerName="kube-rbac-proxy-metric"
Sep 17 18:42:10.176825 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.176808    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.179494 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.179476    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 18:42:10.179798 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.179777    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 18:42:10.179882 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.179804    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 18:42:10.180019 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.180004    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 18:42:10.180055 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.180044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-72zfz\""
Sep 17 18:42:10.180125 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.180109    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 18:42:10.180243 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.180228    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 18:42:10.180306 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.180284    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 18:42:10.180502 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.180487    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 18:42:10.186100 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.186079    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 18:42:10.198671 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.198649    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 18:42:10.330354 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330222    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-config-out\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330354 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330354 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330629 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl2dm\" (UniqueName: \"kubernetes.io/projected/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-kube-api-access-gl2dm\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330629 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330629 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330629 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330547    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330629 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330629 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330629 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330837 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330837 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.330837 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.330708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-web-config\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.431935 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.431885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.431935 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.431937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.432179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.431962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.432179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.431977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.432179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.431994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.432179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.432016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.432179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.432038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.432179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.432063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-web-config\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.432179 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.432086    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-config-out\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.432553 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.432387    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.433144 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.433112    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.433384 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.433346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.433593 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.433572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.433722 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.433707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl2dm\" (UniqueName: \"kubernetes.io/projected/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-kube-api-access-gl2dm\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.433849 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.433833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.434899 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.434869    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.434998 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.434979    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.435124 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.435103    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.435213 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.435193    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-web-config\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.435265 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.435193    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.435500 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.435467    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-config-out\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.435588 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.435560    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.435759 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.435733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.437000 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.436982    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.437050 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.437022    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.444858 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.444833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl2dm\" (UniqueName: \"kubernetes.io/projected/6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4-kube-api-access-gl2dm\") pod \"alertmanager-main-0\" (UID: \"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.486455 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.486427    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 18:42:10.774076 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:10.774048    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 18:42:10.775527 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:42:10.775497    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f75ad07_6a8c_4aea_8c2b_d6dee5e178f4.slice/crio-d3e0fdedc9b9c205166661dda7f98d81dcc46cbe77037b957496e7f4df1160a2 WatchSource:0}: Error finding container d3e0fdedc9b9c205166661dda7f98d81dcc46cbe77037b957496e7f4df1160a2: Status 404 returned error can't find the container with id d3e0fdedc9b9c205166661dda7f98d81dcc46cbe77037b957496e7f4df1160a2
Sep 17 18:42:11.110918 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:11.110888    2575 generic.go:356] "Generic (PLEG): container finished" podID="6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4" containerID="542c94f26b562acbb506a2d4eefabbbdae6bdc432d91c6df1572724daa1bef72" exitCode=0
Sep 17 18:42:11.111259 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:11.110970    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4","Type":"ContainerDied","Data":"542c94f26b562acbb506a2d4eefabbbdae6bdc432d91c6df1572724daa1bef72"}
Sep 17 18:42:11.111259 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:11.111032    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4","Type":"ContainerStarted","Data":"d3e0fdedc9b9c205166661dda7f98d81dcc46cbe77037b957496e7f4df1160a2"}
Sep 17 18:42:11.212077 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:11.212045    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaabfbf6-59af-42a0-9edb-cf187b286549" path="/var/lib/kubelet/pods/aaabfbf6-59af-42a0-9edb-cf187b286549/volumes"
Sep 17 18:42:12.118217 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.118124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4","Type":"ContainerStarted","Data":"1f4d89e008eb3e5ca9e68ad072d91980ecb85b04a81d800e1b563e1911384b96"}
Sep 17 18:42:12.118217 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.118216    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4","Type":"ContainerStarted","Data":"41e9325ff982cf346722c47ebe669d001a9d1bc741c5bcbe63be927d1b801a4f"}
Sep 17 18:42:12.118682 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.118242    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4","Type":"ContainerStarted","Data":"4eb5968d732d588cfb5b8a15ab92b4db92dd3239280c800d02d54d330c2e113a"}
Sep 17 18:42:12.118682 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.118267    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4","Type":"ContainerStarted","Data":"525f2300b97eb805561496ead25364d65d5edd385f5d1fb8ae4a7e81e1c74fe6"}
Sep 17 18:42:12.118682 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.118290    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4","Type":"ContainerStarted","Data":"6a812697182ee188b47db4ccf9777f99062da294f5f20245603b695523217acd"}
Sep 17 18:42:12.118682 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.118359    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4","Type":"ContainerStarted","Data":"9679d63e734dea12ad265d3404f14a0da9fc9e472d60bb21f257b3992f1ffc75"}
Sep 17 18:42:12.149783 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.149727    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.135445842 podStartE2EDuration="2.149711251s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.265409ms" isStatefulPod=false podCreationTimestamp="2026-09-17 18:42:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:42:12.147963727 +0000 UTC m=+183.219923756" watchObservedRunningTime="2026-09-17 18:42:12.149711251 +0000 UTC m=+183.221671278"
Sep 17 18:42:12.750065 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.750032    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f55b7b977-2szjw"]
Sep 17 18:42:12.752553 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.752534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.755760 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.755734    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vbtf8\""
Sep 17 18:42:12.755760 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.755734    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 18:42:12.756658 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.756639    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 18:42:12.757403 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.757387    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 18:42:12.757526 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.757502    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 18:42:12.757647 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.757618    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 18:42:12.762403 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.762385    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 18:42:12.821774 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.821747    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f55b7b977-2szjw"]
Sep 17 18:42:12.853124 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.853089    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a133b0-0079-4046-bd15-a839077380b7-serving-certs-ca-bundle\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.853124 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.853128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-telemeter-client-tls\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.853333 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.853149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.853333 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.853204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-federate-client-tls\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.853333 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.853228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-secret-telemeter-client\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.853333 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.853251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58a133b0-0079-4046-bd15-a839077380b7-metrics-client-ca\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.853333 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.853267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a133b0-0079-4046-bd15-a839077380b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.853333 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.853323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2lk4\" (UniqueName: \"kubernetes.io/projected/58a133b0-0079-4046-bd15-a839077380b7-kube-api-access-m2lk4\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.954384 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.954353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-federate-client-tls\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.954567 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.954390    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-secret-telemeter-client\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.954567 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.954408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58a133b0-0079-4046-bd15-a839077380b7-metrics-client-ca\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.954567 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.954433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a133b0-0079-4046-bd15-a839077380b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.954567 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.954484    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2lk4\" (UniqueName: \"kubernetes.io/projected/58a133b0-0079-4046-bd15-a839077380b7-kube-api-access-m2lk4\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.954567 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.954545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a133b0-0079-4046-bd15-a839077380b7-serving-certs-ca-bundle\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.954819 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.954584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-telemeter-client-tls\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.954819 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.954610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.955410 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.955377    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a133b0-0079-4046-bd15-a839077380b7-serving-certs-ca-bundle\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.955524 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.955432    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58a133b0-0079-4046-bd15-a839077380b7-metrics-client-ca\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.955604 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.955571    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a133b0-0079-4046-bd15-a839077380b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.957021 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.956975    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-federate-client-tls\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.957122 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.957060    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-secret-telemeter-client\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.957269 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.957251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.957363 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.957346    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/58a133b0-0079-4046-bd15-a839077380b7-telemeter-client-tls\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:12.963845 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:12.963819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2lk4\" (UniqueName: \"kubernetes.io/projected/58a133b0-0079-4046-bd15-a839077380b7-kube-api-access-m2lk4\") pod \"telemeter-client-5f55b7b977-2szjw\" (UID: \"58a133b0-0079-4046-bd15-a839077380b7\") " pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:13.061502 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:13.061427    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw"
Sep 17 18:42:13.348159 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:13.348080    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f55b7b977-2szjw"]
Sep 17 18:42:13.351519 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:42:13.351495    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a133b0_0079_4046_bd15_a839077380b7.slice/crio-eeac3a19bdbfeb179a61841991abee3d3d0d8c27f15fd014d4dd889b76a7c8fa WatchSource:0}: Error finding container eeac3a19bdbfeb179a61841991abee3d3d0d8c27f15fd014d4dd889b76a7c8fa: Status 404 returned error can't find the container with id eeac3a19bdbfeb179a61841991abee3d3d0d8c27f15fd014d4dd889b76a7c8fa
Sep 17 18:42:14.130586 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:14.130550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw" event={"ID":"58a133b0-0079-4046-bd15-a839077380b7","Type":"ContainerStarted","Data":"eeac3a19bdbfeb179a61841991abee3d3d0d8c27f15fd014d4dd889b76a7c8fa"}
Sep 17 18:42:16.141155 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.141111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw" event={"ID":"58a133b0-0079-4046-bd15-a839077380b7","Type":"ContainerStarted","Data":"5b70207d7c9c376f400d523a4e606214d8494ff73f2e16a92fb9bcfe44fa3eae"}
Sep 17 18:42:16.141576 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.141195    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw" event={"ID":"58a133b0-0079-4046-bd15-a839077380b7","Type":"ContainerStarted","Data":"0747b5960a15e4f00fd557dd326bc680046985105470256d7e239297ce2f8fc7"}
Sep 17 18:42:16.141576 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.141214    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw" event={"ID":"58a133b0-0079-4046-bd15-a839077380b7","Type":"ContainerStarted","Data":"ea29a57199a753fc552815bfc80a42b4ef385fc4091ad204584cf320f3c75a54"}
Sep 17 18:42:16.175708 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.175664    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f55b7b977-2szjw" podStartSLOduration=2.34683207 podStartE2EDuration="4.175644347s" totalImagesPullingTime="1.828812277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:42:16.173038894 +0000 UTC m=+187.244998921" watchObservedRunningTime="2026-09-17 18:42:16.175644347 +0000 UTC m=+187.247604383"
Sep 17 18:42:16.292347 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.292316    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bd956fb9c-vnkkz"]
Sep 17 18:42:16.294513 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.294497    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.311721 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.311692    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bd956fb9c-vnkkz"]
Sep 17 18:42:16.386737 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.386698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-service-ca\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.386737 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.386736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-oauth-serving-cert\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.386958 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.386795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-serving-cert\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.386958 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.386823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-config\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.386958 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.386845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-oauth-config\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.386958 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.386922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kvd4\" (UniqueName: \"kubernetes.io/projected/09f86f73-c7c2-4782-b9c3-f475b03b43b0-kube-api-access-6kvd4\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.387102 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.386982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-trusted-ca-bundle\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.488183 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.488141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-serving-cert\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.488375 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.488197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-config\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.488375 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.488218    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-oauth-config\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.488375 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.488243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kvd4\" (UniqueName: \"kubernetes.io/projected/09f86f73-c7c2-4782-b9c3-f475b03b43b0-kube-api-access-6kvd4\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.488375 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.488283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-trusted-ca-bundle\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.488579 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.488371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-service-ca\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.488579 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.488415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-oauth-serving-cert\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.489115 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.489087    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-config\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.489242 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.489114    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-oauth-serving-cert\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.489242 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.489090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-service-ca\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.489242 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.489207    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-trusted-ca-bundle\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.490658 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.490636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-serving-cert\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.490743 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.490701    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-oauth-config\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.499200 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.499176    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kvd4\" (UniqueName: \"kubernetes.io/projected/09f86f73-c7c2-4782-b9c3-f475b03b43b0-kube-api-access-6kvd4\") pod \"console-6bd956fb9c-vnkkz\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") " pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.603021 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.602988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:16.880802 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:16.880776    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bd956fb9c-vnkkz"]
Sep 17 18:42:16.882531 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:42:16.882497    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f86f73_c7c2_4782_b9c3_f475b03b43b0.slice/crio-5972ee1582fd9f81a8cec1170d2050a869dc762e5797e6fe5a3cc10e0cbe3291 WatchSource:0}: Error finding container 5972ee1582fd9f81a8cec1170d2050a869dc762e5797e6fe5a3cc10e0cbe3291: Status 404 returned error can't find the container with id 5972ee1582fd9f81a8cec1170d2050a869dc762e5797e6fe5a3cc10e0cbe3291
Sep 17 18:42:17.146536 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:17.146446    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd956fb9c-vnkkz" event={"ID":"09f86f73-c7c2-4782-b9c3-f475b03b43b0","Type":"ContainerStarted","Data":"a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8"}
Sep 17 18:42:17.146536 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:17.146496    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd956fb9c-vnkkz" event={"ID":"09f86f73-c7c2-4782-b9c3-f475b03b43b0","Type":"ContainerStarted","Data":"5972ee1582fd9f81a8cec1170d2050a869dc762e5797e6fe5a3cc10e0cbe3291"}
Sep 17 18:42:17.180899 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:17.180855    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bd956fb9c-vnkkz" podStartSLOduration=1.180838719 podStartE2EDuration="1.180838719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:42:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:42:17.18055151 +0000 UTC m=+188.252511538" watchObservedRunningTime="2026-09-17 18:42:17.180838719 +0000 UTC m=+188.252798747"
Sep 17 18:42:26.603656 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:26.603619    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:26.604195 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:26.603688    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:26.608212 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:26.608190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:27.192222 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:27.192195    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:42:27.234514 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:27.234483    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869fd4dc4d-rv482"]
Sep 17 18:42:52.253726 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.253652    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-869fd4dc4d-rv482" podUID="3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" containerName="console" containerID="cri-o://3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f" gracePeriod=15
Sep 17 18:42:52.492476 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.492451    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:42:52.585761 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.585685    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-serving-cert\") pod \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") "
Sep 17 18:42:52.585761 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.585736    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-service-ca\") pod \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") "
Sep 17 18:42:52.585971 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.585792    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n2qd\" (UniqueName: \"kubernetes.io/projected/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-kube-api-access-2n2qd\") pod \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") "
Sep 17 18:42:52.585971 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.585812    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-config\") pod \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") "
Sep 17 18:42:52.585971 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.585836    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-oauth-serving-cert\") pod \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") "
Sep 17 18:42:52.585971 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.585876    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-oauth-config\") pod \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") "
Sep 17 18:42:52.585971 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.585900    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-trusted-ca-bundle\") pod \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\" (UID: \"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a\") "
Sep 17 18:42:52.586245 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.586215    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" (UID: "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:42:52.586335 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.586286    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-config" (OuterVolumeSpecName: "console-config") pod "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" (UID: "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:42:52.586399 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.586348    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" (UID: "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:42:52.586847 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.586818    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" (UID: "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:42:52.588047 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.588023    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" (UID: "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:42:52.588180 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.588127    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" (UID: "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:42:52.588328 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.588284    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-kube-api-access-2n2qd" (OuterVolumeSpecName: "kube-api-access-2n2qd") pod "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" (UID: "3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a"). InnerVolumeSpecName "kube-api-access-2n2qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:42:52.687141 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.687094    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-oauth-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:52.687141 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.687132    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-trusted-ca-bundle\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:52.687141 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.687142    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:52.687141 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.687150    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-service-ca\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:52.687141 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.687159    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n2qd\" (UniqueName: \"kubernetes.io/projected/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-kube-api-access-2n2qd\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:52.687481 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.687168    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-console-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:52.687481 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:52.687176    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a-oauth-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:42:53.283800 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:53.283765    2575 generic.go:356] "Generic (PLEG): container finished" podID="3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" containerID="3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f" exitCode=0
Sep 17 18:42:53.284193 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:53.283812    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869fd4dc4d-rv482"
Sep 17 18:42:53.284193 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:53.283849    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869fd4dc4d-rv482" event={"ID":"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a","Type":"ContainerDied","Data":"3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f"}
Sep 17 18:42:53.284193 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:53.283900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869fd4dc4d-rv482" event={"ID":"3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a","Type":"ContainerDied","Data":"3d76c3d0bb59c794a8f9ab838e288cbcace7d449efd82579a4e15b13f49a5e2a"}
Sep 17 18:42:53.284193 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:53.283921    2575 scope.go:117] "RemoveContainer" containerID="3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f"
Sep 17 18:42:53.292209 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:53.292197    2575 scope.go:117] "RemoveContainer" containerID="3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f"
Sep 17 18:42:53.292477 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:42:53.292458    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f\": container with ID starting with 3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f not found: ID does not exist" containerID="3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f"
Sep 17 18:42:53.292563 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:53.292484    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f"} err="failed to get container status \"3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f\": rpc error: code = NotFound desc = could not find container \"3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f\": container with ID starting with 3c2d709f59d9730468bd07b4995d9476ae20bd7e7876900bd1d1fe6beae5325f not found: ID does not exist"
Sep 17 18:42:53.300950 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:53.300925    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869fd4dc4d-rv482"]
Sep 17 18:42:53.304755 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:53.304728    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-869fd4dc4d-rv482"]
Sep 17 18:42:55.210378 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:42:55.210343    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" path="/var/lib/kubelet/pods/3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a/volumes"
Sep 17 18:43:28.228982 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.228900    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ddb695c95-x8tz4"]
Sep 17 18:43:28.229456 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.229214    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" containerName="console"
Sep 17 18:43:28.229456 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.229230    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" containerName="console"
Sep 17 18:43:28.229456 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.229282    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d5ff0b1-9dda-484a-b8ee-c9fb6a8dde9a" containerName="console"
Sep 17 18:43:28.231493 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.231477    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.250613 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.250579    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddb695c95-x8tz4"]
Sep 17 18:43:28.261713 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.261678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-trusted-ca-bundle\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.261853 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.261806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-oauth-serving-cert\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.261853 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.261840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-oauth-config\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.261967 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.261866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-config\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.261967 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.261936    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-service-ca\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.262127 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.261997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-serving-cert\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.262127 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.262105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhmdz\" (UniqueName: \"kubernetes.io/projected/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-kube-api-access-dhmdz\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.362598 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.362559    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-oauth-serving-cert\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.362598 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.362596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-oauth-config\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.362826 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.362621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-config\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.362826 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.362657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-service-ca\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.362826 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.362689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-serving-cert\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.362826 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.362736    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhmdz\" (UniqueName: \"kubernetes.io/projected/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-kube-api-access-dhmdz\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.362826 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.362807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-trusted-ca-bundle\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.363492 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.363460    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-oauth-serving-cert\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.363691 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.363522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-service-ca\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.363691 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.363541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-config\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.363829 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.363688    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-trusted-ca-bundle\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.365542 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.365522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-oauth-config\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.365623 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.365607    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-serving-cert\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.371604 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.371582    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhmdz\" (UniqueName: \"kubernetes.io/projected/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-kube-api-access-dhmdz\") pod \"console-5ddb695c95-x8tz4\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") " pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.540803 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.540699    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:28.815668 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:28.815495    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ddb695c95-x8tz4"]
Sep 17 18:43:28.818337 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:43:28.818291    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd103f4b_4112_4af4_b49b_2c1d9aa6162c.slice/crio-98d88d103c3e762a92628e99d4f76d2952ad60a564b2f434af575d398489643e WatchSource:0}: Error finding container 98d88d103c3e762a92628e99d4f76d2952ad60a564b2f434af575d398489643e: Status 404 returned error can't find the container with id 98d88d103c3e762a92628e99d4f76d2952ad60a564b2f434af575d398489643e
Sep 17 18:43:29.420038 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:29.420001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddb695c95-x8tz4" event={"ID":"bd103f4b-4112-4af4-b49b-2c1d9aa6162c","Type":"ContainerStarted","Data":"fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e"}
Sep 17 18:43:29.420412 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:29.420084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddb695c95-x8tz4" event={"ID":"bd103f4b-4112-4af4-b49b-2c1d9aa6162c","Type":"ContainerStarted","Data":"98d88d103c3e762a92628e99d4f76d2952ad60a564b2f434af575d398489643e"}
Sep 17 18:43:29.441410 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:29.441360    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ddb695c95-x8tz4" podStartSLOduration=1.441344389 podStartE2EDuration="1.441344389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:43:29.440908861 +0000 UTC m=+260.512868888" watchObservedRunningTime="2026-09-17 18:43:29.441344389 +0000 UTC m=+260.513304417"
Sep 17 18:43:38.540932 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:38.540894    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:38.541400 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:38.540954    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:38.545531 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:38.545508    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:39.463892 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:39.463865    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:43:39.511418 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:43:39.511386    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bd956fb9c-vnkkz"]
Sep 17 18:44:04.530447 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.530387    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bd956fb9c-vnkkz" podUID="09f86f73-c7c2-4782-b9c3-f475b03b43b0" containerName="console" containerID="cri-o://a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8" gracePeriod=15
Sep 17 18:44:04.777659 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.777634    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:44:04.873212 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873131    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-serving-cert\") pod \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") "
Sep 17 18:44:04.873212 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873179    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-oauth-config\") pod \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") "
Sep 17 18:44:04.873212 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873206    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kvd4\" (UniqueName: \"kubernetes.io/projected/09f86f73-c7c2-4782-b9c3-f475b03b43b0-kube-api-access-6kvd4\") pod \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") "
Sep 17 18:44:04.873490 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873241    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-trusted-ca-bundle\") pod \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") "
Sep 17 18:44:04.873490 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873267    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-config\") pod \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") "
Sep 17 18:44:04.873490 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-oauth-serving-cert\") pod \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") "
Sep 17 18:44:04.873490 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873353    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-service-ca\") pod \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\" (UID: \"09f86f73-c7c2-4782-b9c3-f475b03b43b0\") "
Sep 17 18:44:04.873740 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873706    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-config" (OuterVolumeSpecName: "console-config") pod "09f86f73-c7c2-4782-b9c3-f475b03b43b0" (UID: "09f86f73-c7c2-4782-b9c3-f475b03b43b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:44:04.873740 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873718    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "09f86f73-c7c2-4782-b9c3-f475b03b43b0" (UID: "09f86f73-c7c2-4782-b9c3-f475b03b43b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:44:04.873854 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873770    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "09f86f73-c7c2-4782-b9c3-f475b03b43b0" (UID: "09f86f73-c7c2-4782-b9c3-f475b03b43b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:44:04.873954 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.873914    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "09f86f73-c7c2-4782-b9c3-f475b03b43b0" (UID: "09f86f73-c7c2-4782-b9c3-f475b03b43b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:44:04.875407 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.875383    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "09f86f73-c7c2-4782-b9c3-f475b03b43b0" (UID: "09f86f73-c7c2-4782-b9c3-f475b03b43b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:44:04.875489 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.875445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "09f86f73-c7c2-4782-b9c3-f475b03b43b0" (UID: "09f86f73-c7c2-4782-b9c3-f475b03b43b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:44:04.875489 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.875457    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09f86f73-c7c2-4782-b9c3-f475b03b43b0-kube-api-access-6kvd4" (OuterVolumeSpecName: "kube-api-access-6kvd4") pod "09f86f73-c7c2-4782-b9c3-f475b03b43b0" (UID: "09f86f73-c7c2-4782-b9c3-f475b03b43b0"). InnerVolumeSpecName "kube-api-access-6kvd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:44:04.973946 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.973899    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-oauth-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:44:04.973946 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.973942    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kvd4\" (UniqueName: \"kubernetes.io/projected/09f86f73-c7c2-4782-b9c3-f475b03b43b0-kube-api-access-6kvd4\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:44:04.973946 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.973952    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-trusted-ca-bundle\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:44:04.973946 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.973963    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:44:04.974205 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.973971    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-oauth-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:44:04.974205 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.973979    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09f86f73-c7c2-4782-b9c3-f475b03b43b0-service-ca\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:44:04.974205 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:04.973988    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09f86f73-c7c2-4782-b9c3-f475b03b43b0-console-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:44:05.557285 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:05.557199    2575 generic.go:356] "Generic (PLEG): container finished" podID="09f86f73-c7c2-4782-b9c3-f475b03b43b0" containerID="a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8" exitCode=0
Sep 17 18:44:05.557285 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:05.557245    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd956fb9c-vnkkz"
Sep 17 18:44:05.557697 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:05.557288    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd956fb9c-vnkkz" event={"ID":"09f86f73-c7c2-4782-b9c3-f475b03b43b0","Type":"ContainerDied","Data":"a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8"}
Sep 17 18:44:05.557697 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:05.557361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd956fb9c-vnkkz" event={"ID":"09f86f73-c7c2-4782-b9c3-f475b03b43b0","Type":"ContainerDied","Data":"5972ee1582fd9f81a8cec1170d2050a869dc762e5797e6fe5a3cc10e0cbe3291"}
Sep 17 18:44:05.557697 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:05.557382    2575 scope.go:117] "RemoveContainer" containerID="a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8"
Sep 17 18:44:05.565499 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:05.565484    2575 scope.go:117] "RemoveContainer" containerID="a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8"
Sep 17 18:44:05.565755 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:44:05.565738    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8\": container with ID starting with a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8 not found: ID does not exist" containerID="a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8"
Sep 17 18:44:05.565799 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:05.565764    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8"} err="failed to get container status \"a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8\": rpc error: code = NotFound desc = could not find container \"a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8\": container with ID starting with a9f57e45968e97d4274ce5f82c3165f3fabf152029d8d92281e49ef666692aa8 not found: ID does not exist"
Sep 17 18:44:05.573191 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:05.573170    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bd956fb9c-vnkkz"]
Sep 17 18:44:05.579023 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:05.579005    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bd956fb9c-vnkkz"]
Sep 17 18:44:07.210503 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:07.210471    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09f86f73-c7c2-4782-b9c3-f475b03b43b0" path="/var/lib/kubelet/pods/09f86f73-c7c2-4782-b9c3-f475b03b43b0/volumes"
Sep 17 18:44:11.088030 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:44:11.087999    2575 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 18:45:54.810046 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.810013    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fd6dcbbb6-mmclw"]
Sep 17 18:45:54.810536 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.810289    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09f86f73-c7c2-4782-b9c3-f475b03b43b0" containerName="console"
Sep 17 18:45:54.810536 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.810315    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="09f86f73-c7c2-4782-b9c3-f475b03b43b0" containerName="console"
Sep 17 18:45:54.810536 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.810374    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="09f86f73-c7c2-4782-b9c3-f475b03b43b0" containerName="console"
Sep 17 18:45:54.813071 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.813055    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:54.847242 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.847217    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fd6dcbbb6-mmclw"]
Sep 17 18:45:54.902386 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.902357    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqsgw\" (UniqueName: \"kubernetes.io/projected/99259b67-c5c6-495d-b7e3-15fcd7caab93-kube-api-access-zqsgw\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:54.902538 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.902395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99259b67-c5c6-495d-b7e3-15fcd7caab93-console-serving-cert\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:54.902538 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.902413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-console-config\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:54.902538 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.902481    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99259b67-c5c6-495d-b7e3-15fcd7caab93-console-oauth-config\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:54.902673 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.902551    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-service-ca\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:54.902673 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.902566    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-trusted-ca-bundle\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:54.902673 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:54.902601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-oauth-serving-cert\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.003194 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.003164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqsgw\" (UniqueName: \"kubernetes.io/projected/99259b67-c5c6-495d-b7e3-15fcd7caab93-kube-api-access-zqsgw\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.003339 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.003206    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99259b67-c5c6-495d-b7e3-15fcd7caab93-console-serving-cert\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.003339 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.003230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-console-config\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.003339 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.003253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99259b67-c5c6-495d-b7e3-15fcd7caab93-console-oauth-config\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.003339 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.003277    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-service-ca\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.003339 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.003312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-trusted-ca-bundle\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.003339 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.003342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-oauth-serving-cert\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.004066 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.004047    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-oauth-serving-cert\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.004178 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.004105    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-console-config\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.004178 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.004156    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-service-ca\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.004410 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.004390    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99259b67-c5c6-495d-b7e3-15fcd7caab93-trusted-ca-bundle\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.005801 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.005780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99259b67-c5c6-495d-b7e3-15fcd7caab93-console-oauth-config\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.005905 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.005888    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99259b67-c5c6-495d-b7e3-15fcd7caab93-console-serving-cert\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.012950 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.012922    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqsgw\" (UniqueName: \"kubernetes.io/projected/99259b67-c5c6-495d-b7e3-15fcd7caab93-kube-api-access-zqsgw\") pod \"console-fd6dcbbb6-mmclw\" (UID: \"99259b67-c5c6-495d-b7e3-15fcd7caab93\") " pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.121784 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.121696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:45:55.400550 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.400469    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fd6dcbbb6-mmclw"]
Sep 17 18:45:55.403827 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:45:55.403802    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99259b67_c5c6_495d_b7e3_15fcd7caab93.slice/crio-017a961bdd2d521695474042a458654d311a82c43c64a1296044acf7a2fde9bc WatchSource:0}: Error finding container 017a961bdd2d521695474042a458654d311a82c43c64a1296044acf7a2fde9bc: Status 404 returned error can't find the container with id 017a961bdd2d521695474042a458654d311a82c43c64a1296044acf7a2fde9bc
Sep 17 18:45:55.968554 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.968520    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd6dcbbb6-mmclw" event={"ID":"99259b67-c5c6-495d-b7e3-15fcd7caab93","Type":"ContainerStarted","Data":"8ebeeda59811d4fba58fa1a8da1e440ea067647786648bd09052740e3fbddb7c"}
Sep 17 18:45:55.968927 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.968573    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fd6dcbbb6-mmclw" event={"ID":"99259b67-c5c6-495d-b7e3-15fcd7caab93","Type":"ContainerStarted","Data":"017a961bdd2d521695474042a458654d311a82c43c64a1296044acf7a2fde9bc"}
Sep 17 18:45:55.992145 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:45:55.992094    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fd6dcbbb6-mmclw" podStartSLOduration=1.9920801529999999 podStartE2EDuration="1.992080153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:45:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:45:55.990513172 +0000 UTC m=+407.062473201" watchObservedRunningTime="2026-09-17 18:45:55.992080153 +0000 UTC m=+407.064040181"
Sep 17 18:46:05.122579 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:05.122540    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:46:05.122964 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:05.122635    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:46:05.126981 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:05.126960    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:46:06.009591 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:06.009564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fd6dcbbb6-mmclw"
Sep 17 18:46:06.055150 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:06.055119    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddb695c95-x8tz4"]
Sep 17 18:46:31.074498 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.074385    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5ddb695c95-x8tz4" podUID="bd103f4b-4112-4af4-b49b-2c1d9aa6162c" containerName="console" containerID="cri-o://fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e" gracePeriod=15
Sep 17 18:46:31.321387 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.321340    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:46:31.420827 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.420747    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-oauth-config\") pod \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") "
Sep 17 18:46:31.420827 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.420798    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-trusted-ca-bundle\") pod \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") "
Sep 17 18:46:31.420827 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.420819    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-oauth-serving-cert\") pod \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") "
Sep 17 18:46:31.421056 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.420903    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhmdz\" (UniqueName: \"kubernetes.io/projected/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-kube-api-access-dhmdz\") pod \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") "
Sep 17 18:46:31.421056 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.420938    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-serving-cert\") pod \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") "
Sep 17 18:46:31.421056 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.420968    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-service-ca\") pod \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") "
Sep 17 18:46:31.421056 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.420998    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-config\") pod \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\" (UID: \"bd103f4b-4112-4af4-b49b-2c1d9aa6162c\") "
Sep 17 18:46:31.421343 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.421311    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bd103f4b-4112-4af4-b49b-2c1d9aa6162c" (UID: "bd103f4b-4112-4af4-b49b-2c1d9aa6162c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:46:31.421468 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.421339    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bd103f4b-4112-4af4-b49b-2c1d9aa6162c" (UID: "bd103f4b-4112-4af4-b49b-2c1d9aa6162c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:46:31.421468 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.421400    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-service-ca" (OuterVolumeSpecName: "service-ca") pod "bd103f4b-4112-4af4-b49b-2c1d9aa6162c" (UID: "bd103f4b-4112-4af4-b49b-2c1d9aa6162c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:46:31.421468 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.421454    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-config" (OuterVolumeSpecName: "console-config") pod "bd103f4b-4112-4af4-b49b-2c1d9aa6162c" (UID: "bd103f4b-4112-4af4-b49b-2c1d9aa6162c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:46:31.422930 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.422905    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bd103f4b-4112-4af4-b49b-2c1d9aa6162c" (UID: "bd103f4b-4112-4af4-b49b-2c1d9aa6162c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:46:31.423023 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.423004    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bd103f4b-4112-4af4-b49b-2c1d9aa6162c" (UID: "bd103f4b-4112-4af4-b49b-2c1d9aa6162c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:46:31.423098 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.423074    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-kube-api-access-dhmdz" (OuterVolumeSpecName: "kube-api-access-dhmdz") pod "bd103f4b-4112-4af4-b49b-2c1d9aa6162c" (UID: "bd103f4b-4112-4af4-b49b-2c1d9aa6162c"). InnerVolumeSpecName "kube-api-access-dhmdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:46:31.522598 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.522555    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhmdz\" (UniqueName: \"kubernetes.io/projected/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-kube-api-access-dhmdz\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:46:31.522598 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.522588    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:46:31.522598 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.522602    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-service-ca\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:46:31.522829 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.522614    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:46:31.522829 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.522624    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-console-oauth-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:46:31.522829 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.522635    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-trusted-ca-bundle\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:46:31.522829 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:31.522647    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd103f4b-4112-4af4-b49b-2c1d9aa6162c-oauth-serving-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:46:32.104954 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:32.104917    2575 generic.go:356] "Generic (PLEG): container finished" podID="bd103f4b-4112-4af4-b49b-2c1d9aa6162c" containerID="fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e" exitCode=0
Sep 17 18:46:32.105390 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:32.104961    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ddb695c95-x8tz4"
Sep 17 18:46:32.105390 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:32.105001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddb695c95-x8tz4" event={"ID":"bd103f4b-4112-4af4-b49b-2c1d9aa6162c","Type":"ContainerDied","Data":"fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e"}
Sep 17 18:46:32.105390 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:32.105050    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ddb695c95-x8tz4" event={"ID":"bd103f4b-4112-4af4-b49b-2c1d9aa6162c","Type":"ContainerDied","Data":"98d88d103c3e762a92628e99d4f76d2952ad60a564b2f434af575d398489643e"}
Sep 17 18:46:32.105390 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:32.105069    2575 scope.go:117] "RemoveContainer" containerID="fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e"
Sep 17 18:46:32.113510 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:32.113493    2575 scope.go:117] "RemoveContainer" containerID="fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e"
Sep 17 18:46:32.113766 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:46:32.113747    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e\": container with ID starting with fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e not found: ID does not exist" containerID="fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e"
Sep 17 18:46:32.113815 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:32.113773    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e"} err="failed to get container status \"fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e\": rpc error: code = NotFound desc = could not find container \"fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e\": container with ID starting with fe8c567de0707e65564daff30bddee160c39d57fac5e09be20d9eed158325a8e not found: ID does not exist"
Sep 17 18:46:32.129145 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:32.129119    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ddb695c95-x8tz4"]
Sep 17 18:46:32.132078 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:32.132048    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ddb695c95-x8tz4"]
Sep 17 18:46:33.210271 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:46:33.210239    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd103f4b-4112-4af4-b49b-2c1d9aa6162c" path="/var/lib/kubelet/pods/bd103f4b-4112-4af4-b49b-2c1d9aa6162c/volumes"
Sep 17 18:47:21.815348 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.815314    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"]
Sep 17 18:47:21.815742 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.815615    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd103f4b-4112-4af4-b49b-2c1d9aa6162c" containerName="console"
Sep 17 18:47:21.815742 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.815627    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd103f4b-4112-4af4-b49b-2c1d9aa6162c" containerName="console"
Sep 17 18:47:21.815742 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.815678    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd103f4b-4112-4af4-b49b-2c1d9aa6162c" containerName="console"
Sep 17 18:47:21.819576 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.819560    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:47:21.826002 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.825589    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 17 18:47:21.826002 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.825595    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 17 18:47:21.826284 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.826267    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 17 18:47:21.826365 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.826267    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-j4qp2\""
Sep 17 18:47:21.833975 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.833951    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"]
Sep 17 18:47:21.923227 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.923180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9ff3765d-2b1e-480c-9cf2-baf988c72212-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dxn54\" (UID: \"9ff3765d-2b1e-480c-9cf2-baf988c72212\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:47:21.923412 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:21.923246    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jbwd\" (UniqueName: \"kubernetes.io/projected/9ff3765d-2b1e-480c-9cf2-baf988c72212-kube-api-access-9jbwd\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dxn54\" (UID: \"9ff3765d-2b1e-480c-9cf2-baf988c72212\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:47:22.024632 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:22.024585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jbwd\" (UniqueName: \"kubernetes.io/projected/9ff3765d-2b1e-480c-9cf2-baf988c72212-kube-api-access-9jbwd\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dxn54\" (UID: \"9ff3765d-2b1e-480c-9cf2-baf988c72212\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:47:22.024807 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:22.024674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9ff3765d-2b1e-480c-9cf2-baf988c72212-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dxn54\" (UID: \"9ff3765d-2b1e-480c-9cf2-baf988c72212\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:47:22.026928 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:22.026909    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/9ff3765d-2b1e-480c-9cf2-baf988c72212-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dxn54\" (UID: \"9ff3765d-2b1e-480c-9cf2-baf988c72212\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:47:22.041018 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:22.040999    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jbwd\" (UniqueName: \"kubernetes.io/projected/9ff3765d-2b1e-480c-9cf2-baf988c72212-kube-api-access-9jbwd\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-dxn54\" (UID: \"9ff3765d-2b1e-480c-9cf2-baf988c72212\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:47:22.129250 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:22.129158    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:47:22.412404 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:22.412309    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"]
Sep 17 18:47:22.415212 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:47:22.415182    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff3765d_2b1e_480c_9cf2_baf988c72212.slice/crio-696380e88c9ad5f5a0bbf3ffb5b1b8e2412a26ec3eafbf2ccb8247325c2946a4 WatchSource:0}: Error finding container 696380e88c9ad5f5a0bbf3ffb5b1b8e2412a26ec3eafbf2ccb8247325c2946a4: Status 404 returned error can't find the container with id 696380e88c9ad5f5a0bbf3ffb5b1b8e2412a26ec3eafbf2ccb8247325c2946a4
Sep 17 18:47:22.417153 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:22.417132    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 18:47:23.295692 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:23.295644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54" event={"ID":"9ff3765d-2b1e-480c-9cf2-baf988c72212","Type":"ContainerStarted","Data":"696380e88c9ad5f5a0bbf3ffb5b1b8e2412a26ec3eafbf2ccb8247325c2946a4"}
Sep 17 18:47:26.310921 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:26.310891    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54" event={"ID":"9ff3765d-2b1e-480c-9cf2-baf988c72212","Type":"ContainerStarted","Data":"5ec4e9e3623e3d1876e514a10105fa6bdb1301993dde0c003bc794e4e4fa8798"}
Sep 17 18:47:26.311373 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:26.311025    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:47:26.378528 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:26.378478    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54" podStartSLOduration=2.1977814430000002 podStartE2EDuration="5.378462814s" totalImagesPullingTime="3.180681371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:47:26.371620012 +0000 UTC m=+497.443580040" watchObservedRunningTime="2026-09-17 18:47:26.378462814 +0000 UTC m=+497.450422843"
Sep 17 18:47:47.317016 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:47:47.316980    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-dxn54"
Sep 17 18:48:54.390721 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.390686    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7dcf484667-2l7n7"]
Sep 17 18:48:54.393796 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.393779    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:54.396708 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.396681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Sep 17 18:48:54.396832 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.396784    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 17 18:48:54.396963 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.396938    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 17 18:48:54.397723 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.397708    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-p2znb\""
Sep 17 18:48:54.405791 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.405773    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"]
Sep 17 18:48:54.408739 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.408724    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:48:54.412059 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.412040    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-9gfhr\""
Sep 17 18:48:54.412263 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.412245    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Sep 17 18:48:54.413764 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.413745    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf484667-2l7n7"]
Sep 17 18:48:54.427075 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.427053    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"]
Sep 17 18:48:54.443488 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.443463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-cert\") pod \"kserve-controller-manager-7dcf484667-2l7n7\" (UID: \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\") " pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:54.443612 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.443502    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxzhc\" (UniqueName: \"kubernetes.io/projected/3fc54553-7cf5-48ca-bab4-d55fa15bb7dc-kube-api-access-lxzhc\") pod \"llmisvc-controller-manager-645f9c8fd6-mx7nf\" (UID: \"3fc54553-7cf5-48ca-bab4-d55fa15bb7dc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:48:54.443676 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.443643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkpf8\" (UniqueName: \"kubernetes.io/projected/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-kube-api-access-dkpf8\") pod \"kserve-controller-manager-7dcf484667-2l7n7\" (UID: \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\") " pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:54.443733 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.443675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fc54553-7cf5-48ca-bab4-d55fa15bb7dc-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-mx7nf\" (UID: \"3fc54553-7cf5-48ca-bab4-d55fa15bb7dc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:48:54.545071 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.545030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-cert\") pod \"kserve-controller-manager-7dcf484667-2l7n7\" (UID: \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\") " pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:54.545071 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.545076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxzhc\" (UniqueName: \"kubernetes.io/projected/3fc54553-7cf5-48ca-bab4-d55fa15bb7dc-kube-api-access-lxzhc\") pod \"llmisvc-controller-manager-645f9c8fd6-mx7nf\" (UID: \"3fc54553-7cf5-48ca-bab4-d55fa15bb7dc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:48:54.545274 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.545150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkpf8\" (UniqueName: \"kubernetes.io/projected/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-kube-api-access-dkpf8\") pod \"kserve-controller-manager-7dcf484667-2l7n7\" (UID: \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\") " pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:54.545274 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.545168    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fc54553-7cf5-48ca-bab4-d55fa15bb7dc-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-mx7nf\" (UID: \"3fc54553-7cf5-48ca-bab4-d55fa15bb7dc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:48:54.545274 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:48:54.545182    2575 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 17 18:48:54.545421 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:48:54.545280    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-cert podName:ea38d95a-fe1e-47a0-88a5-dd730bb98a92 nodeName:}" failed. No retries permitted until 2026-09-17 18:48:55.045261785 +0000 UTC m=+586.117221799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-cert") pod "kserve-controller-manager-7dcf484667-2l7n7" (UID: "ea38d95a-fe1e-47a0-88a5-dd730bb98a92") : secret "kserve-webhook-server-cert" not found
Sep 17 18:48:54.547616 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.547590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fc54553-7cf5-48ca-bab4-d55fa15bb7dc-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-mx7nf\" (UID: \"3fc54553-7cf5-48ca-bab4-d55fa15bb7dc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:48:54.555054 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.555020    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxzhc\" (UniqueName: \"kubernetes.io/projected/3fc54553-7cf5-48ca-bab4-d55fa15bb7dc-kube-api-access-lxzhc\") pod \"llmisvc-controller-manager-645f9c8fd6-mx7nf\" (UID: \"3fc54553-7cf5-48ca-bab4-d55fa15bb7dc\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:48:54.555169 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.555089    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkpf8\" (UniqueName: \"kubernetes.io/projected/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-kube-api-access-dkpf8\") pod \"kserve-controller-manager-7dcf484667-2l7n7\" (UID: \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\") " pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:54.718627 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:54.718596    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:48:55.005732 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:55.005597    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"]
Sep 17 18:48:55.007796 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:48:55.007757    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3fc54553_7cf5_48ca_bab4_d55fa15bb7dc.slice/crio-a1f7b0dd535312b2f080074340fb648780689f654ea8cf04f98c8bc3ded1cb97 WatchSource:0}: Error finding container a1f7b0dd535312b2f080074340fb648780689f654ea8cf04f98c8bc3ded1cb97: Status 404 returned error can't find the container with id a1f7b0dd535312b2f080074340fb648780689f654ea8cf04f98c8bc3ded1cb97
Sep 17 18:48:55.048770 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:55.048745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-cert\") pod \"kserve-controller-manager-7dcf484667-2l7n7\" (UID: \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\") " pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:55.051125 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:55.051102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-cert\") pod \"kserve-controller-manager-7dcf484667-2l7n7\" (UID: \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\") " pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:55.303359 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:55.303252    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:55.577080 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:55.577003    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf484667-2l7n7"]
Sep 17 18:48:55.579545 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:48:55.579512    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea38d95a_fe1e_47a0_88a5_dd730bb98a92.slice/crio-151fde14b4c339d8da0ae8b8125e75335a00ae5cc4a8158c5ca7f1f7b6373311 WatchSource:0}: Error finding container 151fde14b4c339d8da0ae8b8125e75335a00ae5cc4a8158c5ca7f1f7b6373311: Status 404 returned error can't find the container with id 151fde14b4c339d8da0ae8b8125e75335a00ae5cc4a8158c5ca7f1f7b6373311
Sep 17 18:48:55.672564 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:55.672527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf" event={"ID":"3fc54553-7cf5-48ca-bab4-d55fa15bb7dc","Type":"ContainerStarted","Data":"a1f7b0dd535312b2f080074340fb648780689f654ea8cf04f98c8bc3ded1cb97"}
Sep 17 18:48:55.674086 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:55.674056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7" event={"ID":"ea38d95a-fe1e-47a0-88a5-dd730bb98a92","Type":"ContainerStarted","Data":"151fde14b4c339d8da0ae8b8125e75335a00ae5cc4a8158c5ca7f1f7b6373311"}
Sep 17 18:48:58.690284 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:58.690248    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf" event={"ID":"3fc54553-7cf5-48ca-bab4-d55fa15bb7dc","Type":"ContainerStarted","Data":"4287c2af855c46119f0bf89e67f9b93deab6b7f161f608c3cd37e22de4fc55ee"}
Sep 17 18:48:58.690717 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:58.690375    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:48:58.691699 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:58.691677    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7" event={"ID":"ea38d95a-fe1e-47a0-88a5-dd730bb98a92","Type":"ContainerStarted","Data":"8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524"}
Sep 17 18:48:58.691837 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:58.691822    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:48:58.709952 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:58.709909    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf" podStartSLOduration=2.005480638 podStartE2EDuration="4.709896965s" totalImagesPullingTime="2.704416327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:48:58.707930951 +0000 UTC m=+589.779890981" watchObservedRunningTime="2026-09-17 18:48:58.709896965 +0000 UTC m=+589.781857058"
Sep 17 18:48:58.726861 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:48:58.726768    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7" podStartSLOduration=1.8348016999999999 podStartE2EDuration="4.726749514s" totalImagesPullingTime="2.891947814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:48:58.726010056 +0000 UTC m=+589.797970095" watchObservedRunningTime="2026-09-17 18:48:58.726749514 +0000 UTC m=+589.798709545"
Sep 17 18:49:29.698609 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:29.698532    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-mx7nf"
Sep 17 18:49:29.701401 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:29.701379    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:49:37.907547 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:37.907513    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7dcf484667-2l7n7"]
Sep 17 18:49:37.908039 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:37.907695    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7" podUID="ea38d95a-fe1e-47a0-88a5-dd730bb98a92" containerName="manager" containerID="cri-o://8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524" gracePeriod=10
Sep 17 18:49:37.941247 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:37.941208    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7dcf484667-78sst"]
Sep 17 18:49:37.943619 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:37.943600    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:49:37.953788 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:37.953758    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf484667-78sst"]
Sep 17 18:49:38.112623 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.112593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxpgl\" (UniqueName: \"kubernetes.io/projected/7b20eee5-994f-45e4-aac6-81ed1766546b-kube-api-access-nxpgl\") pod \"kserve-controller-manager-7dcf484667-78sst\" (UID: \"7b20eee5-994f-45e4-aac6-81ed1766546b\") " pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:49:38.112781 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.112647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b20eee5-994f-45e4-aac6-81ed1766546b-cert\") pod \"kserve-controller-manager-7dcf484667-78sst\" (UID: \"7b20eee5-994f-45e4-aac6-81ed1766546b\") " pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:49:38.146369 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.146346    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:49:38.213547 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.213513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxpgl\" (UniqueName: \"kubernetes.io/projected/7b20eee5-994f-45e4-aac6-81ed1766546b-kube-api-access-nxpgl\") pod \"kserve-controller-manager-7dcf484667-78sst\" (UID: \"7b20eee5-994f-45e4-aac6-81ed1766546b\") " pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:49:38.213732 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.213577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b20eee5-994f-45e4-aac6-81ed1766546b-cert\") pod \"kserve-controller-manager-7dcf484667-78sst\" (UID: \"7b20eee5-994f-45e4-aac6-81ed1766546b\") " pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:49:38.215878 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.215855    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b20eee5-994f-45e4-aac6-81ed1766546b-cert\") pod \"kserve-controller-manager-7dcf484667-78sst\" (UID: \"7b20eee5-994f-45e4-aac6-81ed1766546b\") " pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:49:38.224949 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.224925    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxpgl\" (UniqueName: \"kubernetes.io/projected/7b20eee5-994f-45e4-aac6-81ed1766546b-kube-api-access-nxpgl\") pod \"kserve-controller-manager-7dcf484667-78sst\" (UID: \"7b20eee5-994f-45e4-aac6-81ed1766546b\") " pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:49:38.278476 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.278448    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:49:38.314134 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.314103    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkpf8\" (UniqueName: \"kubernetes.io/projected/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-kube-api-access-dkpf8\") pod \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\" (UID: \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\") "
Sep 17 18:49:38.314134 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.314144    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-cert\") pod \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\" (UID: \"ea38d95a-fe1e-47a0-88a5-dd730bb98a92\") "
Sep 17 18:49:38.316938 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.316907    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-cert" (OuterVolumeSpecName: "cert") pod "ea38d95a-fe1e-47a0-88a5-dd730bb98a92" (UID: "ea38d95a-fe1e-47a0-88a5-dd730bb98a92"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:49:38.317049 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.316916    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-kube-api-access-dkpf8" (OuterVolumeSpecName: "kube-api-access-dkpf8") pod "ea38d95a-fe1e-47a0-88a5-dd730bb98a92" (UID: "ea38d95a-fe1e-47a0-88a5-dd730bb98a92"). InnerVolumeSpecName "kube-api-access-dkpf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:49:38.415667 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.415627    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkpf8\" (UniqueName: \"kubernetes.io/projected/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-kube-api-access-dkpf8\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:49:38.415667 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.415660    2575 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea38d95a-fe1e-47a0-88a5-dd730bb98a92-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:49:38.562437 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.562365    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7dcf484667-78sst"]
Sep 17 18:49:38.565602 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:49:38.565578    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b20eee5_994f_45e4_aac6_81ed1766546b.slice/crio-2a18ea2944889f79ca1d43a26bbd3454895ddd1e6c8620673be9479d401ddce2 WatchSource:0}: Error finding container 2a18ea2944889f79ca1d43a26bbd3454895ddd1e6c8620673be9479d401ddce2: Status 404 returned error can't find the container with id 2a18ea2944889f79ca1d43a26bbd3454895ddd1e6c8620673be9479d401ddce2
Sep 17 18:49:38.866287 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.866192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf484667-78sst" event={"ID":"7b20eee5-994f-45e4-aac6-81ed1766546b","Type":"ContainerStarted","Data":"2a18ea2944889f79ca1d43a26bbd3454895ddd1e6c8620673be9479d401ddce2"}
Sep 17 18:49:38.867418 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.867389    2575 generic.go:356] "Generic (PLEG): container finished" podID="ea38d95a-fe1e-47a0-88a5-dd730bb98a92" containerID="8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524" exitCode=0
Sep 17 18:49:38.867547 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.867436    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7"
Sep 17 18:49:38.867547 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.867434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7" event={"ID":"ea38d95a-fe1e-47a0-88a5-dd730bb98a92","Type":"ContainerDied","Data":"8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524"}
Sep 17 18:49:38.867624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.867569    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf484667-2l7n7" event={"ID":"ea38d95a-fe1e-47a0-88a5-dd730bb98a92","Type":"ContainerDied","Data":"151fde14b4c339d8da0ae8b8125e75335a00ae5cc4a8158c5ca7f1f7b6373311"}
Sep 17 18:49:38.867624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.867599    2575 scope.go:117] "RemoveContainer" containerID="8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524"
Sep 17 18:49:38.876165 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.876151    2575 scope.go:117] "RemoveContainer" containerID="8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524"
Sep 17 18:49:38.876497 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:49:38.876473    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524\": container with ID starting with 8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524 not found: ID does not exist" containerID="8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524"
Sep 17 18:49:38.876585 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.876503    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524"} err="failed to get container status \"8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524\": rpc error: code = NotFound desc = could not find container \"8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524\": container with ID starting with 8d97b9c2b7a2ebfdeafc77dfb76db320f778da4017fb5329345a5f7e08296524 not found: ID does not exist"
Sep 17 18:49:38.888941 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.888914    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7dcf484667-2l7n7"]
Sep 17 18:49:38.891041 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:38.891022    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7dcf484667-2l7n7"]
Sep 17 18:49:39.210597 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:39.210567    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea38d95a-fe1e-47a0-88a5-dd730bb98a92" path="/var/lib/kubelet/pods/ea38d95a-fe1e-47a0-88a5-dd730bb98a92/volumes"
Sep 17 18:49:39.874687 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:39.874650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7dcf484667-78sst" event={"ID":"7b20eee5-994f-45e4-aac6-81ed1766546b","Type":"ContainerStarted","Data":"997ef186a2894922a657dfb43b2f1e0701955dd38681aaf42fb3290f2576bcf7"}
Sep 17 18:49:39.874862 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:39.874787    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:49:39.894343 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:49:39.894276    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7dcf484667-78sst" podStartSLOduration=2.538149102 podStartE2EDuration="2.894262814s" totalImagesPullingTime="356.113712ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:49:39.893475951 +0000 UTC m=+630.965435973" watchObservedRunningTime="2026-09-17 18:49:39.894262814 +0000 UTC m=+630.966222842"
Sep 17 18:50:10.883409 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:50:10.883375    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7dcf484667-78sst"
Sep 17 18:52:01.384198 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.384160    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"]
Sep 17 18:52:01.384674 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.384488    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea38d95a-fe1e-47a0-88a5-dd730bb98a92" containerName="manager"
Sep 17 18:52:01.384674 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.384499    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea38d95a-fe1e-47a0-88a5-dd730bb98a92" containerName="manager"
Sep 17 18:52:01.384674 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.384548    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea38d95a-fe1e-47a0-88a5-dd730bb98a92" containerName="manager"
Sep 17 18:52:01.391676 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.391649    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.394313 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.394278    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 17 18:52:01.394457 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.394371    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 18:52:01.394457 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.394374    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 18:52:01.394580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.394495    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Sep 17 18:52:01.395233 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.395218    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-b8646\""
Sep 17 18:52:01.395276 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.395248    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Sep 17 18:52:01.395332 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.395282    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 18:52:01.400407 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.400386    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"]
Sep 17 18:52:01.498485 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.498454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618365a2-bc6f-4f35-9f00-5195628993af-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.498665 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.498522    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618365a2-bc6f-4f35-9f00-5195628993af-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.498665 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.498556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.498665 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.498582    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.498861 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.498719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d58q2\" (UniqueName: \"kubernetes.io/projected/618365a2-bc6f-4f35-9f00-5195628993af-kube-api-access-d58q2\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.546913 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.546882    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"]
Sep 17 18:52:01.550401 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.550380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:01.552694 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.552673    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-a006b-predictor-serving-cert\""
Sep 17 18:52:01.552840 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.552679    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-a006b-kube-rbac-proxy-sar-config\""
Sep 17 18:52:01.560825 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.560801    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"]
Sep 17 18:52:01.599710 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.599676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618365a2-bc6f-4f35-9f00-5195628993af-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.599710 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.599719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618365a2-bc6f-4f35-9f00-5195628993af-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.599979 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.599743    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.599979 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.599777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.599979 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.599845    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d58q2\" (UniqueName: \"kubernetes.io/projected/618365a2-bc6f-4f35-9f00-5195628993af-kube-api-access-d58q2\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.600176 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.600153    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618365a2-bc6f-4f35-9f00-5195628993af-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.600676 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.600648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.600795 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.600653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.602446 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.602427    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618365a2-bc6f-4f35-9f00-5195628993af-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.612552 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.612519    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d58q2\" (UniqueName: \"kubernetes.io/projected/618365a2-bc6f-4f35-9f00-5195628993af-kube-api-access-d58q2\") pod \"isvc-xgboost-graph-predictor-555fc69d56-t2j4m\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.700635 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.700602    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qbr6\" (UniqueName: \"kubernetes.io/projected/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-api-access-9qbr6\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:01.700792 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.700653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:01.700792 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.700677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7155fd1e-43dd-466e-8409-06a9ee5f3abc-proxy-tls\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:01.703588 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.703564    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:01.801375 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.801347    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:01.801521 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.801385    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7155fd1e-43dd-466e-8409-06a9ee5f3abc-proxy-tls\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:01.801521 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.801440    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qbr6\" (UniqueName: \"kubernetes.io/projected/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-api-access-9qbr6\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:01.801644 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:52:01.801573    2575 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-a006b-predictor-serving-cert: secret "error-404-isvc-a006b-predictor-serving-cert" not found
Sep 17 18:52:01.801692 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:52:01.801641    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7155fd1e-43dd-466e-8409-06a9ee5f3abc-proxy-tls podName:7155fd1e-43dd-466e-8409-06a9ee5f3abc nodeName:}" failed. No retries permitted until 2026-09-17 18:52:02.30162316 +0000 UTC m=+773.373583165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/7155fd1e-43dd-466e-8409-06a9ee5f3abc-proxy-tls") pod "error-404-isvc-a006b-predictor-85d585c4ff-p948h" (UID: "7155fd1e-43dd-466e-8409-06a9ee5f3abc") : secret "error-404-isvc-a006b-predictor-serving-cert" not found
Sep 17 18:52:01.802049 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.802031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:01.810970 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.810950    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qbr6\" (UniqueName: \"kubernetes.io/projected/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-api-access-9qbr6\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:01.978395 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:01.978320    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"]
Sep 17 18:52:01.981584 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:52:01.981559    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618365a2_bc6f_4f35_9f00_5195628993af.slice/crio-7b1b709b35f3a2bfc827d7e5dc001605e8d43f7921585570cd4feed4c8923786 WatchSource:0}: Error finding container 7b1b709b35f3a2bfc827d7e5dc001605e8d43f7921585570cd4feed4c8923786: Status 404 returned error can't find the container with id 7b1b709b35f3a2bfc827d7e5dc001605e8d43f7921585570cd4feed4c8923786
Sep 17 18:52:02.305743 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:02.305639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7155fd1e-43dd-466e-8409-06a9ee5f3abc-proxy-tls\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:02.308053 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:02.308026    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7155fd1e-43dd-466e-8409-06a9ee5f3abc-proxy-tls\") pod \"error-404-isvc-a006b-predictor-85d585c4ff-p948h\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") " pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:02.459909 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:02.459870    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" event={"ID":"618365a2-bc6f-4f35-9f00-5195628993af","Type":"ContainerStarted","Data":"7b1b709b35f3a2bfc827d7e5dc001605e8d43f7921585570cd4feed4c8923786"}
Sep 17 18:52:02.461063 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:02.461043    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:02.731907 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:02.731804    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"]
Sep 17 18:52:02.734656 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:52:02.734631    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7155fd1e_43dd_466e_8409_06a9ee5f3abc.slice/crio-b41c16080b6478c9b168e0e54fd0893755bfa3e51e7c4e35d5bc3bd717d3e42a WatchSource:0}: Error finding container b41c16080b6478c9b168e0e54fd0893755bfa3e51e7c4e35d5bc3bd717d3e42a: Status 404 returned error can't find the container with id b41c16080b6478c9b168e0e54fd0893755bfa3e51e7c4e35d5bc3bd717d3e42a
Sep 17 18:52:03.467985 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:03.467872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" event={"ID":"7155fd1e-43dd-466e-8409-06a9ee5f3abc","Type":"ContainerStarted","Data":"b41c16080b6478c9b168e0e54fd0893755bfa3e51e7c4e35d5bc3bd717d3e42a"}
Sep 17 18:52:13.729459 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:13.729426    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 17 18:52:15.544144 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:15.544106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" event={"ID":"618365a2-bc6f-4f35-9f00-5195628993af","Type":"ContainerStarted","Data":"9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94"}
Sep 17 18:52:15.545719 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:15.545692    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" event={"ID":"7155fd1e-43dd-466e-8409-06a9ee5f3abc","Type":"ContainerStarted","Data":"b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf"}
Sep 17 18:52:18.562875 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:18.562838    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" event={"ID":"7155fd1e-43dd-466e-8409-06a9ee5f3abc","Type":"ContainerStarted","Data":"a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17"}
Sep 17 18:52:18.563290 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:18.562935    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:18.602172 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:18.602114    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podStartSLOduration=2.708771898 podStartE2EDuration="17.602096213s" totalImagesPullingTime="14.893324315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:52:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:52:18.602044161 +0000 UTC m=+789.674004213" watchObservedRunningTime="2026-09-17 18:52:18.602096213 +0000 UTC m=+789.674056241"
Sep 17 18:52:19.568756 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:19.568671    2575 generic.go:356] "Generic (PLEG): container finished" podID="618365a2-bc6f-4f35-9f00-5195628993af" containerID="9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94" exitCode=0
Sep 17 18:52:19.568756 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:19.568743    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" event={"ID":"618365a2-bc6f-4f35-9f00-5195628993af","Type":"ContainerDied","Data":"9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94"}
Sep 17 18:52:19.569244 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:19.569171    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:19.570659 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:19.570621    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 18:52:20.575704 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:20.575276    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 18:52:25.580489 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:25.580270    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:52:25.580862 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:25.580825    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 18:52:35.581621 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:35.581584    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 18:52:40.677107 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:40.677065    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" event={"ID":"618365a2-bc6f-4f35-9f00-5195628993af","Type":"ContainerStarted","Data":"753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589"}
Sep 17 18:52:40.677541 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:40.677160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" event={"ID":"618365a2-bc6f-4f35-9f00-5195628993af","Type":"ContainerStarted","Data":"e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87"}
Sep 17 18:52:40.677541 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:40.677454    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:40.677669 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:40.677594    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:40.678602 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:40.678577    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 18:52:40.698829 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:40.698781    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podStartSLOduration=3.8184656710000002 podStartE2EDuration="39.698768985s" totalImagesPullingTime="32.018036609s" totalInitContainerRuntime="3.862266705s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:52:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:52:40.697005987 +0000 UTC m=+811.768966036" watchObservedRunningTime="2026-09-17 18:52:40.698768985 +0000 UTC m=+811.770729010"
Sep 17 18:52:41.681883 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:41.681842    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 18:52:45.581453 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:45.581409    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 18:52:46.686326 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:46.686285    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:52:46.686882 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:46.686853    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 18:52:55.580893 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:55.580848    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 18:52:56.686994 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:52:56.686950    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 18:53:05.581967 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:05.581931    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:53:06.687624 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:06.687587    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 18:53:16.687271 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:16.687230    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 18:53:26.687316 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:26.687258    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 18:53:35.486077 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.486044    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"]
Sep 17 18:53:35.486556 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.486368    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container" containerID="cri-o://b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf" gracePeriod=30
Sep 17 18:53:35.486556 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.486434    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kube-rbac-proxy" containerID="cri-o://a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17" gracePeriod=30
Sep 17 18:53:35.575567 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.575529    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.31:8643/healthz\": dial tcp 10.134.0.31:8643: connect: connection refused"
Sep 17 18:53:35.581465 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.581430    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.31:8080: connect: connection refused"
Sep 17 18:53:35.674107 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.674073    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"]
Sep 17 18:53:35.676738 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.676719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.679290 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.679267    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-7989f-predictor-serving-cert\""
Sep 17 18:53:35.679486 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.679468    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-7989f-kube-rbac-proxy-sar-config\""
Sep 17 18:53:35.687854 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.687823    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"]
Sep 17 18:53:35.805270 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.805183    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7989f-predictor-5999f84fc9-5kctr\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") " pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.805270 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.805233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvcjk\" (UniqueName: \"kubernetes.io/projected/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-api-access-pvcjk\") pod \"error-404-isvc-7989f-predictor-5999f84fc9-5kctr\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") " pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.805465 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.805337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c54394c-37f9-43f7-bf87-c9115c441e61-proxy-tls\") pod \"error-404-isvc-7989f-predictor-5999f84fc9-5kctr\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") " pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.905754 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.905719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c54394c-37f9-43f7-bf87-c9115c441e61-proxy-tls\") pod \"error-404-isvc-7989f-predictor-5999f84fc9-5kctr\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") " pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.905945 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.905779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7989f-predictor-5999f84fc9-5kctr\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") " pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.905945 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.905808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvcjk\" (UniqueName: \"kubernetes.io/projected/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-api-access-pvcjk\") pod \"error-404-isvc-7989f-predictor-5999f84fc9-5kctr\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") " pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.906500 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.906468    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7989f-predictor-5999f84fc9-5kctr\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") " pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.908194 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.908172    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c54394c-37f9-43f7-bf87-c9115c441e61-proxy-tls\") pod \"error-404-isvc-7989f-predictor-5999f84fc9-5kctr\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") " pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.914631 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.914612    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvcjk\" (UniqueName: \"kubernetes.io/projected/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-api-access-pvcjk\") pod \"error-404-isvc-7989f-predictor-5999f84fc9-5kctr\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") " pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:35.919420 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.919395    2575 generic.go:356] "Generic (PLEG): container finished" podID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerID="a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17" exitCode=2
Sep 17 18:53:35.919504 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.919433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" event={"ID":"7155fd1e-43dd-466e-8409-06a9ee5f3abc","Type":"ContainerDied","Data":"a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17"}
Sep 17 18:53:35.986491 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:35.986458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:36.259940 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:36.259916    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"]
Sep 17 18:53:36.262204 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:53:36.262182    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c54394c_37f9_43f7_bf87_c9115c441e61.slice/crio-06e7f486b111a3735802a9377d6d173ed956c3d6a2b4f221f62322d24464df57 WatchSource:0}: Error finding container 06e7f486b111a3735802a9377d6d173ed956c3d6a2b4f221f62322d24464df57: Status 404 returned error can't find the container with id 06e7f486b111a3735802a9377d6d173ed956c3d6a2b4f221f62322d24464df57
Sep 17 18:53:36.687595 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:36.687510    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 18:53:36.925872 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:36.925829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" event={"ID":"1c54394c-37f9-43f7-bf87-c9115c441e61","Type":"ContainerStarted","Data":"dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2"}
Sep 17 18:53:36.926052 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:36.925903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" event={"ID":"1c54394c-37f9-43f7-bf87-c9115c441e61","Type":"ContainerStarted","Data":"8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f"}
Sep 17 18:53:36.926052 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:36.925940    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:36.926052 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:36.925969    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" event={"ID":"1c54394c-37f9-43f7-bf87-c9115c441e61","Type":"ContainerStarted","Data":"06e7f486b111a3735802a9377d6d173ed956c3d6a2b4f221f62322d24464df57"}
Sep 17 18:53:36.946161 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:36.946068    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" podStartSLOduration=1.946050315 podStartE2EDuration="1.946050315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:53:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:53:36.944981001 +0000 UTC m=+868.016941028" watchObservedRunningTime="2026-09-17 18:53:36.946050315 +0000 UTC m=+868.018010343"
Sep 17 18:53:37.932073 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:37.932034    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:37.933460 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:37.933420    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Sep 17 18:53:38.727014 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.726991    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:53:38.830805 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.830721    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qbr6\" (UniqueName: \"kubernetes.io/projected/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-api-access-9qbr6\") pod \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") "
Sep 17 18:53:38.830805 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.830805    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-rbac-proxy-sar-config\") pod \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") "
Sep 17 18:53:38.831018 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.830979    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7155fd1e-43dd-466e-8409-06a9ee5f3abc-proxy-tls\") pod \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\" (UID: \"7155fd1e-43dd-466e-8409-06a9ee5f3abc\") "
Sep 17 18:53:38.831157 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.831135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7155fd1e-43dd-466e-8409-06a9ee5f3abc" (UID: "7155fd1e-43dd-466e-8409-06a9ee5f3abc"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:53:38.831258 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.831244    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:53:38.833138 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.833114    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7155fd1e-43dd-466e-8409-06a9ee5f3abc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7155fd1e-43dd-466e-8409-06a9ee5f3abc" (UID: "7155fd1e-43dd-466e-8409-06a9ee5f3abc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:53:38.833138 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.833127    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-api-access-9qbr6" (OuterVolumeSpecName: "kube-api-access-9qbr6") pod "7155fd1e-43dd-466e-8409-06a9ee5f3abc" (UID: "7155fd1e-43dd-466e-8409-06a9ee5f3abc"). InnerVolumeSpecName "kube-api-access-9qbr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:53:38.932307 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.932271    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qbr6\" (UniqueName: \"kubernetes.io/projected/7155fd1e-43dd-466e-8409-06a9ee5f3abc-kube-api-access-9qbr6\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:53:38.932307 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.932308    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7155fd1e-43dd-466e-8409-06a9ee5f3abc-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:53:38.938471 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.938437    2575 generic.go:356] "Generic (PLEG): container finished" podID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerID="b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf" exitCode=0
Sep 17 18:53:38.938584 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.938490    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"
Sep 17 18:53:38.938584 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.938523    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" event={"ID":"7155fd1e-43dd-466e-8409-06a9ee5f3abc","Type":"ContainerDied","Data":"b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf"}
Sep 17 18:53:38.938664 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.938589    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h" event={"ID":"7155fd1e-43dd-466e-8409-06a9ee5f3abc","Type":"ContainerDied","Data":"b41c16080b6478c9b168e0e54fd0893755bfa3e51e7c4e35d5bc3bd717d3e42a"}
Sep 17 18:53:38.938664 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.938616    2575 scope.go:117] "RemoveContainer" containerID="a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17"
Sep 17 18:53:38.939078 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.939051    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Sep 17 18:53:38.948026 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.948012    2575 scope.go:117] "RemoveContainer" containerID="b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf"
Sep 17 18:53:38.955170 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.955154    2575 scope.go:117] "RemoveContainer" containerID="a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17"
Sep 17 18:53:38.955439 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:53:38.955422    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17\": container with ID starting with a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17 not found: ID does not exist" containerID="a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17"
Sep 17 18:53:38.955491 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.955449    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17"} err="failed to get container status \"a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17\": rpc error: code = NotFound desc = could not find container \"a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17\": container with ID starting with a4e1180e3885b2b368bd0f7996ea79cd881f36314ab7a3cb61bc658744929c17 not found: ID does not exist"
Sep 17 18:53:38.955491 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.955465    2575 scope.go:117] "RemoveContainer" containerID="b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf"
Sep 17 18:53:38.955708 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:53:38.955690    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf\": container with ID starting with b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf not found: ID does not exist" containerID="b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf"
Sep 17 18:53:38.955744 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.955715    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf"} err="failed to get container status \"b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf\": rpc error: code = NotFound desc = could not find container \"b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf\": container with ID starting with b0fceeab5d8fed07847897115896f258f8bc65736141b8cb62a00dc9558fcccf not found: ID does not exist"
Sep 17 18:53:38.960037 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.960016    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"]
Sep 17 18:53:38.963956 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:38.963936    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h"]
Sep 17 18:53:39.211809 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:39.211773    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" path="/var/lib/kubelet/pods/7155fd1e-43dd-466e-8409-06a9ee5f3abc/volumes"
Sep 17 18:53:43.944018 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:43.943987    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:53:43.944690 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:43.944660    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Sep 17 18:53:46.687163 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:46.687118    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.30:8080: connect: connection refused"
Sep 17 18:53:53.945050 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:53.944966    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Sep 17 18:53:56.687895 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:53:56.687865    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:54:03.945143 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:03.945099    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Sep 17 18:54:13.945257 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:13.945212    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.32:8080: connect: connection refused"
Sep 17 18:54:21.838536 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:21.838502    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"]
Sep 17 18:54:21.838893 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:21.838735    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container" containerID="cri-o://e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87" gracePeriod=30
Sep 17 18:54:21.838893 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:21.838810    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kube-rbac-proxy" containerID="cri-o://753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589" gracePeriod=30
Sep 17 18:54:22.022432 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.022393    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"]
Sep 17 18:54:22.022793 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.022776    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kube-rbac-proxy"
Sep 17 18:54:22.022906 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.022796    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kube-rbac-proxy"
Sep 17 18:54:22.022906 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.022841    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container"
Sep 17 18:54:22.022906 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.022850    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container"
Sep 17 18:54:22.023093 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.022929    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kserve-container"
Sep 17 18:54:22.023093 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.022940    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7155fd1e-43dd-466e-8409-06a9ee5f3abc" containerName="kube-rbac-proxy"
Sep 17 18:54:22.025340 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.025319    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.027800 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.027781    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-887e9-predictor-serving-cert\""
Sep 17 18:54:22.028267 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.028252    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-887e9-kube-rbac-proxy-sar-config\""
Sep 17 18:54:22.037909 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.037886    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"]
Sep 17 18:54:22.093536 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.093463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/260ca545-8921-41c9-bd37-4371e1027b3d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.093666 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.093553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbz7r\" (UniqueName: \"kubernetes.io/projected/260ca545-8921-41c9-bd37-4371e1027b3d-kube-api-access-wbz7r\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.093666 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.093593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/260ca545-8921-41c9-bd37-4371e1027b3d-proxy-tls\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.133851 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.133821    2575 generic.go:356] "Generic (PLEG): container finished" podID="618365a2-bc6f-4f35-9f00-5195628993af" containerID="753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589" exitCode=2
Sep 17 18:54:22.133991 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.133868    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" event={"ID":"618365a2-bc6f-4f35-9f00-5195628993af","Type":"ContainerDied","Data":"753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589"}
Sep 17 18:54:22.194568 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.194533    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/260ca545-8921-41c9-bd37-4371e1027b3d-proxy-tls\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.194733 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.194585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/260ca545-8921-41c9-bd37-4371e1027b3d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.194733 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.194651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbz7r\" (UniqueName: \"kubernetes.io/projected/260ca545-8921-41c9-bd37-4371e1027b3d-kube-api-access-wbz7r\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.194733 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:54:22.194700    2575 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-887e9-predictor-serving-cert: secret "error-404-isvc-887e9-predictor-serving-cert" not found
Sep 17 18:54:22.194897 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:54:22.194819    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/260ca545-8921-41c9-bd37-4371e1027b3d-proxy-tls podName:260ca545-8921-41c9-bd37-4371e1027b3d nodeName:}" failed. No retries permitted until 2026-09-17 18:54:22.694799184 +0000 UTC m=+913.766759190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/260ca545-8921-41c9-bd37-4371e1027b3d-proxy-tls") pod "error-404-isvc-887e9-predictor-5968877ff5-9hz8j" (UID: "260ca545-8921-41c9-bd37-4371e1027b3d") : secret "error-404-isvc-887e9-predictor-serving-cert" not found
Sep 17 18:54:22.195345 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.195323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/260ca545-8921-41c9-bd37-4371e1027b3d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.226923 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.226897    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbz7r\" (UniqueName: \"kubernetes.io/projected/260ca545-8921-41c9-bd37-4371e1027b3d-kube-api-access-wbz7r\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.699953 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.699906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/260ca545-8921-41c9-bd37-4371e1027b3d-proxy-tls\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.702380 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.702350    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/260ca545-8921-41c9-bd37-4371e1027b3d-proxy-tls\") pod \"error-404-isvc-887e9-predictor-5968877ff5-9hz8j\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") " pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:22.935711 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:22.935672    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:23.204434 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:23.204400    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"]
Sep 17 18:54:23.206887 ip-10-0-135-229 kubenswrapper[2575]: W0917 18:54:23.206854    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260ca545_8921_41c9_bd37_4371e1027b3d.slice/crio-926cd129bfb17f4ba2e6afd52fd8ec15424b5c613620f51dc012a273c1e2d8d6 WatchSource:0}: Error finding container 926cd129bfb17f4ba2e6afd52fd8ec15424b5c613620f51dc012a273c1e2d8d6: Status 404 returned error can't find the container with id 926cd129bfb17f4ba2e6afd52fd8ec15424b5c613620f51dc012a273c1e2d8d6
Sep 17 18:54:23.946079 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:23.946050    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 18:54:24.144528 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:24.144493    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" event={"ID":"260ca545-8921-41c9-bd37-4371e1027b3d","Type":"ContainerStarted","Data":"863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76"}
Sep 17 18:54:24.144704 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:24.144550    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" event={"ID":"260ca545-8921-41c9-bd37-4371e1027b3d","Type":"ContainerStarted","Data":"9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120"}
Sep 17 18:54:24.144704 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:24.144570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" event={"ID":"260ca545-8921-41c9-bd37-4371e1027b3d","Type":"ContainerStarted","Data":"926cd129bfb17f4ba2e6afd52fd8ec15424b5c613620f51dc012a273c1e2d8d6"}
Sep 17 18:54:24.144704 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:24.144670    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:24.164821 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:24.164773    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" podStartSLOduration=2.164759514 podStartE2EDuration="2.164759514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:54:24.16333329 +0000 UTC m=+915.235293319" watchObservedRunningTime="2026-09-17 18:54:24.164759514 +0000 UTC m=+915.236719583"
Sep 17 18:54:25.148849 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:25.148820    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:25.150362 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:25.150332    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Sep 17 18:54:25.984164 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:25.984141    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:54:26.028038 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.028004    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d58q2\" (UniqueName: \"kubernetes.io/projected/618365a2-bc6f-4f35-9f00-5195628993af-kube-api-access-d58q2\") pod \"618365a2-bc6f-4f35-9f00-5195628993af\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") "
Sep 17 18:54:26.028215 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.028054    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618365a2-bc6f-4f35-9f00-5195628993af-kserve-provision-location\") pod \"618365a2-bc6f-4f35-9f00-5195628993af\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") "
Sep 17 18:54:26.028215 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.028176    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-cabundle-cert\") pod \"618365a2-bc6f-4f35-9f00-5195628993af\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") "
Sep 17 18:54:26.028369 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.028239    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618365a2-bc6f-4f35-9f00-5195628993af-proxy-tls\") pod \"618365a2-bc6f-4f35-9f00-5195628993af\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") "
Sep 17 18:54:26.028369 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.028291    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-kube-rbac-proxy-sar-config\") pod \"618365a2-bc6f-4f35-9f00-5195628993af\" (UID: \"618365a2-bc6f-4f35-9f00-5195628993af\") "
Sep 17 18:54:26.028479 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.028449    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/618365a2-bc6f-4f35-9f00-5195628993af-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "618365a2-bc6f-4f35-9f00-5195628993af" (UID: "618365a2-bc6f-4f35-9f00-5195628993af"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:54:26.028704 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.028683    2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618365a2-bc6f-4f35-9f00-5195628993af-kserve-provision-location\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:54:26.028836 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.028724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "618365a2-bc6f-4f35-9f00-5195628993af" (UID: "618365a2-bc6f-4f35-9f00-5195628993af"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:54:26.028836 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.028766    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "618365a2-bc6f-4f35-9f00-5195628993af" (UID: "618365a2-bc6f-4f35-9f00-5195628993af"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:54:26.030488 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.030463    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/618365a2-bc6f-4f35-9f00-5195628993af-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "618365a2-bc6f-4f35-9f00-5195628993af" (UID: "618365a2-bc6f-4f35-9f00-5195628993af"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:54:26.030749 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.030725    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/618365a2-bc6f-4f35-9f00-5195628993af-kube-api-access-d58q2" (OuterVolumeSpecName: "kube-api-access-d58q2") pod "618365a2-bc6f-4f35-9f00-5195628993af" (UID: "618365a2-bc6f-4f35-9f00-5195628993af"). InnerVolumeSpecName "kube-api-access-d58q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:54:26.129519 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.129431    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d58q2\" (UniqueName: \"kubernetes.io/projected/618365a2-bc6f-4f35-9f00-5195628993af-kube-api-access-d58q2\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:54:26.129519 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.129470    2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-cabundle-cert\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:54:26.129519 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.129481    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618365a2-bc6f-4f35-9f00-5195628993af-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:54:26.129519 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.129489    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618365a2-bc6f-4f35-9f00-5195628993af-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 18:54:26.156343 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.156305    2575 generic.go:356] "Generic (PLEG): container finished" podID="618365a2-bc6f-4f35-9f00-5195628993af" containerID="e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87" exitCode=0
Sep 17 18:54:26.156742 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.156373    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"
Sep 17 18:54:26.156742 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.156395    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" event={"ID":"618365a2-bc6f-4f35-9f00-5195628993af","Type":"ContainerDied","Data":"e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87"}
Sep 17 18:54:26.156742 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.156465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m" event={"ID":"618365a2-bc6f-4f35-9f00-5195628993af","Type":"ContainerDied","Data":"7b1b709b35f3a2bfc827d7e5dc001605e8d43f7921585570cd4feed4c8923786"}
Sep 17 18:54:26.156742 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.156493    2575 scope.go:117] "RemoveContainer" containerID="753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589"
Sep 17 18:54:26.157158 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.157133    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Sep 17 18:54:26.166580 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.166557    2575 scope.go:117] "RemoveContainer" containerID="e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87"
Sep 17 18:54:26.174271 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.174250    2575 scope.go:117] "RemoveContainer" containerID="9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94"
Sep 17 18:54:26.179776 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.179749    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"]
Sep 17 18:54:26.184020 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.183513    2575 scope.go:117] "RemoveContainer" containerID="753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589"
Sep 17 18:54:26.186421 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.185355    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m"]
Sep 17 18:54:26.190395 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:54:26.190181    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589\": container with ID starting with 753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589 not found: ID does not exist" containerID="753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589"
Sep 17 18:54:26.190503 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.190411    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589"} err="failed to get container status \"753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589\": rpc error: code = NotFound desc = could not find container \"753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589\": container with ID starting with 753899db8aea600da969679b209ac971f0c7fee4fdbfda94e7f13e678d90b589 not found: ID does not exist"
Sep 17 18:54:26.190503 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.190433    2575 scope.go:117] "RemoveContainer" containerID="e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87"
Sep 17 18:54:26.190769 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:54:26.190746    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87\": container with ID starting with e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87 not found: ID does not exist" containerID="e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87"
Sep 17 18:54:26.190821 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.190776    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87"} err="failed to get container status \"e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87\": rpc error: code = NotFound desc = could not find container \"e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87\": container with ID starting with e4ce971d8c8a15436ab3dd4a60cd1cf1edeae9336786a11a8b4ad99ade182e87 not found: ID does not exist"
Sep 17 18:54:26.190821 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.190792    2575 scope.go:117] "RemoveContainer" containerID="9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94"
Sep 17 18:54:26.191085 ip-10-0-135-229 kubenswrapper[2575]: E0917 18:54:26.191063    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94\": container with ID starting with 9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94 not found: ID does not exist" containerID="9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94"
Sep 17 18:54:26.191142 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:26.191093    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94"} err="failed to get container status \"9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94\": rpc error: code = NotFound desc = could not find container \"9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94\": container with ID starting with 9f9989b9588730a15b87eb1261730e5925b1bb9fa06eaec9e1c9dc1143d43f94 not found: ID does not exist"
Sep 17 18:54:27.211760 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:27.211728    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="618365a2-bc6f-4f35-9f00-5195628993af" path="/var/lib/kubelet/pods/618365a2-bc6f-4f35-9f00-5195628993af/volumes"
Sep 17 18:54:31.161888 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:31.161861    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 18:54:31.162287 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:31.162259    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Sep 17 18:54:41.162437 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:41.162397    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Sep 17 18:54:51.162626 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:54:51.162584    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Sep 17 18:55:01.162507 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:55:01.162466    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.33:8080: connect: connection refused"
Sep 17 18:55:11.163340 ip-10-0-135-229 kubenswrapper[2575]: I0917 18:55:11.163311    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 19:02:50.504833 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.504799    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"]
Sep 17 19:02:50.506607 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.505012    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container" containerID="cri-o://8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f" gracePeriod=30
Sep 17 19:02:50.506607 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.505045    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kube-rbac-proxy" containerID="cri-o://dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2" gracePeriod=30
Sep 17 19:02:50.653202 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.653168    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"]
Sep 17 19:02:50.653605 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.653581    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container"
Sep 17 19:02:50.653605 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.653601    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container"
Sep 17 19:02:50.653760 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.653632    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kube-rbac-proxy"
Sep 17 19:02:50.653760 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.653640    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kube-rbac-proxy"
Sep 17 19:02:50.653760 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.653653    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="storage-initializer"
Sep 17 19:02:50.653760 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.653661    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="storage-initializer"
Sep 17 19:02:50.653760 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.653740    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kube-rbac-proxy"
Sep 17 19:02:50.653760 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.653759    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="618365a2-bc6f-4f35-9f00-5195628993af" containerName="kserve-container"
Sep 17 19:02:50.656061 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.656041    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.659873 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.659851    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-4f962-predictor-serving-cert\""
Sep 17 19:02:50.659970 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.659892    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-4f962-kube-rbac-proxy-sar-config\""
Sep 17 19:02:50.671420 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.671401    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"]
Sep 17 19:02:50.682802 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.682775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/82a076f7-389e-45d0-8bba-7bba5a7b6794-proxy-tls\") pod \"error-404-isvc-4f962-predictor-59c67d446c-fhfht\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") " pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.682918 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.682819    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tfrp\" (UniqueName: \"kubernetes.io/projected/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-api-access-5tfrp\") pod \"error-404-isvc-4f962-predictor-59c67d446c-fhfht\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") " pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.682918 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.682891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-4f962-predictor-59c67d446c-fhfht\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") " pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.784388 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.784289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-4f962-predictor-59c67d446c-fhfht\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") " pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.784388 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.784382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/82a076f7-389e-45d0-8bba-7bba5a7b6794-proxy-tls\") pod \"error-404-isvc-4f962-predictor-59c67d446c-fhfht\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") " pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.784585 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.784415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfrp\" (UniqueName: \"kubernetes.io/projected/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-api-access-5tfrp\") pod \"error-404-isvc-4f962-predictor-59c67d446c-fhfht\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") " pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.784954 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.784933    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-4f962-predictor-59c67d446c-fhfht\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") " pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.786776 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.786756    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/82a076f7-389e-45d0-8bba-7bba5a7b6794-proxy-tls\") pod \"error-404-isvc-4f962-predictor-59c67d446c-fhfht\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") " pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.794939 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.794916    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfrp\" (UniqueName: \"kubernetes.io/projected/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-api-access-5tfrp\") pod \"error-404-isvc-4f962-predictor-59c67d446c-fhfht\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") " pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:50.965808 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:50.965755    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:51.240402 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:51.240244    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"]
Sep 17 19:02:51.243115 ip-10-0-135-229 kubenswrapper[2575]: W0917 19:02:51.243092    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a076f7_389e_45d0_8bba_7bba5a7b6794.slice/crio-28fe7e90fe74f5422192bd7a5750ed7c7c4c9e390d3232c38c9c8cd63e2fe7bf WatchSource:0}: Error finding container 28fe7e90fe74f5422192bd7a5750ed7c7c4c9e390d3232c38c9c8cd63e2fe7bf: Status 404 returned error can't find the container with id 28fe7e90fe74f5422192bd7a5750ed7c7c4c9e390d3232c38c9c8cd63e2fe7bf
Sep 17 19:02:51.312190 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:51.312169    2575 generic.go:356] "Generic (PLEG): container finished" podID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerID="dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2" exitCode=2
Sep 17 19:02:51.312279 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:51.312237    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" event={"ID":"1c54394c-37f9-43f7-bf87-c9115c441e61","Type":"ContainerDied","Data":"dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2"}
Sep 17 19:02:51.313856 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:51.313820    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" event={"ID":"82a076f7-389e-45d0-8bba-7bba5a7b6794","Type":"ContainerStarted","Data":"e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b"}
Sep 17 19:02:51.313927 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:51.313890    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" event={"ID":"82a076f7-389e-45d0-8bba-7bba5a7b6794","Type":"ContainerStarted","Data":"28fe7e90fe74f5422192bd7a5750ed7c7c4c9e390d3232c38c9c8cd63e2fe7bf"}
Sep 17 19:02:52.319611 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:52.319577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" event={"ID":"82a076f7-389e-45d0-8bba-7bba5a7b6794","Type":"ContainerStarted","Data":"3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6"}
Sep 17 19:02:52.320090 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:52.319649    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:52.320090 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:52.319681    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:52.321103 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:52.321076    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Sep 17 19:02:52.346952 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:52.346902    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podStartSLOduration=2.346887348 podStartE2EDuration="2.346887348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:02:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:02:52.343750499 +0000 UTC m=+1423.415710527" watchObservedRunningTime="2026-09-17 19:02:52.346887348 +0000 UTC m=+1423.418847376"
Sep 17 19:02:53.324180 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.324140    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Sep 17 19:02:53.741010 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.740985    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 19:02:53.811689 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.811662    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c54394c-37f9-43f7-bf87-c9115c441e61-proxy-tls\") pod \"1c54394c-37f9-43f7-bf87-c9115c441e61\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") "
Sep 17 19:02:53.811871 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.811734    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvcjk\" (UniqueName: \"kubernetes.io/projected/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-api-access-pvcjk\") pod \"1c54394c-37f9-43f7-bf87-c9115c441e61\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") "
Sep 17 19:02:53.811871 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.811810    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-rbac-proxy-sar-config\") pod \"1c54394c-37f9-43f7-bf87-c9115c441e61\" (UID: \"1c54394c-37f9-43f7-bf87-c9115c441e61\") "
Sep 17 19:02:53.812215 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.812181    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "1c54394c-37f9-43f7-bf87-c9115c441e61" (UID: "1c54394c-37f9-43f7-bf87-c9115c441e61"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:02:53.813894 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.813866    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c54394c-37f9-43f7-bf87-c9115c441e61-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1c54394c-37f9-43f7-bf87-c9115c441e61" (UID: "1c54394c-37f9-43f7-bf87-c9115c441e61"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:02:53.813894 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.813867    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-api-access-pvcjk" (OuterVolumeSpecName: "kube-api-access-pvcjk") pod "1c54394c-37f9-43f7-bf87-c9115c441e61" (UID: "1c54394c-37f9-43f7-bf87-c9115c441e61"). InnerVolumeSpecName "kube-api-access-pvcjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:02:53.913480 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.913408    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvcjk\" (UniqueName: \"kubernetes.io/projected/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-api-access-pvcjk\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:02:53.913480 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.913435    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/1c54394c-37f9-43f7-bf87-c9115c441e61-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:02:53.913480 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:53.913445    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1c54394c-37f9-43f7-bf87-c9115c441e61-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:02:54.329626 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.329587    2575 generic.go:356] "Generic (PLEG): container finished" podID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerID="8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f" exitCode=0
Sep 17 19:02:54.330088 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.329635    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"
Sep 17 19:02:54.330088 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.329672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" event={"ID":"1c54394c-37f9-43f7-bf87-c9115c441e61","Type":"ContainerDied","Data":"8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f"}
Sep 17 19:02:54.330088 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.329730    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr" event={"ID":"1c54394c-37f9-43f7-bf87-c9115c441e61","Type":"ContainerDied","Data":"06e7f486b111a3735802a9377d6d173ed956c3d6a2b4f221f62322d24464df57"}
Sep 17 19:02:54.330088 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.329758    2575 scope.go:117] "RemoveContainer" containerID="dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2"
Sep 17 19:02:54.338741 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.338722    2575 scope.go:117] "RemoveContainer" containerID="8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f"
Sep 17 19:02:54.346025 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.346006    2575 scope.go:117] "RemoveContainer" containerID="dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2"
Sep 17 19:02:54.346269 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:02:54.346252    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2\": container with ID starting with dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2 not found: ID does not exist" containerID="dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2"
Sep 17 19:02:54.346344 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.346277    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2"} err="failed to get container status \"dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2\": rpc error: code = NotFound desc = could not find container \"dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2\": container with ID starting with dada08c16c91087682ad78a301f3277c5c82a2cbf74df724cfcf0c9954df88f2 not found: ID does not exist"
Sep 17 19:02:54.346344 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.346310    2575 scope.go:117] "RemoveContainer" containerID="8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f"
Sep 17 19:02:54.346577 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:02:54.346560    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f\": container with ID starting with 8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f not found: ID does not exist" containerID="8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f"
Sep 17 19:02:54.346625 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.346584    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f"} err="failed to get container status \"8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f\": rpc error: code = NotFound desc = could not find container \"8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f\": container with ID starting with 8d58b9d9242e5941cf1e470100a34c3bd62cc133266deb4f6e1a0d4389b9973f not found: ID does not exist"
Sep 17 19:02:54.353959 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.353939    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"]
Sep 17 19:02:54.361883 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:54.361862    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr"]
Sep 17 19:02:55.211616 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:55.211580    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" path="/var/lib/kubelet/pods/1c54394c-37f9-43f7-bf87-c9115c441e61/volumes"
Sep 17 19:02:58.329165 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:58.329134    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:02:58.329702 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:02:58.329639    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Sep 17 19:03:08.329670 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:08.329624    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Sep 17 19:03:18.330596 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:18.330551    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Sep 17 19:03:28.329649 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:28.329609    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.34:8080: connect: connection refused"
Sep 17 19:03:36.524913 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.524876    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"]
Sep 17 19:03:36.525783 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.525728    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container" containerID="cri-o://9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120" gracePeriod=30
Sep 17 19:03:36.526655 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.526621    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kube-rbac-proxy" containerID="cri-o://863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76" gracePeriod=30
Sep 17 19:03:36.805055 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.804978    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"]
Sep 17 19:03:36.805346 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.805333    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kube-rbac-proxy"
Sep 17 19:03:36.805398 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.805347    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kube-rbac-proxy"
Sep 17 19:03:36.805398 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.805357    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container"
Sep 17 19:03:36.805398 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.805363    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container"
Sep 17 19:03:36.805489 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.805411    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kube-rbac-proxy"
Sep 17 19:03:36.805489 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.805425    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c54394c-37f9-43f7-bf87-c9115c441e61" containerName="kserve-container"
Sep 17 19:03:36.808435 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.808418    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:36.811857 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.811820    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-5af63-predictor-serving-cert\""
Sep 17 19:03:36.811988 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.811910    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-5af63-kube-rbac-proxy-sar-config\""
Sep 17 19:03:36.821343 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.821320    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"]
Sep 17 19:03:36.879998 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.879968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5af63-predictor-5659c95479-447vt\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") " pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:36.880169 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.880033    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfwkl\" (UniqueName: \"kubernetes.io/projected/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-api-access-qfwkl\") pod \"error-404-isvc-5af63-predictor-5659c95479-447vt\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") " pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:36.880169 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.880059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/270b189a-7957-4fbe-9493-d3c7caa81f38-proxy-tls\") pod \"error-404-isvc-5af63-predictor-5659c95479-447vt\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") " pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:36.980552 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.980443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5af63-predictor-5659c95479-447vt\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") " pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:36.980703 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.980634    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfwkl\" (UniqueName: \"kubernetes.io/projected/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-api-access-qfwkl\") pod \"error-404-isvc-5af63-predictor-5659c95479-447vt\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") " pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:36.980703 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.980675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/270b189a-7957-4fbe-9493-d3c7caa81f38-proxy-tls\") pod \"error-404-isvc-5af63-predictor-5659c95479-447vt\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") " pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:36.981171 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.981151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5af63-predictor-5659c95479-447vt\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") " pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:36.983117 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.983099    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/270b189a-7957-4fbe-9493-d3c7caa81f38-proxy-tls\") pod \"error-404-isvc-5af63-predictor-5659c95479-447vt\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") " pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:36.990207 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:36.990183    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfwkl\" (UniqueName: \"kubernetes.io/projected/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-api-access-qfwkl\") pod \"error-404-isvc-5af63-predictor-5659c95479-447vt\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") " pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:37.118152 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:37.118065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:37.400273 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:37.400190    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"]
Sep 17 19:03:37.403711 ip-10-0-135-229 kubenswrapper[2575]: W0917 19:03:37.403679    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270b189a_7957_4fbe_9493_d3c7caa81f38.slice/crio-b5a6c06fe798c8ce2a52b26db0f8fa45708ece64df7ab3709c2696e539e173ca WatchSource:0}: Error finding container b5a6c06fe798c8ce2a52b26db0f8fa45708ece64df7ab3709c2696e539e173ca: Status 404 returned error can't find the container with id b5a6c06fe798c8ce2a52b26db0f8fa45708ece64df7ab3709c2696e539e173ca
Sep 17 19:03:37.515371 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:37.515333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" event={"ID":"270b189a-7957-4fbe-9493-d3c7caa81f38","Type":"ContainerStarted","Data":"7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97"}
Sep 17 19:03:37.515522 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:37.515405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" event={"ID":"270b189a-7957-4fbe-9493-d3c7caa81f38","Type":"ContainerStarted","Data":"b5a6c06fe798c8ce2a52b26db0f8fa45708ece64df7ab3709c2696e539e173ca"}
Sep 17 19:03:37.517342 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:37.517315    2575 generic.go:356] "Generic (PLEG): container finished" podID="260ca545-8921-41c9-bd37-4371e1027b3d" containerID="863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76" exitCode=2
Sep 17 19:03:37.517342 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:37.517326    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" event={"ID":"260ca545-8921-41c9-bd37-4371e1027b3d","Type":"ContainerDied","Data":"863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76"}
Sep 17 19:03:38.330474 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:38.330444    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:03:38.524194 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:38.524160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" event={"ID":"270b189a-7957-4fbe-9493-d3c7caa81f38","Type":"ContainerStarted","Data":"4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e"}
Sep 17 19:03:38.524386 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:38.524311    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:38.563701 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:38.563649    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" podStartSLOduration=2.563629057 podStartE2EDuration="2.563629057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:03:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:03:38.562165734 +0000 UTC m=+1469.634125761" watchObservedRunningTime="2026-09-17 19:03:38.563629057 +0000 UTC m=+1469.635589085"
Sep 17 19:03:39.528602 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.528565    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:39.530020 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.529992    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 17 19:03:39.770224 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.770201    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 19:03:39.803541 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.803472    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbz7r\" (UniqueName: \"kubernetes.io/projected/260ca545-8921-41c9-bd37-4371e1027b3d-kube-api-access-wbz7r\") pod \"260ca545-8921-41c9-bd37-4371e1027b3d\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") "
Sep 17 19:03:39.803655 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.803570    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/260ca545-8921-41c9-bd37-4371e1027b3d-proxy-tls\") pod \"260ca545-8921-41c9-bd37-4371e1027b3d\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") "
Sep 17 19:03:39.803655 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.803597    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/260ca545-8921-41c9-bd37-4371e1027b3d-kube-rbac-proxy-sar-config\") pod \"260ca545-8921-41c9-bd37-4371e1027b3d\" (UID: \"260ca545-8921-41c9-bd37-4371e1027b3d\") "
Sep 17 19:03:39.803972 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.803947    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/260ca545-8921-41c9-bd37-4371e1027b3d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "260ca545-8921-41c9-bd37-4371e1027b3d" (UID: "260ca545-8921-41c9-bd37-4371e1027b3d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:03:39.805671 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.805652    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/260ca545-8921-41c9-bd37-4371e1027b3d-kube-api-access-wbz7r" (OuterVolumeSpecName: "kube-api-access-wbz7r") pod "260ca545-8921-41c9-bd37-4371e1027b3d" (UID: "260ca545-8921-41c9-bd37-4371e1027b3d"). InnerVolumeSpecName "kube-api-access-wbz7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:03:39.805752 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.805680    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/260ca545-8921-41c9-bd37-4371e1027b3d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "260ca545-8921-41c9-bd37-4371e1027b3d" (UID: "260ca545-8921-41c9-bd37-4371e1027b3d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:03:39.904506 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.904476    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/260ca545-8921-41c9-bd37-4371e1027b3d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:03:39.904506 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.904501    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbz7r\" (UniqueName: \"kubernetes.io/projected/260ca545-8921-41c9-bd37-4371e1027b3d-kube-api-access-wbz7r\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:03:39.904506 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:39.904512    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/260ca545-8921-41c9-bd37-4371e1027b3d-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:03:40.534801 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.534764    2575 generic.go:356] "Generic (PLEG): container finished" podID="260ca545-8921-41c9-bd37-4371e1027b3d" containerID="9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120" exitCode=0
Sep 17 19:03:40.535198 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.534815    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"
Sep 17 19:03:40.535198 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.534813    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" event={"ID":"260ca545-8921-41c9-bd37-4371e1027b3d","Type":"ContainerDied","Data":"9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120"}
Sep 17 19:03:40.535198 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.534949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j" event={"ID":"260ca545-8921-41c9-bd37-4371e1027b3d","Type":"ContainerDied","Data":"926cd129bfb17f4ba2e6afd52fd8ec15424b5c613620f51dc012a273c1e2d8d6"}
Sep 17 19:03:40.535198 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.534985    2575 scope.go:117] "RemoveContainer" containerID="863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76"
Sep 17 19:03:40.535625 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.535595    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 17 19:03:40.546899 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.546876    2575 scope.go:117] "RemoveContainer" containerID="9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120"
Sep 17 19:03:40.556066 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.556046    2575 scope.go:117] "RemoveContainer" containerID="863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76"
Sep 17 19:03:40.556428 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:03:40.556405    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76\": container with ID starting with 863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76 not found: ID does not exist" containerID="863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76"
Sep 17 19:03:40.556489 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.556443    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76"} err="failed to get container status \"863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76\": rpc error: code = NotFound desc = could not find container \"863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76\": container with ID starting with 863996dc1c02e0e2272ac8683b56c1a8d09b328dc2f93a06a4346345b838ea76 not found: ID does not exist"
Sep 17 19:03:40.556489 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.556484    2575 scope.go:117] "RemoveContainer" containerID="9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120"
Sep 17 19:03:40.556776 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:03:40.556753    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120\": container with ID starting with 9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120 not found: ID does not exist" containerID="9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120"
Sep 17 19:03:40.556829 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.556784    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120"} err="failed to get container status \"9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120\": rpc error: code = NotFound desc = could not find container \"9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120\": container with ID starting with 9114438fd1023aff3af274e4f07164fe8e0fda89866b79cb7ffde2a9981f4120 not found: ID does not exist"
Sep 17 19:03:40.560810 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.560790    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"]
Sep 17 19:03:40.566818 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:40.566790    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j"]
Sep 17 19:03:41.210890 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:41.210859    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" path="/var/lib/kubelet/pods/260ca545-8921-41c9-bd37-4371e1027b3d/volumes"
Sep 17 19:03:45.540513 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:45.540481    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:03:45.540957 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:45.540888    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 17 19:03:55.541754 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:03:55.541708    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 17 19:04:00.692432 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:00.692400    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"]
Sep 17 19:04:00.692867 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:00.692638    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container" containerID="cri-o://e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b" gracePeriod=30
Sep 17 19:04:00.692867 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:00.692685    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kube-rbac-proxy" containerID="cri-o://3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6" gracePeriod=30
Sep 17 19:04:01.632441 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:01.632386    2575 generic.go:356] "Generic (PLEG): container finished" podID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerID="3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6" exitCode=2
Sep 17 19:04:01.632633 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:01.632446    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" event={"ID":"82a076f7-389e-45d0-8bba-7bba5a7b6794","Type":"ContainerDied","Data":"3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6"}
Sep 17 19:04:03.304088 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.304054    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"]
Sep 17 19:04:03.304474 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.304415    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kube-rbac-proxy"
Sep 17 19:04:03.304474 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.304427    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kube-rbac-proxy"
Sep 17 19:04:03.304474 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.304436    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container"
Sep 17 19:04:03.304474 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.304441    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container"
Sep 17 19:04:03.304611 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.304492    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kserve-container"
Sep 17 19:04:03.304611 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.304500    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="260ca545-8921-41c9-bd37-4371e1027b3d" containerName="kube-rbac-proxy"
Sep 17 19:04:03.307579 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.307565    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:03.324963 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.324934    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.34:8643/healthz\": dial tcp 10.134.0.34:8643: connect: connection refused"
Sep 17 19:04:03.330377 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:03.330341    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"error-404-isvc-bd292-predictor-serving-cert\" is forbidden: User \"system:node:ip-10-0-135-229.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-135-229.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-bd292-predictor-serving-cert\"" type="*v1.Secret"
Sep 17 19:04:03.330523 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:03.330406    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" is forbidden: User \"system:node:ip-10-0-135-229.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-135-229.ec2.internal' and this object" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:03.330736 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:03.330714    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"error-404-isvc-bd292-kube-rbac-proxy-sar-config\" is forbidden: User \"system:node:ip-10-0-135-229.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kserve-ci-e2e-test\": no relationship found between node 'ip-10-0-135-229.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-bd292-kube-rbac-proxy-sar-config\"" type="*v1.ConfigMap"
Sep 17 19:04:03.405207 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.405173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7a24cfc-682f-4d0d-86ad-af979d986ef3-proxy-tls\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:03.405391 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.405266    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m29l6\" (UniqueName: \"kubernetes.io/projected/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-api-access-m29l6\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:03.405391 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.405347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:03.406737 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.406711    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"]
Sep 17 19:04:03.506030 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.505997    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7a24cfc-682f-4d0d-86ad-af979d986ef3-proxy-tls\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:03.506203 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.506038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m29l6\" (UniqueName: \"kubernetes.io/projected/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-api-access-m29l6\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:03.506203 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.506069    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:03.517682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.517648    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m29l6\" (UniqueName: \"kubernetes.io/projected/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-api-access-m29l6\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:03.939350 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:03.939326    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:04:04.009551 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.009470    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/82a076f7-389e-45d0-8bba-7bba5a7b6794-proxy-tls\") pod \"82a076f7-389e-45d0-8bba-7bba5a7b6794\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") "
Sep 17 19:04:04.009705 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.009569    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tfrp\" (UniqueName: \"kubernetes.io/projected/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-api-access-5tfrp\") pod \"82a076f7-389e-45d0-8bba-7bba5a7b6794\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") "
Sep 17 19:04:04.009705 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.009614    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-rbac-proxy-sar-config\") pod \"82a076f7-389e-45d0-8bba-7bba5a7b6794\" (UID: \"82a076f7-389e-45d0-8bba-7bba5a7b6794\") "
Sep 17 19:04:04.010156 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.010122    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "82a076f7-389e-45d0-8bba-7bba5a7b6794" (UID: "82a076f7-389e-45d0-8bba-7bba5a7b6794"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:04:04.011769 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.011733    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82a076f7-389e-45d0-8bba-7bba5a7b6794-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "82a076f7-389e-45d0-8bba-7bba5a7b6794" (UID: "82a076f7-389e-45d0-8bba-7bba5a7b6794"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:04:04.012226 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.012170    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-api-access-5tfrp" (OuterVolumeSpecName: "kube-api-access-5tfrp") pod "82a076f7-389e-45d0-8bba-7bba5a7b6794" (UID: "82a076f7-389e-45d0-8bba-7bba5a7b6794"). InnerVolumeSpecName "kube-api-access-5tfrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:04:04.110825 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.110787    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:04:04.110825 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.110819    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/82a076f7-389e-45d0-8bba-7bba5a7b6794-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:04:04.110825 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.110830    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tfrp\" (UniqueName: \"kubernetes.io/projected/82a076f7-389e-45d0-8bba-7bba5a7b6794-kube-api-access-5tfrp\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:04:04.506864 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:04.506828    2575 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-bd292-predictor-serving-cert: failed to sync secret cache: timed out waiting for the condition
Sep 17 19:04:04.507359 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:04.506912    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7a24cfc-682f-4d0d-86ad-af979d986ef3-proxy-tls podName:c7a24cfc-682f-4d0d-86ad-af979d986ef3 nodeName:}" failed. No retries permitted until 2026-09-17 19:04:05.00689564 +0000 UTC m=+1496.078855645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c7a24cfc-682f-4d0d-86ad-af979d986ef3-proxy-tls") pod "error-404-isvc-bd292-predictor-78cb685867-gd85p" (UID: "c7a24cfc-682f-4d0d-86ad-af979d986ef3") : failed to sync secret cache: timed out waiting for the condition
Sep 17 19:04:04.507359 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:04.506831    2575 configmap.go:193] Couldn't get configMap kserve-ci-e2e-test/error-404-isvc-bd292-kube-rbac-proxy-sar-config: failed to sync configmap cache: timed out waiting for the condition
Sep 17 19:04:04.507359 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:04.506979    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-rbac-proxy-sar-config podName:c7a24cfc-682f-4d0d-86ad-af979d986ef3 nodeName:}" failed. No retries permitted until 2026-09-17 19:04:05.006965215 +0000 UTC m=+1496.078925221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-sar-config" (UniqueName: "kubernetes.io/configmap/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-rbac-proxy-sar-config") pod "error-404-isvc-bd292-predictor-78cb685867-gd85p" (UID: "c7a24cfc-682f-4d0d-86ad-af979d986ef3") : failed to sync configmap cache: timed out waiting for the condition
Sep 17 19:04:04.646610 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.646579    2575 generic.go:356] "Generic (PLEG): container finished" podID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerID="e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b" exitCode=0
Sep 17 19:04:04.646771 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.646624    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"
Sep 17 19:04:04.646771 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.646633    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" event={"ID":"82a076f7-389e-45d0-8bba-7bba5a7b6794","Type":"ContainerDied","Data":"e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b"}
Sep 17 19:04:04.646771 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.646681    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht" event={"ID":"82a076f7-389e-45d0-8bba-7bba5a7b6794","Type":"ContainerDied","Data":"28fe7e90fe74f5422192bd7a5750ed7c7c4c9e390d3232c38c9c8cd63e2fe7bf"}
Sep 17 19:04:04.646771 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.646706    2575 scope.go:117] "RemoveContainer" containerID="3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6"
Sep 17 19:04:04.648587 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.648567    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-bd292-predictor-serving-cert\""
Sep 17 19:04:04.655201 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.655182    2575 scope.go:117] "RemoveContainer" containerID="e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b"
Sep 17 19:04:04.662177 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.662160    2575 scope.go:117] "RemoveContainer" containerID="3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6"
Sep 17 19:04:04.662461 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:04.662443    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6\": container with ID starting with 3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6 not found: ID does not exist" containerID="3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6"
Sep 17 19:04:04.662541 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.662473    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6"} err="failed to get container status \"3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6\": rpc error: code = NotFound desc = could not find container \"3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6\": container with ID starting with 3b044256e8951d5a23beff2c2791ffe4765b39c77fccb30f721304f5eca272b6 not found: ID does not exist"
Sep 17 19:04:04.662541 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.662496    2575 scope.go:117] "RemoveContainer" containerID="e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b"
Sep 17 19:04:04.662777 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:04.662758    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b\": container with ID starting with e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b not found: ID does not exist" containerID="e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b"
Sep 17 19:04:04.662818 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.662785    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b"} err="failed to get container status \"e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b\": rpc error: code = NotFound desc = could not find container \"e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b\": container with ID starting with e4840379bd5e3826f6dac92b8a809fc48b4f98f53f1cb939d7792dde31dcf43b not found: ID does not exist"
Sep 17 19:04:04.679393 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.679369    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"]
Sep 17 19:04:04.690123 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.690101    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht"]
Sep 17 19:04:04.848827 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:04.848745    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-bd292-kube-rbac-proxy-sar-config\""
Sep 17 19:04:05.019093 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.019061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7a24cfc-682f-4d0d-86ad-af979d986ef3-proxy-tls\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:05.019323 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.019113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:05.019796 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.019776    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:05.021505 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.021478    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7a24cfc-682f-4d0d-86ad-af979d986ef3-proxy-tls\") pod \"error-404-isvc-bd292-predictor-78cb685867-gd85p\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") " pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:05.117719 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.117642    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:05.211422 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.211393    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" path="/var/lib/kubelet/pods/82a076f7-389e-45d0-8bba-7bba5a7b6794/volumes"
Sep 17 19:04:05.409174 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.409096    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"]
Sep 17 19:04:05.412271 ip-10-0-135-229 kubenswrapper[2575]: W0917 19:04:05.412240    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a24cfc_682f_4d0d_86ad_af979d986ef3.slice/crio-c2cc8d74300ba424a25ebb51d9048f608e9826c1b7a7ee465313408e15e8486a WatchSource:0}: Error finding container c2cc8d74300ba424a25ebb51d9048f608e9826c1b7a7ee465313408e15e8486a: Status 404 returned error can't find the container with id c2cc8d74300ba424a25ebb51d9048f608e9826c1b7a7ee465313408e15e8486a
Sep 17 19:04:05.541852 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.541817    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 17 19:04:05.654687 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.654650    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" event={"ID":"c7a24cfc-682f-4d0d-86ad-af979d986ef3","Type":"ContainerStarted","Data":"b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20"}
Sep 17 19:04:05.654840 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.654711    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" event={"ID":"c7a24cfc-682f-4d0d-86ad-af979d986ef3","Type":"ContainerStarted","Data":"e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0"}
Sep 17 19:04:05.654840 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.654744    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:05.654840 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.654770    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" event={"ID":"c7a24cfc-682f-4d0d-86ad-af979d986ef3","Type":"ContainerStarted","Data":"c2cc8d74300ba424a25ebb51d9048f608e9826c1b7a7ee465313408e15e8486a"}
Sep 17 19:04:05.654840 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.654797    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:05.656129 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:05.656100    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 19:04:06.660331 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:06.660277    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 19:04:11.665273 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:11.665197    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:11.665834 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:11.665806    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 19:04:11.686467 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:11.686420    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podStartSLOduration=9.686406217 podStartE2EDuration="9.686406217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:04:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:04:05.722159132 +0000 UTC m=+1496.794119162" watchObservedRunningTime="2026-09-17 19:04:11.686406217 +0000 UTC m=+1502.758366245"
Sep 17 19:04:15.541549 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:15.541508    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 17 19:04:21.666434 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:21.666349    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 19:04:25.541921 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:25.541891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:04:31.666052 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:31.666015    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 19:04:41.666353 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:41.666291    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 17 19:04:46.874188 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:46.874149    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"]
Sep 17 19:04:46.874758 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:46.874594    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container" containerID="cri-o://7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97" gracePeriod=30
Sep 17 19:04:46.874831 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:46.874798    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kube-rbac-proxy" containerID="cri-o://4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e" gracePeriod=30
Sep 17 19:04:47.096429 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.096393    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"]
Sep 17 19:04:47.096729 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.096718    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container"
Sep 17 19:04:47.096776 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.096731    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container"
Sep 17 19:04:47.096776 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.096747    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kube-rbac-proxy"
Sep 17 19:04:47.096776 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.096753    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kube-rbac-proxy"
Sep 17 19:04:47.096876 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.096810    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kserve-container"
Sep 17 19:04:47.096876 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.096820    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a076f7-389e-45d0-8bba-7bba5a7b6794" containerName="kube-rbac-proxy"
Sep 17 19:04:47.099820 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.099805    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.103068 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.103044    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-058d2-kube-rbac-proxy-sar-config\""
Sep 17 19:04:47.103192 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.103044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-058d2-predictor-serving-cert\""
Sep 17 19:04:47.115228 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.115207    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"]
Sep 17 19:04:47.180352 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.180239    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56312303-34c8-41f5-96be-489b7f7ac27f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-058d2-predictor-7df8c9df5f-rprn6\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") " pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.180352 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.180320    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rvt9\" (UniqueName: \"kubernetes.io/projected/56312303-34c8-41f5-96be-489b7f7ac27f-kube-api-access-9rvt9\") pod \"error-404-isvc-058d2-predictor-7df8c9df5f-rprn6\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") " pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.180556 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.180400    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56312303-34c8-41f5-96be-489b7f7ac27f-proxy-tls\") pod \"error-404-isvc-058d2-predictor-7df8c9df5f-rprn6\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") " pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.281574 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.281541    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56312303-34c8-41f5-96be-489b7f7ac27f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-058d2-predictor-7df8c9df5f-rprn6\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") " pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.281761 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.281587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rvt9\" (UniqueName: \"kubernetes.io/projected/56312303-34c8-41f5-96be-489b7f7ac27f-kube-api-access-9rvt9\") pod \"error-404-isvc-058d2-predictor-7df8c9df5f-rprn6\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") " pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.281761 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.281656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56312303-34c8-41f5-96be-489b7f7ac27f-proxy-tls\") pod \"error-404-isvc-058d2-predictor-7df8c9df5f-rprn6\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") " pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.282230 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.282205    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56312303-34c8-41f5-96be-489b7f7ac27f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-058d2-predictor-7df8c9df5f-rprn6\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") " pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.284274 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.284244    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56312303-34c8-41f5-96be-489b7f7ac27f-proxy-tls\") pod \"error-404-isvc-058d2-predictor-7df8c9df5f-rprn6\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") " pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.295683 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.295655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rvt9\" (UniqueName: \"kubernetes.io/projected/56312303-34c8-41f5-96be-489b7f7ac27f-kube-api-access-9rvt9\") pod \"error-404-isvc-058d2-predictor-7df8c9df5f-rprn6\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") " pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.409182 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.409140    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.684946 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.684916    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"]
Sep 17 19:04:47.687325 ip-10-0-135-229 kubenswrapper[2575]: W0917 19:04:47.687275    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56312303_34c8_41f5_96be_489b7f7ac27f.slice/crio-f0f8a71ddffc9932a9b45797fc60811d094f76b7d411bb798574817111de66da WatchSource:0}: Error finding container f0f8a71ddffc9932a9b45797fc60811d094f76b7d411bb798574817111de66da: Status 404 returned error can't find the container with id f0f8a71ddffc9932a9b45797fc60811d094f76b7d411bb798574817111de66da
Sep 17 19:04:47.847224 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.847189    2575 generic.go:356] "Generic (PLEG): container finished" podID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerID="4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e" exitCode=2
Sep 17 19:04:47.847410 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.847261    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" event={"ID":"270b189a-7957-4fbe-9493-d3c7caa81f38","Type":"ContainerDied","Data":"4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e"}
Sep 17 19:04:47.849119 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.849097    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" event={"ID":"56312303-34c8-41f5-96be-489b7f7ac27f","Type":"ContainerStarted","Data":"8ac0f7071af8e04ee7ceaf62a178340f6d698a4aff5d18ffd04255bfe14aeb95"}
Sep 17 19:04:47.849237 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.849141    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" event={"ID":"56312303-34c8-41f5-96be-489b7f7ac27f","Type":"ContainerStarted","Data":"0d5e085d706c9d88de311ac913acfb2247331d9676a032009cf2b94d45365e66"}
Sep 17 19:04:47.849237 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.849161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" event={"ID":"56312303-34c8-41f5-96be-489b7f7ac27f","Type":"ContainerStarted","Data":"f0f8a71ddffc9932a9b45797fc60811d094f76b7d411bb798574817111de66da"}
Sep 17 19:04:47.849363 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.849252    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:47.884155 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:47.884094    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podStartSLOduration=0.884072036 podStartE2EDuration="884.072036ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:04:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:04:47.871326842 +0000 UTC m=+1538.943287080" watchObservedRunningTime="2026-09-17 19:04:47.884072036 +0000 UTC m=+1538.956032065"
Sep 17 19:04:48.853314 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:48.853265    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:48.854639 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:48.854608    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 19:04:49.858243 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:49.858204    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 19:04:50.025087 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.025062    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:04:50.107142 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.107054    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/270b189a-7957-4fbe-9493-d3c7caa81f38-proxy-tls\") pod \"270b189a-7957-4fbe-9493-d3c7caa81f38\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") "
Sep 17 19:04:50.107142 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.107112    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfwkl\" (UniqueName: \"kubernetes.io/projected/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-api-access-qfwkl\") pod \"270b189a-7957-4fbe-9493-d3c7caa81f38\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") "
Sep 17 19:04:50.107365 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.107156    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-rbac-proxy-sar-config\") pod \"270b189a-7957-4fbe-9493-d3c7caa81f38\" (UID: \"270b189a-7957-4fbe-9493-d3c7caa81f38\") "
Sep 17 19:04:50.107576 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.107548    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "270b189a-7957-4fbe-9493-d3c7caa81f38" (UID: "270b189a-7957-4fbe-9493-d3c7caa81f38"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:04:50.109223 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.109196    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-api-access-qfwkl" (OuterVolumeSpecName: "kube-api-access-qfwkl") pod "270b189a-7957-4fbe-9493-d3c7caa81f38" (UID: "270b189a-7957-4fbe-9493-d3c7caa81f38"). InnerVolumeSpecName "kube-api-access-qfwkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:04:50.109329 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.109308    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/270b189a-7957-4fbe-9493-d3c7caa81f38-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "270b189a-7957-4fbe-9493-d3c7caa81f38" (UID: "270b189a-7957-4fbe-9493-d3c7caa81f38"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:04:50.208044 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.208009    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:04:50.208044 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.208034    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/270b189a-7957-4fbe-9493-d3c7caa81f38-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:04:50.208044 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.208044    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfwkl\" (UniqueName: \"kubernetes.io/projected/270b189a-7957-4fbe-9493-d3c7caa81f38-kube-api-access-qfwkl\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:04:50.863356 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.863320    2575 generic.go:356] "Generic (PLEG): container finished" podID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerID="7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97" exitCode=0
Sep 17 19:04:50.863787 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.863364    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"
Sep 17 19:04:50.863787 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.863383    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" event={"ID":"270b189a-7957-4fbe-9493-d3c7caa81f38","Type":"ContainerDied","Data":"7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97"}
Sep 17 19:04:50.863787 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.863432    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt" event={"ID":"270b189a-7957-4fbe-9493-d3c7caa81f38","Type":"ContainerDied","Data":"b5a6c06fe798c8ce2a52b26db0f8fa45708ece64df7ab3709c2696e539e173ca"}
Sep 17 19:04:50.863787 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.863457    2575 scope.go:117] "RemoveContainer" containerID="4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e"
Sep 17 19:04:50.871987 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.871968    2575 scope.go:117] "RemoveContainer" containerID="7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97"
Sep 17 19:04:50.879010 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.878994    2575 scope.go:117] "RemoveContainer" containerID="4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e"
Sep 17 19:04:50.879271 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:50.879254    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e\": container with ID starting with 4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e not found: ID does not exist" containerID="4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e"
Sep 17 19:04:50.879356 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.879279    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e"} err="failed to get container status \"4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e\": rpc error: code = NotFound desc = could not find container \"4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e\": container with ID starting with 4d76ac68ca7ba7d563df3e7a4a6ab82ddbf82f4857c7b554d67e889df1a96f9e not found: ID does not exist"
Sep 17 19:04:50.879356 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.879315    2575 scope.go:117] "RemoveContainer" containerID="7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97"
Sep 17 19:04:50.879618 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:04:50.879594    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97\": container with ID starting with 7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97 not found: ID does not exist" containerID="7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97"
Sep 17 19:04:50.879713 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.879626    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97"} err="failed to get container status \"7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97\": rpc error: code = NotFound desc = could not find container \"7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97\": container with ID starting with 7cda3b2b0df7f9d497b9650684497812a0af888f0aa7f8037b69fab9353f2e97 not found: ID does not exist"
Sep 17 19:04:50.885008 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.884984    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"]
Sep 17 19:04:50.888478 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:50.888460    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt"]
Sep 17 19:04:51.211518 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:51.211486    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" path="/var/lib/kubelet/pods/270b189a-7957-4fbe-9493-d3c7caa81f38/volumes"
Sep 17 19:04:51.667266 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:51.667173    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:04:54.863188 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:54.863160    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:04:54.863754 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:04:54.863654    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 19:05:04.864305 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:05:04.864262    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 19:05:14.864139 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:05:14.864101    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 19:05:24.863694 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:05:24.863646    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 19:05:34.864452 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:05:34.864421    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:13:25.705437 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.705357    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"]
Sep 17 19:13:25.708017 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.705583    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container" containerID="cri-o://e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0" gracePeriod=30
Sep 17 19:13:25.708017 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.705625    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kube-rbac-proxy" containerID="cri-o://b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20" gracePeriod=30
Sep 17 19:13:25.775653 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.775614    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"]
Sep 17 19:13:25.775974 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.775961    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container"
Sep 17 19:13:25.776040 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.775975    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container"
Sep 17 19:13:25.776040 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.775993    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kube-rbac-proxy"
Sep 17 19:13:25.776040 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.775999    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kube-rbac-proxy"
Sep 17 19:13:25.776189 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.776057    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kube-rbac-proxy"
Sep 17 19:13:25.776189 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.776065    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="270b189a-7957-4fbe-9493-d3c7caa81f38" containerName="kserve-container"
Sep 17 19:13:25.785068 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.785038    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:25.787623 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.787592    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-3efeb-predictor-serving-cert\""
Sep 17 19:13:25.787789 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.787647    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-3efeb-kube-rbac-proxy-sar-config\""
Sep 17 19:13:25.789243 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.789218    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"]
Sep 17 19:13:25.922212 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.922176    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4a30d19-a224-46d8-80ca-175c08b4cf4d-proxy-tls\") pod \"error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") " pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:25.922410 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.922220    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") " pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:25.922410 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:25.922246    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56mx4\" (UniqueName: \"kubernetes.io/projected/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-api-access-56mx4\") pod \"error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") " pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:26.023515 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.023417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4a30d19-a224-46d8-80ca-175c08b4cf4d-proxy-tls\") pod \"error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") " pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:26.023515 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.023466    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") " pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:26.023515 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.023490    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56mx4\" (UniqueName: \"kubernetes.io/projected/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-api-access-56mx4\") pod \"error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") " pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:26.024222 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.024200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") " pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:26.026092 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.026060    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4a30d19-a224-46d8-80ca-175c08b4cf4d-proxy-tls\") pod \"error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") " pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:26.032453 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.032429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56mx4\" (UniqueName: \"kubernetes.io/projected/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-api-access-56mx4\") pod \"error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") " pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:26.093317 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.093268    2575 generic.go:356] "Generic (PLEG): container finished" podID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerID="b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20" exitCode=2
Sep 17 19:13:26.093480 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.093344    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" event={"ID":"c7a24cfc-682f-4d0d-86ad-af979d986ef3","Type":"ContainerDied","Data":"b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20"}
Sep 17 19:13:26.096487 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.096468    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:26.366521 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.366498    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"]
Sep 17 19:13:26.369144 ip-10-0-135-229 kubenswrapper[2575]: W0917 19:13:26.369115    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a30d19_a224_46d8_80ca_175c08b4cf4d.slice/crio-aaf3543bef21df9467c7a074e3e63f57c27212c0fd64a3709c5ad45a1eef7edb WatchSource:0}: Error finding container aaf3543bef21df9467c7a074e3e63f57c27212c0fd64a3709c5ad45a1eef7edb: Status 404 returned error can't find the container with id aaf3543bef21df9467c7a074e3e63f57c27212c0fd64a3709c5ad45a1eef7edb
Sep 17 19:13:26.661181 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:26.661091    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Sep 17 19:13:27.099735 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:27.099694    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" event={"ID":"a4a30d19-a224-46d8-80ca-175c08b4cf4d","Type":"ContainerStarted","Data":"962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337"}
Sep 17 19:13:27.100168 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:27.099764    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" event={"ID":"a4a30d19-a224-46d8-80ca-175c08b4cf4d","Type":"ContainerStarted","Data":"612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307"}
Sep 17 19:13:27.100168 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:27.099872    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:27.100168 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:27.099906    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:27.100168 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:27.099933    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" event={"ID":"a4a30d19-a224-46d8-80ca-175c08b4cf4d","Type":"ContainerStarted","Data":"aaf3543bef21df9467c7a074e3e63f57c27212c0fd64a3709c5ad45a1eef7edb"}
Sep 17 19:13:27.101315 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:27.101273    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 19:13:27.119365 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:27.119321    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podStartSLOduration=2.119291457 podStartE2EDuration="2.119291457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:13:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:13:27.118258726 +0000 UTC m=+2058.190218754" watchObservedRunningTime="2026-09-17 19:13:27.119291457 +0000 UTC m=+2058.191251485"
Sep 17 19:13:28.104620 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:28.104577    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 19:13:29.451763 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.451736    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:13:29.554597 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.554501    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m29l6\" (UniqueName: \"kubernetes.io/projected/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-api-access-m29l6\") pod \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") "
Sep 17 19:13:29.554597 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.554545    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-rbac-proxy-sar-config\") pod \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") "
Sep 17 19:13:29.554597 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.554572    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7a24cfc-682f-4d0d-86ad-af979d986ef3-proxy-tls\") pod \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\" (UID: \"c7a24cfc-682f-4d0d-86ad-af979d986ef3\") "
Sep 17 19:13:29.554961 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.554928    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c7a24cfc-682f-4d0d-86ad-af979d986ef3" (UID: "c7a24cfc-682f-4d0d-86ad-af979d986ef3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:13:29.556726 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.556699    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7a24cfc-682f-4d0d-86ad-af979d986ef3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c7a24cfc-682f-4d0d-86ad-af979d986ef3" (UID: "c7a24cfc-682f-4d0d-86ad-af979d986ef3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:13:29.556726 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.556711    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-api-access-m29l6" (OuterVolumeSpecName: "kube-api-access-m29l6") pod "c7a24cfc-682f-4d0d-86ad-af979d986ef3" (UID: "c7a24cfc-682f-4d0d-86ad-af979d986ef3"). InnerVolumeSpecName "kube-api-access-m29l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:13:29.655245 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.655208    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m29l6\" (UniqueName: \"kubernetes.io/projected/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-api-access-m29l6\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:13:29.655245 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.655240    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c7a24cfc-682f-4d0d-86ad-af979d986ef3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:13:29.655245 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:29.655250    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c7a24cfc-682f-4d0d-86ad-af979d986ef3-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:13:30.115092 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.115059    2575 generic.go:356] "Generic (PLEG): container finished" podID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerID="e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0" exitCode=0
Sep 17 19:13:30.115285 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.115111    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"
Sep 17 19:13:30.115285 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.115122    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" event={"ID":"c7a24cfc-682f-4d0d-86ad-af979d986ef3","Type":"ContainerDied","Data":"e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0"}
Sep 17 19:13:30.115285 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.115169    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p" event={"ID":"c7a24cfc-682f-4d0d-86ad-af979d986ef3","Type":"ContainerDied","Data":"c2cc8d74300ba424a25ebb51d9048f608e9826c1b7a7ee465313408e15e8486a"}
Sep 17 19:13:30.115285 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.115195    2575 scope.go:117] "RemoveContainer" containerID="b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20"
Sep 17 19:13:30.133132 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.133111    2575 scope.go:117] "RemoveContainer" containerID="e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0"
Sep 17 19:13:30.140856 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.140836    2575 scope.go:117] "RemoveContainer" containerID="b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20"
Sep 17 19:13:30.141141 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:13:30.141120    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20\": container with ID starting with b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20 not found: ID does not exist" containerID="b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20"
Sep 17 19:13:30.141219 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.141148    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20"} err="failed to get container status \"b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20\": rpc error: code = NotFound desc = could not find container \"b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20\": container with ID starting with b98f4403e724d963d676d32c8f512ec4bc040e854d429c60cf8e3b7ca491dd20 not found: ID does not exist"
Sep 17 19:13:30.141219 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.141167    2575 scope.go:117] "RemoveContainer" containerID="e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0"
Sep 17 19:13:30.141544 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:13:30.141523    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0\": container with ID starting with e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0 not found: ID does not exist" containerID="e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0"
Sep 17 19:13:30.141613 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.141548    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0"} err="failed to get container status \"e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0\": rpc error: code = NotFound desc = could not find container \"e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0\": container with ID starting with e5fdea898c8bf66ca2b2b6eeddb14d3535de22b3305370da3fc49484ae8a0ab0 not found: ID does not exist"
Sep 17 19:13:30.146234 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.146211    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"]
Sep 17 19:13:30.153599 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:30.153579    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p"]
Sep 17 19:13:31.212912 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:31.212875    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" path="/var/lib/kubelet/pods/c7a24cfc-682f-4d0d-86ad-af979d986ef3/volumes"
Sep 17 19:13:33.109311 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:33.109264    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:13:33.109826 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:33.109800    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 19:13:43.110594 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:43.110547    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 19:13:53.109800 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:13:53.109763    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 19:14:01.998847 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:01.998812    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"]
Sep 17 19:14:01.999340 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:01.999061    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container" containerID="cri-o://0d5e085d706c9d88de311ac913acfb2247331d9676a032009cf2b94d45365e66" gracePeriod=30
Sep 17 19:14:01.999340 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:01.999137    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kube-rbac-proxy" containerID="cri-o://8ac0f7071af8e04ee7ceaf62a178340f6d698a4aff5d18ffd04255bfe14aeb95" gracePeriod=30
Sep 17 19:14:02.235524 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.235481    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"]
Sep 17 19:14:02.235848 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.235834    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container"
Sep 17 19:14:02.235902 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.235849    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container"
Sep 17 19:14:02.235902 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.235872    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kube-rbac-proxy"
Sep 17 19:14:02.235902 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.235877    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kube-rbac-proxy"
Sep 17 19:14:02.236001 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.235932    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kserve-container"
Sep 17 19:14:02.236001 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.235939    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a24cfc-682f-4d0d-86ad-af979d986ef3" containerName="kube-rbac-proxy"
Sep 17 19:14:02.238970 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.238953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.241426 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.241407    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-e2192-predictor-serving-cert\""
Sep 17 19:14:02.241426 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.241423    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-e2192-kube-rbac-proxy-sar-config\""
Sep 17 19:14:02.251958 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.251879    2575 generic.go:356] "Generic (PLEG): container finished" podID="56312303-34c8-41f5-96be-489b7f7ac27f" containerID="8ac0f7071af8e04ee7ceaf62a178340f6d698a4aff5d18ffd04255bfe14aeb95" exitCode=2
Sep 17 19:14:02.252082 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.251946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" event={"ID":"56312303-34c8-41f5-96be-489b7f7ac27f","Type":"ContainerDied","Data":"8ac0f7071af8e04ee7ceaf62a178340f6d698a4aff5d18ffd04255bfe14aeb95"}
Sep 17 19:14:02.253290 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.253269    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"]
Sep 17 19:14:02.336494 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.336455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvdqk\" (UniqueName: \"kubernetes.io/projected/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-api-access-nvdqk\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.336701 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.336518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/150a7fd2-abf9-4276-a04d-84fb869199d9-proxy-tls\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.336701 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.336601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.437969 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.437925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/150a7fd2-abf9-4276-a04d-84fb869199d9-proxy-tls\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.438170 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.437978    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.438170 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.438045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvdqk\" (UniqueName: \"kubernetes.io/projected/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-api-access-nvdqk\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.438170 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:14:02.438091    2575 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-e2192-predictor-serving-cert: secret "error-404-isvc-e2192-predictor-serving-cert" not found
Sep 17 19:14:02.438170 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:14:02.438157    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/150a7fd2-abf9-4276-a04d-84fb869199d9-proxy-tls podName:150a7fd2-abf9-4276-a04d-84fb869199d9 nodeName:}" failed. No retries permitted until 2026-09-17 19:14:02.93814226 +0000 UTC m=+2094.010102280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/150a7fd2-abf9-4276-a04d-84fb869199d9-proxy-tls") pod "error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" (UID: "150a7fd2-abf9-4276-a04d-84fb869199d9") : secret "error-404-isvc-e2192-predictor-serving-cert" not found
Sep 17 19:14:02.438721 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.438697    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.447630 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.447603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvdqk\" (UniqueName: \"kubernetes.io/projected/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-api-access-nvdqk\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.942323 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.942248    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/150a7fd2-abf9-4276-a04d-84fb869199d9-proxy-tls\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:02.944802 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:02.944767    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/150a7fd2-abf9-4276-a04d-84fb869199d9-proxy-tls\") pod \"error-404-isvc-e2192-predictor-74c95f44b7-ndfvf\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") " pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:03.109890 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:03.109851    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 17 19:14:03.148996 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:03.148953    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:03.421776 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:03.421698    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"]
Sep 17 19:14:03.424720 ip-10-0-135-229 kubenswrapper[2575]: W0917 19:14:03.424688    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150a7fd2_abf9_4276_a04d_84fb869199d9.slice/crio-c49463732b0d93312992756235dbb1c8427a3578ef191302ce96fc7cdb91c050 WatchSource:0}: Error finding container c49463732b0d93312992756235dbb1c8427a3578ef191302ce96fc7cdb91c050: Status 404 returned error can't find the container with id c49463732b0d93312992756235dbb1c8427a3578ef191302ce96fc7cdb91c050
Sep 17 19:14:04.264645 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:04.264604    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" event={"ID":"150a7fd2-abf9-4276-a04d-84fb869199d9","Type":"ContainerStarted","Data":"4c9bb3730e984506b7ebff2fce9151d73e6663de6308d577ee72bf60a17e5ec9"}
Sep 17 19:14:04.265084 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:04.264694    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" event={"ID":"150a7fd2-abf9-4276-a04d-84fb869199d9","Type":"ContainerStarted","Data":"a6963c9dbf6972e2d163051a800a4ed7483fc278dbeeac473415878ad3c1b805"}
Sep 17 19:14:04.265084 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:04.264721    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" event={"ID":"150a7fd2-abf9-4276-a04d-84fb869199d9","Type":"ContainerStarted","Data":"c49463732b0d93312992756235dbb1c8427a3578ef191302ce96fc7cdb91c050"}
Sep 17 19:14:04.265084 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:04.264746    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:04.265084 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:04.264780    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:04.266158 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:04.266132    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 17 19:14:04.284085 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:04.284028    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" podStartSLOduration=2.284011204 podStartE2EDuration="2.284011204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:14:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:14:04.282602446 +0000 UTC m=+2095.354562509" watchObservedRunningTime="2026-09-17 19:14:04.284011204 +0000 UTC m=+2095.355971232"
Sep 17 19:14:04.859500 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:04.859455    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.37:8643/healthz\": dial tcp 10.134.0.37:8643: connect: connection refused"
Sep 17 19:14:04.863901 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:04.863878    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 17 19:14:05.272059 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.272029    2575 generic.go:356] "Generic (PLEG): container finished" podID="56312303-34c8-41f5-96be-489b7f7ac27f" containerID="0d5e085d706c9d88de311ac913acfb2247331d9676a032009cf2b94d45365e66" exitCode=0
Sep 17 19:14:05.272438 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.272105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" event={"ID":"56312303-34c8-41f5-96be-489b7f7ac27f","Type":"ContainerDied","Data":"0d5e085d706c9d88de311ac913acfb2247331d9676a032009cf2b94d45365e66"}
Sep 17 19:14:05.272511 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.272484    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 17 19:14:05.343567 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.343536    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:14:05.466473 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.466438    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56312303-34c8-41f5-96be-489b7f7ac27f-kube-rbac-proxy-sar-config\") pod \"56312303-34c8-41f5-96be-489b7f7ac27f\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") "
Sep 17 19:14:05.466671 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.466485    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rvt9\" (UniqueName: \"kubernetes.io/projected/56312303-34c8-41f5-96be-489b7f7ac27f-kube-api-access-9rvt9\") pod \"56312303-34c8-41f5-96be-489b7f7ac27f\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") "
Sep 17 19:14:05.466671 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.466514    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56312303-34c8-41f5-96be-489b7f7ac27f-proxy-tls\") pod \"56312303-34c8-41f5-96be-489b7f7ac27f\" (UID: \"56312303-34c8-41f5-96be-489b7f7ac27f\") "
Sep 17 19:14:05.466784 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.466761    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56312303-34c8-41f5-96be-489b7f7ac27f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "56312303-34c8-41f5-96be-489b7f7ac27f" (UID: "56312303-34c8-41f5-96be-489b7f7ac27f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:14:05.468630 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.468600    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56312303-34c8-41f5-96be-489b7f7ac27f-kube-api-access-9rvt9" (OuterVolumeSpecName: "kube-api-access-9rvt9") pod "56312303-34c8-41f5-96be-489b7f7ac27f" (UID: "56312303-34c8-41f5-96be-489b7f7ac27f"). InnerVolumeSpecName "kube-api-access-9rvt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:14:05.468741 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.468651    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56312303-34c8-41f5-96be-489b7f7ac27f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "56312303-34c8-41f5-96be-489b7f7ac27f" (UID: "56312303-34c8-41f5-96be-489b7f7ac27f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:14:05.567355 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.567291    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/56312303-34c8-41f5-96be-489b7f7ac27f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:14:05.567355 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.567349    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rvt9\" (UniqueName: \"kubernetes.io/projected/56312303-34c8-41f5-96be-489b7f7ac27f-kube-api-access-9rvt9\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:14:05.567355 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:05.567358    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/56312303-34c8-41f5-96be-489b7f7ac27f-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:14:06.277859 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:06.277832    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"
Sep 17 19:14:06.278261 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:06.277865    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6" event={"ID":"56312303-34c8-41f5-96be-489b7f7ac27f","Type":"ContainerDied","Data":"f0f8a71ddffc9932a9b45797fc60811d094f76b7d411bb798574817111de66da"}
Sep 17 19:14:06.278261 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:06.277929    2575 scope.go:117] "RemoveContainer" containerID="8ac0f7071af8e04ee7ceaf62a178340f6d698a4aff5d18ffd04255bfe14aeb95"
Sep 17 19:14:06.286426 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:06.286409    2575 scope.go:117] "RemoveContainer" containerID="0d5e085d706c9d88de311ac913acfb2247331d9676a032009cf2b94d45365e66"
Sep 17 19:14:06.299622 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:06.299600    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"]
Sep 17 19:14:06.303128 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:06.303109    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6"]
Sep 17 19:14:07.212372 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:07.212341    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" path="/var/lib/kubelet/pods/56312303-34c8-41f5-96be-489b7f7ac27f/volumes"
Sep 17 19:14:10.277722 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:10.277692    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:10.278255 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:10.278219    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 17 19:14:13.110459 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:13.110428    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:14:20.278133 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:20.278086    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 17 19:14:30.278658 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:30.278615    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 17 19:14:35.951177 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:35.951145    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"]
Sep 17 19:14:35.951653 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:35.951377    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container" containerID="cri-o://612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307" gracePeriod=30
Sep 17 19:14:35.951653 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:35.951426    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kube-rbac-proxy" containerID="cri-o://962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337" gracePeriod=30
Sep 17 19:14:36.182098 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.182063    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"]
Sep 17 19:14:36.182498 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.182478    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container"
Sep 17 19:14:36.182498 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.182499    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container"
Sep 17 19:14:36.182661 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.182539    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kube-rbac-proxy"
Sep 17 19:14:36.182661 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.182548    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kube-rbac-proxy"
Sep 17 19:14:36.182661 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.182623    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kserve-container"
Sep 17 19:14:36.182661 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.182634    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="56312303-34c8-41f5-96be-489b7f7ac27f" containerName="kube-rbac-proxy"
Sep 17 19:14:36.185531 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.185512    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.187744 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.187714    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-46c43-kube-rbac-proxy-sar-config\""
Sep 17 19:14:36.187845 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.187759    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-46c43-predictor-serving-cert\""
Sep 17 19:14:36.194280 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.194259    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"]
Sep 17 19:14:36.220990 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.220914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a393590-6c53-4506-902b-f9648e8d97a1-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.221116 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.221046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a393590-6c53-4506-902b-f9648e8d97a1-proxy-tls\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.221172 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.221141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsfb\" (UniqueName: \"kubernetes.io/projected/7a393590-6c53-4506-902b-f9648e8d97a1-kube-api-access-6wsfb\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.322538 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.322498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a393590-6c53-4506-902b-f9648e8d97a1-proxy-tls\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.322735 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.322557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsfb\" (UniqueName: \"kubernetes.io/projected/7a393590-6c53-4506-902b-f9648e8d97a1-kube-api-access-6wsfb\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.322735 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.322610    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a393590-6c53-4506-902b-f9648e8d97a1-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.322735 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:14:36.322698    2575 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-46c43-predictor-serving-cert: secret "error-404-isvc-46c43-predictor-serving-cert" not found
Sep 17 19:14:36.322979 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:14:36.322793    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a393590-6c53-4506-902b-f9648e8d97a1-proxy-tls podName:7a393590-6c53-4506-902b-f9648e8d97a1 nodeName:}" failed. No retries permitted until 2026-09-17 19:14:36.822768626 +0000 UTC m=+2127.894728648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/7a393590-6c53-4506-902b-f9648e8d97a1-proxy-tls") pod "error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" (UID: "7a393590-6c53-4506-902b-f9648e8d97a1") : secret "error-404-isvc-46c43-predictor-serving-cert" not found
Sep 17 19:14:36.323339 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.323320    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a393590-6c53-4506-902b-f9648e8d97a1-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.333019 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.332991    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsfb\" (UniqueName: \"kubernetes.io/projected/7a393590-6c53-4506-902b-f9648e8d97a1-kube-api-access-6wsfb\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.409173 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.409139    2575 generic.go:356] "Generic (PLEG): container finished" podID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerID="962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337" exitCode=2
Sep 17 19:14:36.409357 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.409186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" event={"ID":"a4a30d19-a224-46d8-80ca-175c08b4cf4d","Type":"ContainerDied","Data":"962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337"}
Sep 17 19:14:36.827094 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.827055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a393590-6c53-4506-902b-f9648e8d97a1-proxy-tls\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:36.829474 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:36.829443    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a393590-6c53-4506-902b-f9648e8d97a1-proxy-tls\") pod \"error-404-isvc-46c43-predictor-5db8845cfc-4r9g6\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") " pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:37.096343 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:37.096222    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:37.368918 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:37.368891    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"]
Sep 17 19:14:37.371402 ip-10-0-135-229 kubenswrapper[2575]: W0917 19:14:37.371373    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a393590_6c53_4506_902b_f9648e8d97a1.slice/crio-cbbc8f1f63e08f59ab94fffd9208636a4de4136b2ecc01d5868de6e24bc5e016 WatchSource:0}: Error finding container cbbc8f1f63e08f59ab94fffd9208636a4de4136b2ecc01d5868de6e24bc5e016: Status 404 returned error can't find the container with id cbbc8f1f63e08f59ab94fffd9208636a4de4136b2ecc01d5868de6e24bc5e016
Sep 17 19:14:37.416126 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:37.416098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" event={"ID":"7a393590-6c53-4506-902b-f9648e8d97a1","Type":"ContainerStarted","Data":"cbbc8f1f63e08f59ab94fffd9208636a4de4136b2ecc01d5868de6e24bc5e016"}
Sep 17 19:14:38.105166 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:38.105121    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.38:8643/healthz\": dial tcp 10.134.0.38:8643: connect: connection refused"
Sep 17 19:14:38.424074 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:38.423988    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" event={"ID":"7a393590-6c53-4506-902b-f9648e8d97a1","Type":"ContainerStarted","Data":"494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494"}
Sep 17 19:14:38.424074 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:38.424058    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" event={"ID":"7a393590-6c53-4506-902b-f9648e8d97a1","Type":"ContainerStarted","Data":"9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160"}
Sep 17 19:14:38.424256 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:38.424196    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:38.424256 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:38.424227    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:38.425606 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:38.425576    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 19:14:38.443596 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:38.443547    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" podStartSLOduration=2.443531459 podStartE2EDuration="2.443531459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:14:38.441895728 +0000 UTC m=+2129.513855755" watchObservedRunningTime="2026-09-17 19:14:38.443531459 +0000 UTC m=+2129.515491488"
Sep 17 19:14:39.300980 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.300955    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:14:39.349115 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.349077    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-rbac-proxy-sar-config\") pod \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") "
Sep 17 19:14:39.349115 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.349117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4a30d19-a224-46d8-80ca-175c08b4cf4d-proxy-tls\") pod \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") "
Sep 17 19:14:39.349330 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.349165    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56mx4\" (UniqueName: \"kubernetes.io/projected/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-api-access-56mx4\") pod \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\" (UID: \"a4a30d19-a224-46d8-80ca-175c08b4cf4d\") "
Sep 17 19:14:39.349495 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.349472    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "a4a30d19-a224-46d8-80ca-175c08b4cf4d" (UID: "a4a30d19-a224-46d8-80ca-175c08b4cf4d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:14:39.351279 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.351246    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4a30d19-a224-46d8-80ca-175c08b4cf4d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a4a30d19-a224-46d8-80ca-175c08b4cf4d" (UID: "a4a30d19-a224-46d8-80ca-175c08b4cf4d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:14:39.351279 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.351267    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-api-access-56mx4" (OuterVolumeSpecName: "kube-api-access-56mx4") pod "a4a30d19-a224-46d8-80ca-175c08b4cf4d" (UID: "a4a30d19-a224-46d8-80ca-175c08b4cf4d"). InnerVolumeSpecName "kube-api-access-56mx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:14:39.430956 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.430864    2575 generic.go:356] "Generic (PLEG): container finished" podID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerID="612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307" exitCode=0
Sep 17 19:14:39.430956 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.430923    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"
Sep 17 19:14:39.430956 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.430946    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" event={"ID":"a4a30d19-a224-46d8-80ca-175c08b4cf4d","Type":"ContainerDied","Data":"612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307"}
Sep 17 19:14:39.431225 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.431008    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm" event={"ID":"a4a30d19-a224-46d8-80ca-175c08b4cf4d","Type":"ContainerDied","Data":"aaf3543bef21df9467c7a074e3e63f57c27212c0fd64a3709c5ad45a1eef7edb"}
Sep 17 19:14:39.431225 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.431034    2575 scope.go:117] "RemoveContainer" containerID="962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337"
Sep 17 19:14:39.431763 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.431697    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 19:14:39.440722 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.440702    2575 scope.go:117] "RemoveContainer" containerID="612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307"
Sep 17 19:14:39.448268 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.448253    2575 scope.go:117] "RemoveContainer" containerID="962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337"
Sep 17 19:14:39.448558 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:14:39.448541    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337\": container with ID starting with 962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337 not found: ID does not exist" containerID="962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337"
Sep 17 19:14:39.448608 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.448568    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337"} err="failed to get container status \"962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337\": rpc error: code = NotFound desc = could not find container \"962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337\": container with ID starting with 962fb3265126c65218e91cd5258f4123c6233447064990ca413cd79e594ab337 not found: ID does not exist"
Sep 17 19:14:39.448608 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.448585    2575 scope.go:117] "RemoveContainer" containerID="612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307"
Sep 17 19:14:39.451323 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.450799    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:14:39.451323 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.450849    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a4a30d19-a224-46d8-80ca-175c08b4cf4d-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:14:39.451323 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.450866    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56mx4\" (UniqueName: \"kubernetes.io/projected/a4a30d19-a224-46d8-80ca-175c08b4cf4d-kube-api-access-56mx4\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:14:39.451551 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:14:39.451411    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307\": container with ID starting with 612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307 not found: ID does not exist" containerID="612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307"
Sep 17 19:14:39.451551 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.451446    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307"} err="failed to get container status \"612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307\": rpc error: code = NotFound desc = could not find container \"612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307\": container with ID starting with 612ad853e514ff606b1be8f965cd86c87d5a04232a2f5a65bb3c44a97ba02307 not found: ID does not exist"
Sep 17 19:14:39.456953 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.456920    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"]
Sep 17 19:14:39.457068 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:39.456975    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm"]
Sep 17 19:14:40.278277 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:40.278236    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 17 19:14:41.211555 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:41.211512    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" path="/var/lib/kubelet/pods/a4a30d19-a224-46d8-80ca-175c08b4cf4d/volumes"
Sep 17 19:14:44.437069 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:44.437038    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:14:44.437529 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:44.437504    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 19:14:50.279436 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:50.279404    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:14:54.438285 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:14:54.438194    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 19:15:04.438470 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:15:04.438429    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 19:15:14.437790 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:15:14.437748    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 17 19:15:24.438314 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:15:24.438259    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:23:50.955737 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:50.955699    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"]
Sep 17 19:23:50.958132 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:50.955983    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container" containerID="cri-o://9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160" gracePeriod=30
Sep 17 19:23:50.958132 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:50.956015    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kube-rbac-proxy" containerID="cri-o://494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494" gracePeriod=30
Sep 17 19:23:51.824119 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:51.824082    2575 generic.go:356] "Generic (PLEG): container finished" podID="7a393590-6c53-4506-902b-f9648e8d97a1" containerID="494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494" exitCode=2
Sep 17 19:23:51.824347 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:51.824134    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" event={"ID":"7a393590-6c53-4506-902b-f9648e8d97a1","Type":"ContainerDied","Data":"494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494"}
Sep 17 19:23:54.311125 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.311095    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:23:54.420362 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.420271    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a393590-6c53-4506-902b-f9648e8d97a1-proxy-tls\") pod \"7a393590-6c53-4506-902b-f9648e8d97a1\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") "
Sep 17 19:23:54.420519 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.420367    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a393590-6c53-4506-902b-f9648e8d97a1-kube-rbac-proxy-sar-config\") pod \"7a393590-6c53-4506-902b-f9648e8d97a1\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") "
Sep 17 19:23:54.420519 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.420464    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wsfb\" (UniqueName: \"kubernetes.io/projected/7a393590-6c53-4506-902b-f9648e8d97a1-kube-api-access-6wsfb\") pod \"7a393590-6c53-4506-902b-f9648e8d97a1\" (UID: \"7a393590-6c53-4506-902b-f9648e8d97a1\") "
Sep 17 19:23:54.420753 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.420725    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a393590-6c53-4506-902b-f9648e8d97a1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7a393590-6c53-4506-902b-f9648e8d97a1" (UID: "7a393590-6c53-4506-902b-f9648e8d97a1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:23:54.422533 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.422504    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a393590-6c53-4506-902b-f9648e8d97a1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7a393590-6c53-4506-902b-f9648e8d97a1" (UID: "7a393590-6c53-4506-902b-f9648e8d97a1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:23:54.422533 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.422527    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a393590-6c53-4506-902b-f9648e8d97a1-kube-api-access-6wsfb" (OuterVolumeSpecName: "kube-api-access-6wsfb") pod "7a393590-6c53-4506-902b-f9648e8d97a1" (UID: "7a393590-6c53-4506-902b-f9648e8d97a1"). InnerVolumeSpecName "kube-api-access-6wsfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:23:54.521443 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.521407    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wsfb\" (UniqueName: \"kubernetes.io/projected/7a393590-6c53-4506-902b-f9648e8d97a1-kube-api-access-6wsfb\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:23:54.521443 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.521438    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7a393590-6c53-4506-902b-f9648e8d97a1-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:23:54.521443 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.521447    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7a393590-6c53-4506-902b-f9648e8d97a1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:23:54.840096 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.840059    2575 generic.go:356] "Generic (PLEG): container finished" podID="7a393590-6c53-4506-902b-f9648e8d97a1" containerID="9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160" exitCode=0
Sep 17 19:23:54.840276 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.840112    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"
Sep 17 19:23:54.840276 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.840114    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" event={"ID":"7a393590-6c53-4506-902b-f9648e8d97a1","Type":"ContainerDied","Data":"9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160"}
Sep 17 19:23:54.840276 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.840266    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6" event={"ID":"7a393590-6c53-4506-902b-f9648e8d97a1","Type":"ContainerDied","Data":"cbbc8f1f63e08f59ab94fffd9208636a4de4136b2ecc01d5868de6e24bc5e016"}
Sep 17 19:23:54.840414 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.840319    2575 scope.go:117] "RemoveContainer" containerID="494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494"
Sep 17 19:23:54.848678 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.848659    2575 scope.go:117] "RemoveContainer" containerID="9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160"
Sep 17 19:23:54.856274 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.856254    2575 scope.go:117] "RemoveContainer" containerID="494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494"
Sep 17 19:23:54.856571 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:23:54.856553    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494\": container with ID starting with 494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494 not found: ID does not exist" containerID="494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494"
Sep 17 19:23:54.856619 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.856581    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494"} err="failed to get container status \"494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494\": rpc error: code = NotFound desc = could not find container \"494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494\": container with ID starting with 494183b80707ebacba9e839ac628b0958307a03efc7be25c3021b7fcebd0d494 not found: ID does not exist"
Sep 17 19:23:54.856619 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.856600    2575 scope.go:117] "RemoveContainer" containerID="9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160"
Sep 17 19:23:54.856840 ip-10-0-135-229 kubenswrapper[2575]: E0917 19:23:54.856825    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160\": container with ID starting with 9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160 not found: ID does not exist" containerID="9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160"
Sep 17 19:23:54.856882 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.856844    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160"} err="failed to get container status \"9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160\": rpc error: code = NotFound desc = could not find container \"9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160\": container with ID starting with 9d32a6588c8a28eb01d044de5988a66cb8b4ee86ca624c8b996871b886bd7160 not found: ID does not exist"
Sep 17 19:23:54.865067 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.865044    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"]
Sep 17 19:23:54.869640 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:54.869618    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6"]
Sep 17 19:23:55.211533 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:23:55.211494    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" path="/var/lib/kubelet/pods/7a393590-6c53-4506-902b-f9648e8d97a1/volumes"
Sep 17 19:31:21.480524 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:21.480439    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"]
Sep 17 19:31:21.483022 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:21.480706    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container" containerID="cri-o://a6963c9dbf6972e2d163051a800a4ed7483fc278dbeeac473415878ad3c1b805" gracePeriod=30
Sep 17 19:31:21.483022 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:21.480747    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kube-rbac-proxy" containerID="cri-o://4c9bb3730e984506b7ebff2fce9151d73e6663de6308d577ee72bf60a17e5ec9" gracePeriod=30
Sep 17 19:31:21.761343 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:21.761238    2575 generic.go:356] "Generic (PLEG): container finished" podID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerID="4c9bb3730e984506b7ebff2fce9151d73e6663de6308d577ee72bf60a17e5ec9" exitCode=2
Sep 17 19:31:21.761343 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:21.761324    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" event={"ID":"150a7fd2-abf9-4276-a04d-84fb869199d9","Type":"ContainerDied","Data":"4c9bb3730e984506b7ebff2fce9151d73e6663de6308d577ee72bf60a17e5ec9"}
Sep 17 19:31:24.776446 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.776415    2575 generic.go:356] "Generic (PLEG): container finished" podID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerID="a6963c9dbf6972e2d163051a800a4ed7483fc278dbeeac473415878ad3c1b805" exitCode=0
Sep 17 19:31:24.776786 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.776485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" event={"ID":"150a7fd2-abf9-4276-a04d-84fb869199d9","Type":"ContainerDied","Data":"a6963c9dbf6972e2d163051a800a4ed7483fc278dbeeac473415878ad3c1b805"}
Sep 17 19:31:24.827606 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.827579    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:31:24.894289 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.894201    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvdqk\" (UniqueName: \"kubernetes.io/projected/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-api-access-nvdqk\") pod \"150a7fd2-abf9-4276-a04d-84fb869199d9\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") "
Sep 17 19:31:24.894289 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.894263    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-rbac-proxy-sar-config\") pod \"150a7fd2-abf9-4276-a04d-84fb869199d9\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") "
Sep 17 19:31:24.894289 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.894287    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/150a7fd2-abf9-4276-a04d-84fb869199d9-proxy-tls\") pod \"150a7fd2-abf9-4276-a04d-84fb869199d9\" (UID: \"150a7fd2-abf9-4276-a04d-84fb869199d9\") "
Sep 17 19:31:24.894708 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.894683    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "150a7fd2-abf9-4276-a04d-84fb869199d9" (UID: "150a7fd2-abf9-4276-a04d-84fb869199d9"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 19:31:24.896497 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.896469    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/150a7fd2-abf9-4276-a04d-84fb869199d9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "150a7fd2-abf9-4276-a04d-84fb869199d9" (UID: "150a7fd2-abf9-4276-a04d-84fb869199d9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 19:31:24.896497 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.896481    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-api-access-nvdqk" (OuterVolumeSpecName: "kube-api-access-nvdqk") pod "150a7fd2-abf9-4276-a04d-84fb869199d9" (UID: "150a7fd2-abf9-4276-a04d-84fb869199d9"). InnerVolumeSpecName "kube-api-access-nvdqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 19:31:24.995339 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.995282    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvdqk\" (UniqueName: \"kubernetes.io/projected/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-api-access-nvdqk\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:31:24.995339 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.995333    2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/150a7fd2-abf9-4276-a04d-84fb869199d9-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:31:24.995339 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:24.995344    2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/150a7fd2-abf9-4276-a04d-84fb869199d9-proxy-tls\") on node \"ip-10-0-135-229.ec2.internal\" DevicePath \"\""
Sep 17 19:31:25.782486 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:25.782455    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"
Sep 17 19:31:25.782486 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:25.782481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf" event={"ID":"150a7fd2-abf9-4276-a04d-84fb869199d9","Type":"ContainerDied","Data":"c49463732b0d93312992756235dbb1c8427a3578ef191302ce96fc7cdb91c050"}
Sep 17 19:31:25.783024 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:25.782557    2575 scope.go:117] "RemoveContainer" containerID="4c9bb3730e984506b7ebff2fce9151d73e6663de6308d577ee72bf60a17e5ec9"
Sep 17 19:31:25.790973 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:25.790956    2575 scope.go:117] "RemoveContainer" containerID="a6963c9dbf6972e2d163051a800a4ed7483fc278dbeeac473415878ad3c1b805"
Sep 17 19:31:25.799849 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:25.799823    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"]
Sep 17 19:31:25.804226 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:25.804204    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf"]
Sep 17 19:31:27.211568 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:27.211531    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" path="/var/lib/kubelet/pods/150a7fd2-abf9-4276-a04d-84fb869199d9/volumes"
Sep 17 19:31:55.101176 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101139    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sms2k/must-gather-txchj"]
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101486    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kube-rbac-proxy"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101499    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kube-rbac-proxy"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101511    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101519    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101530    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101538    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101547    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101552    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101559    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kube-rbac-proxy"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101564    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kube-rbac-proxy"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101573    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kube-rbac-proxy"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101578    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kube-rbac-proxy"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101637    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kserve-container"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101645    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kube-rbac-proxy"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101651    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kube-rbac-proxy"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101658    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a30d19-a224-46d8-80ca-175c08b4cf4d" containerName="kserve-container"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101662    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a393590-6c53-4506-902b-f9648e8d97a1" containerName="kserve-container"
Sep 17 19:31:55.101682 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.101669    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="150a7fd2-abf9-4276-a04d-84fb869199d9" containerName="kube-rbac-proxy"
Sep 17 19:31:55.104566 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.104549    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sms2k/must-gather-txchj"
Sep 17 19:31:55.110760 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.110511    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sms2k\"/\"default-dockercfg-2v6r8\""
Sep 17 19:31:55.111259 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.111238    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sms2k\"/\"openshift-service-ca.crt\""
Sep 17 19:31:55.112316 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.112279    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sms2k\"/\"kube-root-ca.crt\""
Sep 17 19:31:55.128222 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.128195    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sms2k/must-gather-txchj"]
Sep 17 19:31:55.164629 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.164591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30ada25f-832e-40fb-b219-5c061523ba14-must-gather-output\") pod \"must-gather-txchj\" (UID: \"30ada25f-832e-40fb-b219-5c061523ba14\") " pod="openshift-must-gather-sms2k/must-gather-txchj"
Sep 17 19:31:55.164797 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.164651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwh9h\" (UniqueName: \"kubernetes.io/projected/30ada25f-832e-40fb-b219-5c061523ba14-kube-api-access-lwh9h\") pod \"must-gather-txchj\" (UID: \"30ada25f-832e-40fb-b219-5c061523ba14\") " pod="openshift-must-gather-sms2k/must-gather-txchj"
Sep 17 19:31:55.265059 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.265022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwh9h\" (UniqueName: \"kubernetes.io/projected/30ada25f-832e-40fb-b219-5c061523ba14-kube-api-access-lwh9h\") pod \"must-gather-txchj\" (UID: \"30ada25f-832e-40fb-b219-5c061523ba14\") " pod="openshift-must-gather-sms2k/must-gather-txchj"
Sep 17 19:31:55.265247 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.265086    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30ada25f-832e-40fb-b219-5c061523ba14-must-gather-output\") pod \"must-gather-txchj\" (UID: \"30ada25f-832e-40fb-b219-5c061523ba14\") " pod="openshift-must-gather-sms2k/must-gather-txchj"
Sep 17 19:31:55.265407 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.265389    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/30ada25f-832e-40fb-b219-5c061523ba14-must-gather-output\") pod \"must-gather-txchj\" (UID: \"30ada25f-832e-40fb-b219-5c061523ba14\") " pod="openshift-must-gather-sms2k/must-gather-txchj"
Sep 17 19:31:55.274462 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.274439    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwh9h\" (UniqueName: \"kubernetes.io/projected/30ada25f-832e-40fb-b219-5c061523ba14-kube-api-access-lwh9h\") pod \"must-gather-txchj\" (UID: \"30ada25f-832e-40fb-b219-5c061523ba14\") " pod="openshift-must-gather-sms2k/must-gather-txchj"
Sep 17 19:31:55.412859 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.412776    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sms2k/must-gather-txchj"
Sep 17 19:31:55.683328 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.683107    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sms2k/must-gather-txchj"]
Sep 17 19:31:55.685898 ip-10-0-135-229 kubenswrapper[2575]: W0917 19:31:55.685871    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30ada25f_832e_40fb_b219_5c061523ba14.slice/crio-13fa29e45889151e02d1c2a3486fbc48bb33a1de0ac29bd13f30272420a1e7a2 WatchSource:0}: Error finding container 13fa29e45889151e02d1c2a3486fbc48bb33a1de0ac29bd13f30272420a1e7a2: Status 404 returned error can't find the container with id 13fa29e45889151e02d1c2a3486fbc48bb33a1de0ac29bd13f30272420a1e7a2
Sep 17 19:31:55.687741 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.687725    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 19:31:55.906461 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:55.906420    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sms2k/must-gather-txchj" event={"ID":"30ada25f-832e-40fb-b219-5c061523ba14","Type":"ContainerStarted","Data":"13fa29e45889151e02d1c2a3486fbc48bb33a1de0ac29bd13f30272420a1e7a2"}
Sep 17 19:31:56.913430 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:56.913327    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sms2k/must-gather-txchj" event={"ID":"30ada25f-832e-40fb-b219-5c061523ba14","Type":"ContainerStarted","Data":"58584aee74f221e7cddfd584ca65cff27e2a881290c51d948e93b802a815972e"}
Sep 17 19:31:56.913430 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:56.913373    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sms2k/must-gather-txchj" event={"ID":"30ada25f-832e-40fb-b219-5c061523ba14","Type":"ContainerStarted","Data":"526eb98e90a9c57be80d6496b59a776974c44d35e010d8ee98fb51a2712245ad"}
Sep 17 19:31:56.931181 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:56.931119    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sms2k/must-gather-txchj" podStartSLOduration=1.113026876 podStartE2EDuration="1.931098632s" totalImagesPullingTime="818.071756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 19:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:31:56.930341369 +0000 UTC m=+3168.002301399" watchObservedRunningTime="2026-09-17 19:31:56.931098632 +0000 UTC m=+3168.003058662"
Sep 17 19:31:57.989313 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:57.989270    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xx5jd_460b2252-a6cb-4e30-8f44-593a71adf004/global-pull-secret-syncer/0.log"
Sep 17 19:31:58.085313 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:58.085265    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c75wd_8f686a9a-6483-47a6-85d9-7945eaec6984/konnectivity-agent/0.log"
Sep 17 19:31:58.143549 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:31:58.143520    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-229.ec2.internal_fe1cc490e9c9f162e93a2c47a0afaf33/haproxy/0.log"
Sep 17 19:32:02.191122 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.191093    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4/alertmanager/0.log"
Sep 17 19:32:02.219757 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.219608    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4/config-reloader/0.log"
Sep 17 19:32:02.247446 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.247418    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4/kube-rbac-proxy-web/0.log"
Sep 17 19:32:02.279108 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.279071    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4/kube-rbac-proxy/0.log"
Sep 17 19:32:02.316656 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.316627    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4/kube-rbac-proxy-metric/0.log"
Sep 17 19:32:02.346905 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.346868    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4/prom-label-proxy/0.log"
Sep 17 19:32:02.374548 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.374516    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f75ad07-6a8c-4aea-8c2b-d6dee5e178f4/init-config-reloader/0.log"
Sep 17 19:32:02.631482 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.631449    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dh24d_7d6d91b6-6f96-48bd-84e9-b8de46779922/node-exporter/0.log"
Sep 17 19:32:02.657609 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.657580    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dh24d_7d6d91b6-6f96-48bd-84e9-b8de46779922/kube-rbac-proxy/0.log"
Sep 17 19:32:02.685789 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.685756    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dh24d_7d6d91b6-6f96-48bd-84e9-b8de46779922/init-textfile/0.log"
Sep 17 19:32:02.902405 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.902254    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-q7t8j_4f579336-884f-4505-8520-d917a7b16132/kube-rbac-proxy-main/0.log"
Sep 17 19:32:02.932687 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.932654    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-q7t8j_4f579336-884f-4505-8520-d917a7b16132/kube-rbac-proxy-self/0.log"
Sep 17 19:32:02.954866 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:02.954824    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-q7t8j_4f579336-884f-4505-8520-d917a7b16132/openshift-state-metrics/0.log"
Sep 17 19:32:03.302262 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:03.302227    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f55b7b977-2szjw_58a133b0-0079-4046-bd15-a839077380b7/telemeter-client/0.log"
Sep 17 19:32:03.327766 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:03.327737    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f55b7b977-2szjw_58a133b0-0079-4046-bd15-a839077380b7/reload/0.log"
Sep 17 19:32:03.366759 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:03.366663    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f55b7b977-2szjw_58a133b0-0079-4046-bd15-a839077380b7/kube-rbac-proxy/0.log"
Sep 17 19:32:05.970720 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:05.970694    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fd6dcbbb6-mmclw_99259b67-c5c6-495d-b7e3-15fcd7caab93/console/0.log"
Sep 17 19:32:06.012841 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.012813    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-9msnw_ed52ef77-6f12-46bb-bef3-b11695a3c0d6/download-server/0.log"
Sep 17 19:32:06.830856 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.830813    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"]
Sep 17 19:32:06.836624 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.836592    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.847146 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.847113    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"]
Sep 17 19:32:06.881169 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.881131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-podres\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.881595 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.881569    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-proc\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.881746 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.881732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-sys\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.881857 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.881840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl4sv\" (UniqueName: \"kubernetes.io/projected/680a59c0-8813-42ec-80e6-40d42e3a82fe-kube-api-access-hl4sv\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.881978 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.881964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-lib-modules\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.982581 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.982539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-proc\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.982581 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.982594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-sys\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.983224 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.982621    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl4sv\" (UniqueName: \"kubernetes.io/projected/680a59c0-8813-42ec-80e6-40d42e3a82fe-kube-api-access-hl4sv\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.983224 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.982655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-lib-modules\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.983224 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.982682    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-proc\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.983224 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.982689    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-podres\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.983224 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.982862    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-lib-modules\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.983224 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.982942    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-podres\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.983224 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.982991    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/680a59c0-8813-42ec-80e6-40d42e3a82fe-sys\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:06.993059 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:06.993031    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl4sv\" (UniqueName: \"kubernetes.io/projected/680a59c0-8813-42ec-80e6-40d42e3a82fe-kube-api-access-hl4sv\") pod \"perf-node-gather-daemonset-mt75m\" (UID: \"680a59c0-8813-42ec-80e6-40d42e3a82fe\") " pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:07.151367 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:07.151245    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:07.447185 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:07.447105    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"]
Sep 17 19:32:07.451384 ip-10-0-135-229 kubenswrapper[2575]: W0917 19:32:07.451349    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod680a59c0_8813_42ec_80e6_40d42e3a82fe.slice/crio-0d8690274742513ccc502bcd04d2bd7b1be6d9d5353fa8e1883c65659b47879b WatchSource:0}: Error finding container 0d8690274742513ccc502bcd04d2bd7b1be6d9d5353fa8e1883c65659b47879b: Status 404 returned error can't find the container with id 0d8690274742513ccc502bcd04d2bd7b1be6d9d5353fa8e1883c65659b47879b
Sep 17 19:32:07.472724 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:07.472688    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jlvrl_065fa123-2fc5-43e9-920d-c34363925630/dns/0.log"
Sep 17 19:32:07.499090 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:07.499068    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jlvrl_065fa123-2fc5-43e9-920d-c34363925630/kube-rbac-proxy/0.log"
Sep 17 19:32:07.665127 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:07.665101    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fg6p8_6c89642d-8115-4b12-b994-80b4fdd94aa4/dns-node-resolver/0.log"
Sep 17 19:32:08.002624 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:08.002574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m" event={"ID":"680a59c0-8813-42ec-80e6-40d42e3a82fe","Type":"ContainerStarted","Data":"dc0b8e74e77b360d793ed79150a34cd4da252efd5eb4ab9b5917f143c8752583"}
Sep 17 19:32:08.003094 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:08.002687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m" event={"ID":"680a59c0-8813-42ec-80e6-40d42e3a82fe","Type":"ContainerStarted","Data":"0d8690274742513ccc502bcd04d2bd7b1be6d9d5353fa8e1883c65659b47879b"}
Sep 17 19:32:08.003548 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:08.003491    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:08.023269 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:08.023217    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m" podStartSLOduration=2.02320349 podStartE2EDuration="2.02320349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 19:32:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 19:32:08.022620744 +0000 UTC m=+3179.094580791" watchObservedRunningTime="2026-09-17 19:32:08.02320349 +0000 UTC m=+3179.095163518"
Sep 17 19:32:08.200177 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:08.200138    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c55876d5b-j7w8h_e4e40c48-505d-4001-8726-a0cc7ac3160f/registry/0.log"
Sep 17 19:32:08.250934 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:08.250907    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7csz9_2bf32f3c-313e-41ec-a8de-e02bca764270/node-ca/0.log"
Sep 17 19:32:09.434387 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:09.434361    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nrx6t_5e4f444b-7085-4351-970d-0cedab60e0e8/serve-healthcheck-canary/0.log"
Sep 17 19:32:09.890942 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:09.890906    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-tchqh_c6cf6711-d48f-4b3b-a994-d49bc70626df/insights-operator/0.log"
Sep 17 19:32:09.891513 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:09.891491    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-tchqh_c6cf6711-d48f-4b3b-a994-d49bc70626df/insights-operator/1.log"
Sep 17 19:32:10.055987 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:10.055960    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqc79_24871cd7-bf2a-4e53-984f-0d7a603c266a/kube-rbac-proxy/0.log"
Sep 17 19:32:10.077739 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:10.077714    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqc79_24871cd7-bf2a-4e53-984f-0d7a603c266a/exporter/0.log"
Sep 17 19:32:10.100756 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:10.100728    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqc79_24871cd7-bf2a-4e53-984f-0d7a603c266a/extractor/0.log"
Sep 17 19:32:12.420657 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:12.420616    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-7dcf484667-78sst_7b20eee5-994f-45e4-aac6-81ed1766546b/manager/0.log"
Sep 17 19:32:12.456303 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:12.456254    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-mx7nf_3fc54553-7cf5-48ca-bab4-d55fa15bb7dc/manager/0.log"
Sep 17 19:32:15.026663 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:15.026637    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sms2k/perf-node-gather-daemonset-mt75m"
Sep 17 19:32:16.581735 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:16.581713    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-6t8vq_39275510-0f5f-430a-8dc8-bf7aa9e9e0a3/migrator/0.log"
Sep 17 19:32:16.605043 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:16.605015    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-6t8vq_39275510-0f5f-430a-8dc8-bf7aa9e9e0a3/graceful-termination/0.log"
Sep 17 19:32:18.184221 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.184192    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6gh9d_c81dc79a-21e6-4746-9941-a28ee9440300/kube-multus-additional-cni-plugins/0.log"
Sep 17 19:32:18.209188 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.209167    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6gh9d_c81dc79a-21e6-4746-9941-a28ee9440300/egress-router-binary-copy/0.log"
Sep 17 19:32:18.232478 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.232452    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6gh9d_c81dc79a-21e6-4746-9941-a28ee9440300/cni-plugins/0.log"
Sep 17 19:32:18.256636 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.256606    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6gh9d_c81dc79a-21e6-4746-9941-a28ee9440300/bond-cni-plugin/0.log"
Sep 17 19:32:18.278451 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.278424    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6gh9d_c81dc79a-21e6-4746-9941-a28ee9440300/routeoverride-cni/0.log"
Sep 17 19:32:18.299861 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.299835    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6gh9d_c81dc79a-21e6-4746-9941-a28ee9440300/whereabouts-cni-bincopy/0.log"
Sep 17 19:32:18.321673 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.321652    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6gh9d_c81dc79a-21e6-4746-9941-a28ee9440300/whereabouts-cni/0.log"
Sep 17 19:32:18.784095 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.784064    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bjqjf_d9a9636d-c015-4738-9e84-e871940ac053/kube-multus/0.log"
Sep 17 19:32:18.881465 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.881433    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fnh86_d9aa2188-f986-4999-982d-a02dde5eba1e/network-metrics-daemon/0.log"
Sep 17 19:32:18.907676 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:18.907646    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fnh86_d9aa2188-f986-4999-982d-a02dde5eba1e/kube-rbac-proxy/0.log"
Sep 17 19:32:20.026839 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:20.026812    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8q7g_60d068af-a16a-4676-9b62-9d262dca963d/ovn-controller/0.log"
Sep 17 19:32:20.046774 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:20.046749    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8q7g_60d068af-a16a-4676-9b62-9d262dca963d/ovn-acl-logging/0.log"
Sep 17 19:32:20.071706 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:20.071630    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8q7g_60d068af-a16a-4676-9b62-9d262dca963d/kube-rbac-proxy-node/0.log"
Sep 17 19:32:20.094587 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:20.094561    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8q7g_60d068af-a16a-4676-9b62-9d262dca963d/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 19:32:20.117951 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:20.117909    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8q7g_60d068af-a16a-4676-9b62-9d262dca963d/northd/0.log"
Sep 17 19:32:20.140051 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:20.140023    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8q7g_60d068af-a16a-4676-9b62-9d262dca963d/nbdb/0.log"
Sep 17 19:32:20.162210 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:20.162182    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8q7g_60d068af-a16a-4676-9b62-9d262dca963d/sbdb/0.log"
Sep 17 19:32:20.203947 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:20.203916    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m8q7g_60d068af-a16a-4676-9b62-9d262dca963d/ovnkube-controller/0.log"
Sep 17 19:32:21.413324 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:21.413285    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lsr2c_36555ce9-b17b-4157-9d11-357b392cb318/network-check-target-container/0.log"
Sep 17 19:32:22.548739 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:22.548711    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-p4298_42fc87b9-8d93-4a1d-958e-286e086c8b44/iptables-alerter/0.log"
Sep 17 19:32:23.299334 ip-10-0-135-229 kubenswrapper[2575]: I0917 19:32:23.299253    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-nfhrg_9bd66254-a50a-4592-9f6b-7dfe0fefd2bb/tuned/0.log"