Sep 09 19:55:01.820790 ip-10-0-128-182 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 19:55:02.254276 ip-10-0-128-182 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 19:55:02.254276 ip-10-0-128-182 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 19:55:02.254276 ip-10-0-128-182 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 19:55:02.254276 ip-10-0-128-182 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 19:55:02.254276 ip-10-0-128-182 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 19:55:02.255591 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.255486    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 19:55:02.259139 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259125    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 19:55:02.259139 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259139    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259145    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259148    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259152    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259155    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259158    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259161    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259164    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259169    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259173    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259176    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259179    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259181    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259184    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259188    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259191    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259193    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259197    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259199    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 19:55:02.259202 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259202    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259205    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259207    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259211    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259213    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259216    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259219    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259221    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259224    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259227    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259229    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259232    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259234    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259237    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259239    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259242    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259244    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259247    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259250    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259252    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 19:55:02.259677 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259255    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259257    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259260    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259262    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259265    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259268    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259271    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259274    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259277    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259280    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259282    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259286    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259289    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259292    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259297    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259299    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259302    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259305    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259307    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 19:55:02.260159 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259309    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259312    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259314    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259317    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259319    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259322    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259324    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259327    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259329    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259332    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259334    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259337    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259339    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259342    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259344    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259347    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259349    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259352    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259354    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259356    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 19:55:02.260667 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259359    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259361    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259363    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259366    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259368    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259370    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259373    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259377    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259379    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259382    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259385    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259387    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259390    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259392    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259395    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259397    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259400    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259403    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259405    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 19:55:02.261148 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.259408    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261134    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261141    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261145    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261147    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261151    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261154    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261157    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261160    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261163    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261166    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261169    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261171    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261174    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261176    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261179    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261181    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261184    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261186    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261189    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 19:55:02.261623 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261191    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261194    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261196    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261198    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261201    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261203    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261206    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261209    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261212    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261214    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261216    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261219    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261222    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261224    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261227    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261229    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261232    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261234    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261237    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 19:55:02.262109 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261240    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261243    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261245    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261249    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261253    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261256    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261258    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261261    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261263    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261266    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261268    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261270    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261273    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261275    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261279    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261281    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261283    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261286    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261289    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261292    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 19:55:02.262593 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261295    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261298    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261300    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261303    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261306    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261308    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261311    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261313    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261315    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261318    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261320    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261323    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261325    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261328    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261331    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261334    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261338    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261340    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261343    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261346    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 19:55:02.263192 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261348    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261352    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261354    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261357    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261359    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261362    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261364    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261367    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261369    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261372    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261374    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261379    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261383    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261386    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261388    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261392    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261394    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261397    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261399    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261402    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 19:55:02.263723 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261404    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261787    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261792    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261795    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261799    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261806    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261810    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261813    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261816    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261818    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261821    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261824    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261828    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261830    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261833    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261836    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261839    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261841    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261844    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 19:55:02.264211 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261846    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261849    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261852    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261854    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261857    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261860    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261863    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261865    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261868    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261870    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261873    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261875    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261878    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261880    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261883    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261885    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261888    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261890    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261893    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261895    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 19:55:02.264684 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261898    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261900    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261903    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261905    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261908    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261910    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261912    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261915    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261917    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261920    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261923    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261925    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261929    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261932    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261935    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261937    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261941    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261943    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261946    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 19:55:02.265204 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261948    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261951    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261953    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261956    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261959    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261961    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261963    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261966    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261968    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261971    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261973    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261976    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261978    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261981    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261984    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261987    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261990    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261992    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261995    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.261998    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 19:55:02.265716 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262000    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262002    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262005    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262007    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262009    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262012    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262014    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262016    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262019    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262022    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262025    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262027    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262030    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262032    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262035    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262037    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262040    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262042    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262046    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262048    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 19:55:02.266205 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262050    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262053    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262131    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262181    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262188    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262193    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262198    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262201    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262205    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262210    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262213    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262216    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262219    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262222    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262225    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262228    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262231    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262234    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262237    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262239    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262244    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262248    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262251    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262254    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 19:55:02.266725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262257    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262261    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262273    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262277    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262280    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262283    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262286    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262289    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262292    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262294    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262298    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262301    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262304    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262306    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262309    2577 flags.go:64] FLAG: --enable-server="true"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262313    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262318    2577 flags.go:64] FLAG: --event-burst="100"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262321    2577 flags.go:64] FLAG: --event-qps="50"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262323    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262326    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262329    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262332    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262335    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262338    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262340    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 09 19:55:02.267298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262344    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262346    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262349    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262352    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262355    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262360    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262363    2577 flags.go:64] FLAG: --feature-gates=""
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262366    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262369    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262372    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262376    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262379    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262382    2577 flags.go:64] FLAG: --help="false"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262385    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262388    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262390    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262393    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262397    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262400    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262403    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262405    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262408    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262411    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 19:55:02.267909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262414    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262417    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262420    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262422    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262425    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262428    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262431    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262433    2577 flags.go:64] FLAG: --lock-file=""
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262436    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262439    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262442    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262447    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262450    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262453    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262459    2577 flags.go:64] FLAG: --logging-format="text"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262462    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262478    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262481    2577 flags.go:64] FLAG: --manifest-url=""
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262484    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262489    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262492    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262496    2577 flags.go:64] FLAG: --max-pods="110"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262498    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262502    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262505    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 19:55:02.268527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262508    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262510    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262514    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262517    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262524    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262527    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262530    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262533    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262536    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262542    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262545    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262548    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262551    2577 flags.go:64] FLAG: --port="10250"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262554    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262557    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-082a42730f057c845"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262560    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262563    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262566    2577 flags.go:64] FLAG: --register-node="true"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262569    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262573    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262576    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262578    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262582    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262586    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262589    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 19:55:02.269168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262592    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262595    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262598    2577 flags.go:64] FLAG: --runonce="false"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262601    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262604    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262607    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262610    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262613    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262616    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262619    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262622    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262625    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262628    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262630    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262633    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262636    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262640    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262643    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262648    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262650    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262671    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262675    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262678    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262681    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262684    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 19:55:02.269790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262687    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262691    2577 flags.go:64] FLAG: --v="2"
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262695    2577 flags.go:64] FLAG: --version="false"
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262699    2577 flags.go:64] FLAG: --vmodule=""
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262706    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.262709    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262823    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262827    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262830    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262833    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262836    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262839    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262842    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262844    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262847    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262850    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262853    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262856    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262859    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262861    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262864    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 19:55:02.270405 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262867    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262869    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262872    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262875    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262877    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262880    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262882    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262885    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262888    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262890    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262893    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262895    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262899    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262902    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262904    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262908    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262911    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262913    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262916    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 19:55:02.270921 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262918    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262921    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262924    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262926    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262929    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262931    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262934    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262936    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262938    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262941    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262944    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262946    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262948    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262951    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262953    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262956    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262958    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262961    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262965    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 19:55:02.271382 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262969    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262972    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262974    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262977    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262980    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262983    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262988    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262990    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262993    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262996    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.262999    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263002    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263004    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263007    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263009    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263012    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263015    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263017    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263020    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263022    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 19:55:02.271871 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263025    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263027    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263030    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263032    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263035    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263038    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263042    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263044    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263048    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263051    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263054    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263057    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263068    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263071    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263074    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263077    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263080    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263083    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263087    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 19:55:02.272366 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263090    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263092    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263096    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263099    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263101    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263104    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.263106    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.263958    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.271491    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.271507    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.272852    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 19:55:02.272889 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.272860    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272919    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272925    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272928    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272931    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272934    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272937    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272939    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272942    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272945    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272947    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272950    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272952    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272956    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272958    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272961    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272965    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272969    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272972    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272975    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 19:55:02.273170 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272978    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272981    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272984    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272987    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272989    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272992    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272995    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.272998    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273000    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273002    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273005    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273008    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273011    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273014    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273017    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273019    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273022    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273025    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273027    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273030    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 19:55:02.273658 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273032    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273035    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273037    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273039    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273042    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273044    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273047    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273050    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273052    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273055    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273057    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273059    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273062    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273066    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273069    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273072    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273074    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273077    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273079    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273082    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 19:55:02.274141 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273084    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273086    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273089    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273091    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273094    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273096    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273099    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273102    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273104    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273107    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273110    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273112    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273114    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273117    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273120    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273122    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273124    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273127    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273129    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273132    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 19:55:02.274654 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273134    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273137    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273140    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273142    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273144    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273147    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273149    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273151    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273154    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273156    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273159    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273161    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273163    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273165    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273168    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273172    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273175    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273179    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273182    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 19:55:02.275128 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273185    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.273190    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273304    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273309    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273312    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273316    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273319    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273322    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273324    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273327    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273329    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273332    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273334    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273337    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273340    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 19:55:02.275604 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273343    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273345    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273348    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273350    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273353    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273355    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273358    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273360    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273363    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273365    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273368    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273371    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273373    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273375    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273378    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273381    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273383    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273386    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273389    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 19:55:02.275972 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273391    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273394    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273396    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273399    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273401    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273404    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273407    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273409    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273411    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273414    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273416    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273419    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273422    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273424    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273427    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273429    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273431    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273434    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273436    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273438    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 19:55:02.276433 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273442    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273445    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273448    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273450    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273453    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273455    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273459    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273462    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273477    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273480    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273483    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273486    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273489    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273491    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273494    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273497    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273499    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273502    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273504    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 19:55:02.276980 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273507    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273511    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273514    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273516    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273519    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273522    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273525    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273527    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273530    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273532    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273535    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273538    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273540    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273543    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273545    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273548    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273550    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273553    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273555    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273558    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 19:55:02.277429 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273560    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273563    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273565    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273568    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273571    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273574    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273576    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:02.273579    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.273583    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.273690    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.276611    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.277710    2577 server.go:1019] "Starting client certificate rotation"
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.277805    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 19:55:02.277915 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.277837    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 19:55:02.280854 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.280840    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 19:55:02.281979 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.281956    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 19:55:02.291427 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.291407    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 09 19:55:02.294252 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.294235    2577 log.go:25] "Validated CRI v1 image API"
Sep 09 19:55:02.295124 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.295106    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 19:55:02.299696 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.299675    2577 fs.go:135] Filesystem UUIDs: map[4c73aea2-5fe8-46d5-88ea-b68c0eb46b68:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a668fe08-f008-4051-bd33-4ec2cc04ee19:/dev/nvme0n1p3]
Sep 09 19:55:02.299774 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.299694    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 19:55:02.304945 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.304832    2577 manager.go:216] Machine: {Timestamp:2026-09-09 19:55:02.303354146 +0000 UTC m=+0.353499220 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098972 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec227fa999ccf8e59747f4e8ab318939 SystemUUID:ec227fa9-99cc-f8e5-9747-f4e8ab318939 BootID:57c1bb51-54ff-405a-bc12-0866e4d6a52d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f5:ce:37:ad:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f5:ce:37:ad:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:ce:c7:27:55:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 19:55:02.304945 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.304942    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 19:55:02.305066 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.305027    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 19:55:02.308541 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.308509    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 19:55:02.308722 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.308547    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 19:55:02.309316 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.309303    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 19:55:02.309374 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.309320    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 19:55:02.309374 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.309332    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 19:55:02.310020 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.310008    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 19:55:02.310947 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.310936    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 19:55:02.314806 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.314787    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 19:55:02.314940 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.314920    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 19:55:02.314984 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.314943    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 19:55:02.314984 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.314972    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 19:55:02.315047 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.314985    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 19:55:02.315047 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.315005    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 19:55:02.315047 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.315017    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 09 19:55:02.315047 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.315028    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 19:55:02.315419 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.315408    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 19:55:02.315457 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.315426    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 19:55:02.318588 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.318551    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 19:55:02.321025 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.320651    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 19:55:02.321085 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.321041    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 19:55:02.322298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322285    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 19:55:02.322343 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322306    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 19:55:02.322343 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322314    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 19:55:02.322343 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322319    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 19:55:02.322343 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322329    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 19:55:02.322343 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322334    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 19:55:02.322512 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322348    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 19:55:02.322512 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322353    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 19:55:02.322512 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322361    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 19:55:02.322512 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322366    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 19:55:02.322512 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322375    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 19:55:02.322512 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.322380    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 19:55:02.323261 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.323246    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 19:55:02.323261 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.323258    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 19:55:02.325490 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.325457    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-182.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 19:55:02.325541 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.325505    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 19:55:02.325541 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.325506    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 19:55:02.327348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.327334    2577 server.go:1268] "Started kubelet"
Sep 09 19:55:02.327452 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.327414    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 19:55:02.327546 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.327490    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 19:55:02.327623 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.327607    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 19:55:02.328203 ip-10-0-128-182 systemd[1]: Started Kubernetes Kubelet.
Sep 09 19:55:02.328940 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.328920    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 19:55:02.329158 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.329018    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 19:55:02.333805 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.333773    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 19:55:02.338906 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.338884    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 19:55:02.339454 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.339437    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 19:55:02.339919 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.339897    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:02.340379 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.340365    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 19:55:02.340485 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.340457    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 19:55:02.340633 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.340623    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 19:55:02.340804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.340794    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 19:55:02.340902 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.340886    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 19:55:02.341097 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.341078    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 19:55:02.341148 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.341101    2577 factory.go:55] Registering systemd factory
Sep 09 19:55:02.341148 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.341111    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 09 19:55:02.341371 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.341359    2577 factory.go:153] Registering CRI-O factory
Sep 09 19:55:02.341423 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.341375    2577 factory.go:223] Registration of the crio container factory successfully
Sep 09 19:55:02.341423 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.341392    2577 factory.go:103] Registering Raw factory
Sep 09 19:55:02.341423 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.341407    2577 manager.go:1196] Started watching for new ooms in manager
Sep 09 19:55:02.341833 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.341810    2577 manager.go:349] Starting recovery of all containers
Sep 09 19:55:02.345804 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.345777    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 19:55:02.345905 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.345843    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 19:55:02.347193 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.345936    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-182.ec2.internal.18d3bf32e62e95ea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-182.ec2.internal,UID:ip-10-0-128-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-182.ec2.internal,},FirstTimestamp:2026-09-09 19:55:02.32730161 +0000 UTC m=+0.377446684,LastTimestamp:2026-09-09 19:55:02.32730161 +0000 UTC m=+0.377446684,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-182.ec2.internal,}"
Sep 09 19:55:02.352500 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.352460    2577 manager.go:354] Recovery completed
Sep 09 19:55:02.357031 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.357019    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 19:55:02.359033 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.359017    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 19:55:02.359094 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.359045    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 19:55:02.359094 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.359055    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientPID"
Sep 09 19:55:02.359624 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.359611    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 19:55:02.359624 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.359622    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 19:55:02.359752 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.359628    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 19:55:02.359752 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.359638    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 19:55:02.360378 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.360358    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 19:55:02.360507 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.360390    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 19:55:02.360507 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.360402    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientPID"
Sep 09 19:55:02.361064 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.361050    2577 policy_none.go:49] "None policy: Start"
Sep 09 19:55:02.361134 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.361070    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 19:55:02.361134 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.361083    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 19:55:02.361541 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.361435    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-182.ec2.internal.18d3bf32e812bdc4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-182.ec2.internal,UID:ip-10-0-128-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-182.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-182.ec2.internal,},FirstTimestamp:2026-09-09 19:55:02.359031236 +0000 UTC m=+0.409176309,LastTimestamp:2026-09-09 19:55:02.359031236 +0000 UTC m=+0.409176309,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-182.ec2.internal,}"
Sep 09 19:55:02.362442 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.362430    2577 policy_none.go:47] "Start"
Sep 09 19:55:02.368518 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.368495    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zc7zt"
Sep 09 19:55:02.372022 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.371951    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-182.ec2.internal.18d3bf32e81304f6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-182.ec2.internal,UID:ip-10-0-128-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-182.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-182.ec2.internal,},FirstTimestamp:2026-09-09 19:55:02.359049462 +0000 UTC m=+0.409194537,LastTimestamp:2026-09-09 19:55:02.359049462 +0000 UTC m=+0.409194537,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-182.ec2.internal,}"
Sep 09 19:55:02.380233 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.380215    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zc7zt"
Sep 09 19:55:02.382455 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.382308    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-182.ec2.internal.18d3bf32e813294e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-182.ec2.internal,UID:ip-10-0-128-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-182.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-182.ec2.internal,},FirstTimestamp:2026-09-09 19:55:02.359058766 +0000 UTC m=+0.409203840,LastTimestamp:2026-09-09 19:55:02.359058766 +0000 UTC m=+0.409203840,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-182.ec2.internal,}"
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.405233    2577 manager.go:337] "Starting Device Plugin manager"
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.405359    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.405371    2577 server.go:87] "Starting device plugin registration server"
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.405617    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.405626    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.405917    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.405998    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.406007    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.406504    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 19:55:02.411165 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.406572    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:02.438218 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.438181    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 19:55:02.440161 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.440142    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 19:55:02.440255 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.440194    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 19:55:02.440255 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.440214    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 19:55:02.440347 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.440290    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 19:55:02.443648 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.443628    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 19:55:02.506380 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.506295    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 19:55:02.507741 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.507720    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 19:55:02.507818 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.507761    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 19:55:02.507818 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.507773    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientPID"
Sep 09 19:55:02.507818 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.507795    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.515181 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.515167    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.515232 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.515190    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-182.ec2.internal\": node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:02.531076 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.531055    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:02.540544 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.540524    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal"]
Sep 09 19:55:02.540594 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.540588    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 19:55:02.541599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.541579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07213de36b3d10e36e586e567fa23d0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal\" (UID: \"07213de36b3d10e36e586e567fa23d0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.541641 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.541613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07213de36b3d10e36e586e567fa23d0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal\" (UID: \"07213de36b3d10e36e586e567fa23d0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.542009 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.541992    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 19:55:02.542074 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.542019    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 19:55:02.542074 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.542030    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientPID"
Sep 09 19:55:02.543395 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.543384    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 19:55:02.543553 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.543537    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.543593 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.543570    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 19:55:02.544251 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.544234    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 19:55:02.544365 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.544264    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 19:55:02.544365 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.544276    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientPID"
Sep 09 19:55:02.544365 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.544323    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 19:55:02.544365 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.544343    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 19:55:02.544365 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.544355    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientPID"
Sep 09 19:55:02.545618 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.545602    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.545706 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.545633    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 19:55:02.546351 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.546333    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 19:55:02.546422 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.546356    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 19:55:02.546422 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.546366    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeHasSufficientPID"
Sep 09 19:55:02.571190 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.571161    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-182.ec2.internal\" not found" node="ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.575649 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.575635    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-182.ec2.internal\" not found" node="ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.631554 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.631518    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:02.642429 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.642406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07213de36b3d10e36e586e567fa23d0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal\" (UID: \"07213de36b3d10e36e586e567fa23d0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.642510 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.642435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07213de36b3d10e36e586e567fa23d0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal\" (UID: \"07213de36b3d10e36e586e567fa23d0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.642510 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.642457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/904bc9f88e13bb5338c5d8bd66a5e7ec-config\") pod \"kube-apiserver-proxy-ip-10-0-128-182.ec2.internal\" (UID: \"904bc9f88e13bb5338c5d8bd66a5e7ec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.642583 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.642533    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07213de36b3d10e36e586e567fa23d0b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal\" (UID: \"07213de36b3d10e36e586e567fa23d0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.642583 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.642549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07213de36b3d10e36e586e567fa23d0b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal\" (UID: \"07213de36b3d10e36e586e567fa23d0b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.732084 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.732046    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:02.743458 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.743430    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/904bc9f88e13bb5338c5d8bd66a5e7ec-config\") pod \"kube-apiserver-proxy-ip-10-0-128-182.ec2.internal\" (UID: \"904bc9f88e13bb5338c5d8bd66a5e7ec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.743552 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.743385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/904bc9f88e13bb5338c5d8bd66a5e7ec-config\") pod \"kube-apiserver-proxy-ip-10-0-128-182.ec2.internal\" (UID: \"904bc9f88e13bb5338c5d8bd66a5e7ec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.832862 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.832780    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:02.873190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.873163    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.880102 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:02.880087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:02.933850 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:02.933813    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:03.034354 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.034307    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:03.134889 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.134821    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-182.ec2.internal\" not found"
Sep 09 19:55:03.168839 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.168815    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 19:55:03.200981 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.200959    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 19:55:03.241513 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.241492    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:03.253662 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.253645    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 19:55:03.254698 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.254685    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal"
Sep 09 19:55:03.263732 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.263716    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 19:55:03.277874 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.277857    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 19:55:03.277991 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.277975    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 19:55:03.278026 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.277982    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 19:55:03.278026 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.277977    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 19:55:03.316199 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.316162    2577 apiserver.go:52] "Watching apiserver"
Sep 09 19:55:03.327042 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.327021    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 19:55:03.327402 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.327382    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-7h8j2","kube-system/global-pull-secret-syncer-4q5g4","kube-system/konnectivity-agent-gttr6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9","openshift-cluster-node-tuning-operator/tuned-wt7sp","openshift-dns/node-resolver-qdtq8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal","openshift-multus/multus-cdk2z","openshift-multus/network-metrics-daemon-dbvkj","kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal","openshift-image-registry/node-ca-hqxw8","openshift-multus/multus-additional-cni-plugins-fkxfj","openshift-network-diagnostics/network-check-target-f4k29","openshift-network-operator/iptables-alerter-lbk66"]
Sep 09 19:55:03.329024 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.329008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.330187 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.330166    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.330298 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.330276    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:03.331001 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.330982    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 19:55:03.331111 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.330982    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 19:55:03.331111 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.331101    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 19:55:03.331242 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.331221    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 19:55:03.331315 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.331287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p59rt\""
Sep 09 19:55:03.331315 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.331305    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 19:55:03.331459 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.331446    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 19:55:03.331578 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.331564    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:03.333920 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.333158    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.334504 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.334483    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 19:55:03.334791 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.334768    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bh682\""
Sep 09 19:55:03.334915 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.334897    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 19:55:03.335334 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.335315    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.335949 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.335913    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 19:55:03.336038 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.335945    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 19:55:03.336816 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.336780    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4lr57\""
Sep 09 19:55:03.336999 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.336983    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 19:55:03.337887 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.337868    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 19:55:03.337973 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.337944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.338076 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.338059    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k4v5g\""
Sep 09 19:55:03.338202 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.338185    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 19:55:03.339030 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.339015    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 19:55:03.339108 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.339031    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.339618 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.339602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l8k4n\""
Sep 09 19:55:03.339837 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.339826    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 19:55:03.340022 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.340007    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 19:55:03.340210 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.340196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:03.340263 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.340253    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:03.340712 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.340699    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 19:55:03.340955 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.340942    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 19:55:03.341012 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.340954    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 19:55:03.341169 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.341156    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 19:55:03.341339 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.341324    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2jq8f\""
Sep 09 19:55:03.341488 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.341458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.342817 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.342803    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.343144 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.343129    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 19:55:03.343303 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.343289    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 19:55:03.343393 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.343379    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 19:55:03.343437 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.343379    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pc922\""
Sep 09 19:55:03.344082 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.344064    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:03.344212 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.344120    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:03.344295 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.344280    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 19:55:03.344633 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.344604    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 19:55:03.344732 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.344672    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6dhsg\""
Sep 09 19:55:03.345216 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.345198    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.346875 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.346857    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 19:55:03.347121 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347073    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 19:55:03.347226 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9077078-4773-47ab-8080-cdcc7b94f4e9-tmp-dir\") pod \"node-resolver-qdtq8\" (UID: \"c9077078-4773-47ab-8080-cdcc7b94f4e9\") " pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.347226 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-run-openvswitch\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.347342 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-run-k8s-cni-cncf-io\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.347342 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-var-lib-cni-multus\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.347342 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347289    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-run-multus-certs\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.347342 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347304    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 19:55:03.347342 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72906567-38dc-4a1e-b887-c6d2da4d3917-konnectivity-ca\") pod \"konnectivity-agent-gttr6\" (UID: \"72906567-38dc-4a1e-b887-c6d2da4d3917\") " pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:03.347342 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347321    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wlkmr\""
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-socket-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9077078-4773-47ab-8080-cdcc7b94f4e9-hosts-file\") pod \"node-resolver-qdtq8\" (UID: \"c9077078-4773-47ab-8080-cdcc7b94f4e9\") " pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-cni-bin\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bscx4\" (UniqueName: \"kubernetes.io/projected/96493eca-d587-406b-9d39-a5e0dd8594dc-kube-api-access-bscx4\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6fafc35-09fa-4a2b-8a00-511938ca5f48-ovnkube-config\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-cni-binary-copy\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347585    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-var-lib-kubelet\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9vx\" (UniqueName: \"kubernetes.io/projected/c9077078-4773-47ab-8080-cdcc7b94f4e9-kube-api-access-7c9vx\") pod \"node-resolver-qdtq8\" (UID: \"c9077078-4773-47ab-8080-cdcc7b94f4e9\") " pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tljhj\" (UniqueName: \"kubernetes.io/projected/b0ea2929-722b-472c-ab75-2bd456540d9a-kube-api-access-tljhj\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-etc-openvswitch\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.347654 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44c947ed-7f54-435e-a325-bc76db2aa6e2-dbus\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-device-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-lib-modules\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-cnibin\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347745    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-run\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-cni-netd\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-slash\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-kubernetes\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-var-lib-kubelet\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-cni-dir\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-run-netns\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347898    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-conf-dir\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72906567-38dc-4a1e-b887-c6d2da4d3917-agent-certs\") pod \"konnectivity-agent-gttr6\" (UID: \"72906567-38dc-4a1e-b887-c6d2da4d3917\") " pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.347988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-modprobe-d\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-systemd-units\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-node-log\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.348190 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-log-socket\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6fafc35-09fa-4a2b-8a00-511938ca5f48-ovn-node-metrics-cert\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-var-lib-cni-bin\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-daemon-config\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47wkp\" (UniqueName: \"kubernetes.io/projected/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-kube-api-access-47wkp\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-registration-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96493eca-d587-406b-9d39-a5e0dd8594dc-tmp\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-etc-selinux\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-sys-fs\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6fafc35-09fa-4a2b-8a00-511938ca5f48-env-overrides\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c951ba96-23fb-403a-b91d-e894f18cfc8f-host\") pod \"node-ca-hqxw8\" (UID: \"c951ba96-23fb-403a-b91d-e894f18cfc8f\") " pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-run-ovn\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbx8r\" (UniqueName: \"kubernetes.io/projected/b6fafc35-09fa-4a2b-8a00-511938ca5f48-kube-api-access-xbx8r\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-host\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-run-ovn-kubernetes\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5xk7\" (UniqueName: \"kubernetes.io/projected/d0bdea7a-40e7-4d07-80af-a66a93254c05-kube-api-access-f5xk7\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.349147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-sysctl-conf\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348521    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-run-netns\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348535    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-var-lib-openvswitch\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-systemd\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-kubelet\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-run-systemd\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-socket-dir-parent\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-hostroot\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348678    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-etc-kubernetes\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m2zt\" (UniqueName: \"kubernetes.io/projected/c951ba96-23fb-403a-b91d-e894f18cfc8f-kube-api-access-8m2zt\") pod \"node-ca-hqxw8\" (UID: \"c951ba96-23fb-403a-b91d-e894f18cfc8f\") " pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6fafc35-09fa-4a2b-8a00-511938ca5f48-ovnkube-script-lib\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-sys\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-tuned\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c951ba96-23fb-403a-b91d-e894f18cfc8f-serviceca\") pod \"node-ca-hqxw8\" (UID: \"c951ba96-23fb-403a-b91d-e894f18cfc8f\") " pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-system-cni-dir\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.349622 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-sysconfig\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.350077 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44c947ed-7f54-435e-a325-bc76db2aa6e2-kubelet-config\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.350077 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.348838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-sysctl-d\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.350077 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.349249    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 19:55:03.376051 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.376033    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dll5t"
Sep 09 19:55:03.384521 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.384505    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dll5t"
Sep 09 19:55:03.384590 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.384522    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 19:55:03.385291 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.385241    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 19:50:03 +0000 UTC" deadline="2028-05-01 05:07:13.300530704 +0000 UTC"
Sep 09 19:55:03.385291 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.385272    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14385h12m9.915261012s"
Sep 09 19:55:03.441699 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.441680    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 19:55:03.448981 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.448960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c951ba96-23fb-403a-b91d-e894f18cfc8f-serviceca\") pod \"node-ca-hqxw8\" (UID: \"c951ba96-23fb-403a-b91d-e894f18cfc8f\") " pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.449073 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.448988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.449073 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-system-cni-dir\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.449073 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-sysconfig\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.449073 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44c947ed-7f54-435e-a325-bc76db2aa6e2-kubelet-config\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-system-cni-dir\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449137    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44c947ed-7f54-435e-a325-bc76db2aa6e2-kubelet-config\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-sysctl-d\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-sysconfig\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c19fb1b-fe26-4be2-ab6a-aab24665d904-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9077078-4773-47ab-8080-cdcc7b94f4e9-tmp-dir\") pod \"node-resolver-qdtq8\" (UID: \"c9077078-4773-47ab-8080-cdcc7b94f4e9\") " pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-run-openvswitch\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449248    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-sysctl-d\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.449281 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449269    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-run-openvswitch\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-run-k8s-cni-cncf-io\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-var-lib-cni-multus\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449370    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-run-k8s-cni-cncf-io\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-run-multus-certs\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-run-multus-certs\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72906567-38dc-4a1e-b887-c6d2da4d3917-konnectivity-ca\") pod \"konnectivity-agent-gttr6\" (UID: \"72906567-38dc-4a1e-b887-c6d2da4d3917\") " pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c951ba96-23fb-403a-b91d-e894f18cfc8f-serviceca\") pod \"node-ca-hqxw8\" (UID: \"c951ba96-23fb-403a-b91d-e894f18cfc8f\") " pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449434    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-socket-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-var-lib-cni-multus\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449462    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9077078-4773-47ab-8080-cdcc7b94f4e9-hosts-file\") pod \"node-resolver-qdtq8\" (UID: \"c9077078-4773-47ab-8080-cdcc7b94f4e9\") " pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449500    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-cni-bin\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bscx4\" (UniqueName: \"kubernetes.io/projected/96493eca-d587-406b-9d39-a5e0dd8594dc-kube-api-access-bscx4\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4372d0b8-fe33-401f-957a-ce20f16ef750-iptables-alerter-script\") pod \"iptables-alerter-lbk66\" (UID: \"4372d0b8-fe33-401f-957a-ce20f16ef750\") " pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjnqk\" (UniqueName: \"kubernetes.io/projected/4372d0b8-fe33-401f-957a-ce20f16ef750-kube-api-access-jjnqk\") pod \"iptables-alerter-lbk66\" (UID: \"4372d0b8-fe33-401f-957a-ce20f16ef750\") " pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449576    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-cni-bin\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9077078-4773-47ab-8080-cdcc7b94f4e9-hosts-file\") pod \"node-resolver-qdtq8\" (UID: \"c9077078-4773-47ab-8080-cdcc7b94f4e9\") " pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.449804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449659    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6fafc35-09fa-4a2b-8a00-511938ca5f48-ovnkube-config\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-cni-binary-copy\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-socket-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-var-lib-kubelet\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.449844    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4372d0b8-fe33-401f-957a-ce20f16ef750-host-slash\") pod \"iptables-alerter-lbk66\" (UID: \"4372d0b8-fe33-401f-957a-ce20f16ef750\") " pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9vx\" (UniqueName: \"kubernetes.io/projected/c9077078-4773-47ab-8080-cdcc7b94f4e9-kube-api-access-7c9vx\") pod \"node-resolver-qdtq8\" (UID: \"c9077078-4773-47ab-8080-cdcc7b94f4e9\") " pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.449912    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret podName:44c947ed-7f54-435e-a325-bc76db2aa6e2 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:03.94989286 +0000 UTC m=+2.000037940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret") pod "global-pull-secret-syncer-4q5g4" (UID: "44c947ed-7f54-435e-a325-bc76db2aa6e2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449932    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-var-lib-kubelet\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tljhj\" (UniqueName: \"kubernetes.io/projected/b0ea2929-722b-472c-ab75-2bd456540d9a-kube-api-access-tljhj\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72906567-38dc-4a1e-b887-c6d2da4d3917-konnectivity-ca\") pod \"konnectivity-agent-gttr6\" (UID: \"72906567-38dc-4a1e-b887-c6d2da4d3917\") " pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.449969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-etc-openvswitch\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44c947ed-7f54-435e-a325-bc76db2aa6e2-dbus\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-device-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-lib-modules\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450062    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9077078-4773-47ab-8080-cdcc7b94f4e9-tmp-dir\") pod \"node-resolver-qdtq8\" (UID: \"c9077078-4773-47ab-8080-cdcc7b94f4e9\") " pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.450690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-etc-openvswitch\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-cnibin\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6fafc35-09fa-4a2b-8a00-511938ca5f48-ovnkube-config\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44c947ed-7f54-435e-a325-bc76db2aa6e2-dbus\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450237    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-device-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450307    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-cnibin\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-lib-modules\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-run\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-cni-netd\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-slash\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-kubernetes\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450404    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-run\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-var-lib-kubelet\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450419    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-slash\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c19fb1b-fe26-4be2-ab6a-aab24665d904-cnibin\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-kubernetes\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.451449 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450452    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-var-lib-kubelet\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-cni-netd\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-cni-dir\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-run-netns\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450533    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-conf-dir\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72906567-38dc-4a1e-b887-c6d2da4d3917-agent-certs\") pod \"konnectivity-agent-gttr6\" (UID: \"72906567-38dc-4a1e-b887-c6d2da4d3917\") " pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-modprobe-d\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-systemd-units\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450585    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-run-netns\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-conf-dir\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-cni-dir\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-node-log\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450667    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-systemd-units\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-modprobe-d\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-log-socket\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450705    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-node-log\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6fafc35-09fa-4a2b-8a00-511938ca5f48-ovn-node-metrics-cert\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450745    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-log-socket\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.452348 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450753    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-cni-binary-copy\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-var-lib-cni-bin\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-host-var-lib-cni-bin\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-daemon-config\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450827    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47wkp\" (UniqueName: \"kubernetes.io/projected/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-kube-api-access-47wkp\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c19fb1b-fe26-4be2-ab6a-aab24665d904-system-cni-dir\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.450979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-registration-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96493eca-d587-406b-9d39-a5e0dd8594dc-tmp\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c19fb1b-fe26-4be2-ab6a-aab24665d904-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c19fb1b-fe26-4be2-ab6a-aab24665d904-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-etc-selinux\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-sys-fs\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6fafc35-09fa-4a2b-8a00-511938ca5f48-env-overrides\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c951ba96-23fb-403a-b91d-e894f18cfc8f-host\") pod \"node-ca-hqxw8\" (UID: \"c951ba96-23fb-403a-b91d-e894f18cfc8f\") " pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-run-ovn\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-daemon-config\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.453099 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbx8r\" (UniqueName: \"kubernetes.io/projected/b6fafc35-09fa-4a2b-8a00-511938ca5f48-kube-api-access-xbx8r\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451298    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-etc-selinux\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-host\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-run-ovn-kubernetes\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-registration-dir\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451378    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-run-ovn\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0bdea7a-40e7-4d07-80af-a66a93254c05-sys-fs\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c951ba96-23fb-403a-b91d-e894f18cfc8f-host\") pod \"node-ca-hqxw8\" (UID: \"c951ba96-23fb-403a-b91d-e894f18cfc8f\") " pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-host\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451528    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-run-ovn-kubernetes\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451598    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6fafc35-09fa-4a2b-8a00-511938ca5f48-env-overrides\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5xk7\" (UniqueName: \"kubernetes.io/projected/d0bdea7a-40e7-4d07-80af-a66a93254c05-kube-api-access-f5xk7\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-sysctl-conf\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slvdz\" (UniqueName: \"kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz\") pod \"network-check-target-f4k29\" (UID: \"a50f3dbf-6489-4d45-bca7-9630d61b593f\") " pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-run-netns\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-var-lib-openvswitch\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-run-netns\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.453642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-sysctl-conf\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-var-lib-openvswitch\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-systemd\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq6pw\" (UniqueName: \"kubernetes.io/projected/6c19fb1b-fe26-4be2-ab6a-aab24665d904-kube-api-access-dq6pw\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.451998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452009    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-systemd\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-kubelet\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-run-systemd\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-socket-dir-parent\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-host-kubelet\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-hostroot\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-etc-kubernetes\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6fafc35-09fa-4a2b-8a00-511938ca5f48-run-systemd\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.452137    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c19fb1b-fe26-4be2-ab6a-aab24665d904-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-multus-socket-dir-parent\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-hostroot\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m2zt\" (UniqueName: \"kubernetes.io/projected/c951ba96-23fb-403a-b91d-e894f18cfc8f-kube-api-access-8m2zt\") pod \"node-ca-hqxw8\" (UID: \"c951ba96-23fb-403a-b91d-e894f18cfc8f\") " pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.454183 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-etc-kubernetes\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.452229    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 19:55:03.952212462 +0000 UTC m=+2.002357549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6fafc35-09fa-4a2b-8a00-511938ca5f48-ovnkube-script-lib\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-sys\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-tuned\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452397    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96493eca-d587-406b-9d39-a5e0dd8594dc-sys\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.452900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6fafc35-09fa-4a2b-8a00-511938ca5f48-ovnkube-script-lib\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.454093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96493eca-d587-406b-9d39-a5e0dd8594dc-tmp\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.454219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6fafc35-09fa-4a2b-8a00-511938ca5f48-ovn-node-metrics-cert\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.454312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72906567-38dc-4a1e-b887-c6d2da4d3917-agent-certs\") pod \"konnectivity-agent-gttr6\" (UID: \"72906567-38dc-4a1e-b887-c6d2da4d3917\") " pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:03.454725 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.454342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96493eca-d587-406b-9d39-a5e0dd8594dc-etc-tuned\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.457446 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.457426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bscx4\" (UniqueName: \"kubernetes.io/projected/96493eca-d587-406b-9d39-a5e0dd8594dc-kube-api-access-bscx4\") pod \"tuned-wt7sp\" (UID: \"96493eca-d587-406b-9d39-a5e0dd8594dc\") " pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.457568 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.457552    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9vx\" (UniqueName: \"kubernetes.io/projected/c9077078-4773-47ab-8080-cdcc7b94f4e9-kube-api-access-7c9vx\") pod \"node-resolver-qdtq8\" (UID: \"c9077078-4773-47ab-8080-cdcc7b94f4e9\") " pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.458296 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.458275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tljhj\" (UniqueName: \"kubernetes.io/projected/b0ea2929-722b-472c-ab75-2bd456540d9a-kube-api-access-tljhj\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:03.464337 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.464310    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47wkp\" (UniqueName: \"kubernetes.io/projected/b18b5d0f-ca1d-4e49-895f-d7f2b42761fc-kube-api-access-47wkp\") pod \"multus-cdk2z\" (UID: \"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc\") " pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.465446 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.465423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbx8r\" (UniqueName: \"kubernetes.io/projected/b6fafc35-09fa-4a2b-8a00-511938ca5f48-kube-api-access-xbx8r\") pod \"ovnkube-node-7h8j2\" (UID: \"b6fafc35-09fa-4a2b-8a00-511938ca5f48\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.465631 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.465616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5xk7\" (UniqueName: \"kubernetes.io/projected/d0bdea7a-40e7-4d07-80af-a66a93254c05-kube-api-access-f5xk7\") pod \"aws-ebs-csi-driver-node-vxmv9\" (UID: \"d0bdea7a-40e7-4d07-80af-a66a93254c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.466322 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.466303    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m2zt\" (UniqueName: \"kubernetes.io/projected/c951ba96-23fb-403a-b91d-e894f18cfc8f-kube-api-access-8m2zt\") pod \"node-ca-hqxw8\" (UID: \"c951ba96-23fb-403a-b91d-e894f18cfc8f\") " pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.553321 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553287    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvdz\" (UniqueName: \"kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz\") pod \"network-check-target-f4k29\" (UID: \"a50f3dbf-6489-4d45-bca7-9630d61b593f\") " pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:03.553321 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq6pw\" (UniqueName: \"kubernetes.io/projected/6c19fb1b-fe26-4be2-ab6a-aab24665d904-kube-api-access-dq6pw\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c19fb1b-fe26-4be2-ab6a-aab24665d904-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553380    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c19fb1b-fe26-4be2-ab6a-aab24665d904-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553404    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4372d0b8-fe33-401f-957a-ce20f16ef750-iptables-alerter-script\") pod \"iptables-alerter-lbk66\" (UID: \"4372d0b8-fe33-401f-957a-ce20f16ef750\") " pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.553599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjnqk\" (UniqueName: \"kubernetes.io/projected/4372d0b8-fe33-401f-957a-ce20f16ef750-kube-api-access-jjnqk\") pod \"iptables-alerter-lbk66\" (UID: \"4372d0b8-fe33-401f-957a-ce20f16ef750\") " pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.553599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4372d0b8-fe33-401f-957a-ce20f16ef750-host-slash\") pod \"iptables-alerter-lbk66\" (UID: \"4372d0b8-fe33-401f-957a-ce20f16ef750\") " pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.553599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c19fb1b-fe26-4be2-ab6a-aab24665d904-cnibin\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c19fb1b-fe26-4be2-ab6a-aab24665d904-system-cni-dir\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c19fb1b-fe26-4be2-ab6a-aab24665d904-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553599 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c19fb1b-fe26-4be2-ab6a-aab24665d904-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553990 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553619    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c19fb1b-fe26-4be2-ab6a-aab24665d904-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553990 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4372d0b8-fe33-401f-957a-ce20f16ef750-host-slash\") pod \"iptables-alerter-lbk66\" (UID: \"4372d0b8-fe33-401f-957a-ce20f16ef750\") " pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.553990 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c19fb1b-fe26-4be2-ab6a-aab24665d904-system-cni-dir\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553990 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c19fb1b-fe26-4be2-ab6a-aab24665d904-cnibin\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.553990 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.553968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c19fb1b-fe26-4be2-ab6a-aab24665d904-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.554232 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.554070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c19fb1b-fe26-4be2-ab6a-aab24665d904-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.554232 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.554172    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4372d0b8-fe33-401f-957a-ce20f16ef750-iptables-alerter-script\") pod \"iptables-alerter-lbk66\" (UID: \"4372d0b8-fe33-401f-957a-ce20f16ef750\") " pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.554325 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.554231    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c19fb1b-fe26-4be2-ab6a-aab24665d904-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.559521 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.559501    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 19:55:03.559521 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.559521    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 19:55:03.559698 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.559530    2577 projected.go:196] Error preparing data for projected volume kube-api-access-slvdz for pod openshift-network-diagnostics/network-check-target-f4k29: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:03.559698 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.559596    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz podName:a50f3dbf-6489-4d45-bca7-9630d61b593f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:04.059579923 +0000 UTC m=+2.109724999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-slvdz" (UniqueName: "kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz") pod "network-check-target-f4k29" (UID: "a50f3dbf-6489-4d45-bca7-9630d61b593f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:03.561740 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.561720    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjnqk\" (UniqueName: \"kubernetes.io/projected/4372d0b8-fe33-401f-957a-ce20f16ef750-kube-api-access-jjnqk\") pod \"iptables-alerter-lbk66\" (UID: \"4372d0b8-fe33-401f-957a-ce20f16ef750\") " pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.561817 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.561802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq6pw\" (UniqueName: \"kubernetes.io/projected/6c19fb1b-fe26-4be2-ab6a-aab24665d904-kube-api-access-dq6pw\") pod \"multus-additional-cni-plugins-fkxfj\" (UID: \"6c19fb1b-fe26-4be2-ab6a-aab24665d904\") " pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.659618 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.659551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:03.676808 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.676780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:03.684327 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.684294    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9"
Sep 09 19:55:03.699019 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.698999    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wt7sp"
Sep 09 19:55:03.717565 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.717541    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qdtq8"
Sep 09 19:55:03.729806 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.729785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdk2z"
Sep 09 19:55:03.745016 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.744999    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hqxw8"
Sep 09 19:55:03.752156 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.752140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkxfj"
Sep 09 19:55:03.777210 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.777181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbk66"
Sep 09 19:55:03.828826 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:03.828773    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07213de36b3d10e36e586e567fa23d0b.slice/crio-bf8c7c795ebd98a25d1f165ec4a692af016ef38746ba06f44df434f1d9b00252 WatchSource:0}: Error finding container bf8c7c795ebd98a25d1f165ec4a692af016ef38746ba06f44df434f1d9b00252: Status 404 returned error can't find the container with id bf8c7c795ebd98a25d1f165ec4a692af016ef38746ba06f44df434f1d9b00252
Sep 09 19:55:03.829160 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:03.829132    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904bc9f88e13bb5338c5d8bd66a5e7ec.slice/crio-0349702120d7290144a047c9ce5a181c55c9f0c45c236a386dc42081e27788cc WatchSource:0}: Error finding container 0349702120d7290144a047c9ce5a181c55c9f0c45c236a386dc42081e27788cc: Status 404 returned error can't find the container with id 0349702120d7290144a047c9ce5a181c55c9f0c45c236a386dc42081e27788cc
Sep 09 19:55:03.829911 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:03.829890    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4372d0b8_fe33_401f_957a_ce20f16ef750.slice/crio-e2369dad0ffcc0c687211f4ec03d8d20fd4732e36fb574443bd577efe76495d5 WatchSource:0}: Error finding container e2369dad0ffcc0c687211f4ec03d8d20fd4732e36fb574443bd577efe76495d5: Status 404 returned error can't find the container with id e2369dad0ffcc0c687211f4ec03d8d20fd4732e36fb574443bd577efe76495d5
Sep 09 19:55:03.833694 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.833660    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 19:55:03.955703 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.955622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:03.955703 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:03.955661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:03.955882 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.955760    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:03.955882 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.955760    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:03.955882 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.955817    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 19:55:04.955801812 +0000 UTC m=+3.005946873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:03.955882 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:03.955830    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret podName:44c947ed-7f54-435e-a325-bc76db2aa6e2 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:04.955823706 +0000 UTC m=+3.005968767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret") pod "global-pull-secret-syncer-4q5g4" (UID: "44c947ed-7f54-435e-a325-bc76db2aa6e2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:04.049625 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:04.049597    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc951ba96_23fb_403a_b91d_e894f18cfc8f.slice/crio-b933ab3f9934a72c027ef40fb32e61b1dc9af58841e737cab485c8cf89c89969 WatchSource:0}: Error finding container b933ab3f9934a72c027ef40fb32e61b1dc9af58841e737cab485c8cf89c89969: Status 404 returned error can't find the container with id b933ab3f9934a72c027ef40fb32e61b1dc9af58841e737cab485c8cf89c89969
Sep 09 19:55:04.070872 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:04.070845    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9077078_4773_47ab_8080_cdcc7b94f4e9.slice/crio-be5db489987bac3626da9cbdd064a7def960175204d5d68afb02e9b5770ce8b2 WatchSource:0}: Error finding container be5db489987bac3626da9cbdd064a7def960175204d5d68afb02e9b5770ce8b2: Status 404 returned error can't find the container with id be5db489987bac3626da9cbdd064a7def960175204d5d68afb02e9b5770ce8b2
Sep 09 19:55:04.137635 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:04.137602    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bdea7a_40e7_4d07_80af_a66a93254c05.slice/crio-35065d2d835945122d33915d633e6672328bf9641eb16d34de9d7f5cb469e895 WatchSource:0}: Error finding container 35065d2d835945122d33915d633e6672328bf9641eb16d34de9d7f5cb469e895: Status 404 returned error can't find the container with id 35065d2d835945122d33915d633e6672328bf9641eb16d34de9d7f5cb469e895
Sep 09 19:55:04.156532 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.156503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvdz\" (UniqueName: \"kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz\") pod \"network-check-target-f4k29\" (UID: \"a50f3dbf-6489-4d45-bca7-9630d61b593f\") " pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:04.156665 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.156652    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 19:55:04.156707 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.156668    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 19:55:04.156707 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.156678    2577 projected.go:196] Error preparing data for projected volume kube-api-access-slvdz for pod openshift-network-diagnostics/network-check-target-f4k29: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:04.156773 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.156729    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz podName:a50f3dbf-6489-4d45-bca7-9630d61b593f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:05.156711327 +0000 UTC m=+3.206856389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-slvdz" (UniqueName: "kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz") pod "network-check-target-f4k29" (UID: "a50f3dbf-6489-4d45-bca7-9630d61b593f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:04.231309 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:04.231279    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c19fb1b_fe26_4be2_ab6a_aab24665d904.slice/crio-886ac9ceca728a3fa4a13261706815d5a6269d81cad918543634b2cad9072e5b WatchSource:0}: Error finding container 886ac9ceca728a3fa4a13261706815d5a6269d81cad918543634b2cad9072e5b: Status 404 returned error can't find the container with id 886ac9ceca728a3fa4a13261706815d5a6269d81cad918543634b2cad9072e5b
Sep 09 19:55:04.275069 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:04.275044    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18b5d0f_ca1d_4e49_895f_d7f2b42761fc.slice/crio-892a2160172b63eb6272c7cffd34ed9266d37fd134d6bc6d7637f8dcf077612a WatchSource:0}: Error finding container 892a2160172b63eb6272c7cffd34ed9266d37fd134d6bc6d7637f8dcf077612a: Status 404 returned error can't find the container with id 892a2160172b63eb6272c7cffd34ed9266d37fd134d6bc6d7637f8dcf077612a
Sep 09 19:55:04.388004 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.387929    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 19:50:04 +0000 UTC" deadline="2028-03-02 09:13:41.311143631 +0000 UTC"
Sep 09 19:55:04.388004 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.387994    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12949h18m36.92315241s"
Sep 09 19:55:04.412077 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.412056    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 19:55:04.441177 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.441145    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:04.441300 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.441261    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:04.441352 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.441329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:04.441469 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.441445    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:04.444975 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.444935    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9" event={"ID":"d0bdea7a-40e7-4d07-80af-a66a93254c05","Type":"ContainerStarted","Data":"35065d2d835945122d33915d633e6672328bf9641eb16d34de9d7f5cb469e895"}
Sep 09 19:55:04.446086 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.446061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qdtq8" event={"ID":"c9077078-4773-47ab-8080-cdcc7b94f4e9","Type":"ContainerStarted","Data":"be5db489987bac3626da9cbdd064a7def960175204d5d68afb02e9b5770ce8b2"}
Sep 09 19:55:04.447262 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.447242    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hqxw8" event={"ID":"c951ba96-23fb-403a-b91d-e894f18cfc8f","Type":"ContainerStarted","Data":"b933ab3f9934a72c027ef40fb32e61b1dc9af58841e737cab485c8cf89c89969"}
Sep 09 19:55:04.448638 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.448615    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbk66" event={"ID":"4372d0b8-fe33-401f-957a-ce20f16ef750","Type":"ContainerStarted","Data":"e2369dad0ffcc0c687211f4ec03d8d20fd4732e36fb574443bd577efe76495d5"}
Sep 09 19:55:04.449726 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.449707    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal" event={"ID":"07213de36b3d10e36e586e567fa23d0b","Type":"ContainerStarted","Data":"bf8c7c795ebd98a25d1f165ec4a692af016ef38746ba06f44df434f1d9b00252"}
Sep 09 19:55:04.450900 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.450880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal" event={"ID":"904bc9f88e13bb5338c5d8bd66a5e7ec","Type":"ContainerStarted","Data":"0349702120d7290144a047c9ce5a181c55c9f0c45c236a386dc42081e27788cc"}
Sep 09 19:55:04.452127 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.452108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdk2z" event={"ID":"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc","Type":"ContainerStarted","Data":"892a2160172b63eb6272c7cffd34ed9266d37fd134d6bc6d7637f8dcf077612a"}
Sep 09 19:55:04.453222 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.453206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkxfj" event={"ID":"6c19fb1b-fe26-4be2-ab6a-aab24665d904","Type":"ContainerStarted","Data":"886ac9ceca728a3fa4a13261706815d5a6269d81cad918543634b2cad9072e5b"}
Sep 09 19:55:04.595813 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:04.595778    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72906567_38dc_4a1e_b887_c6d2da4d3917.slice/crio-f8daf6623c10ed70dac76b336b05b6b6e8a5bd35ea45fc5e66261eabf9761a7c WatchSource:0}: Error finding container f8daf6623c10ed70dac76b336b05b6b6e8a5bd35ea45fc5e66261eabf9761a7c: Status 404 returned error can't find the container with id f8daf6623c10ed70dac76b336b05b6b6e8a5bd35ea45fc5e66261eabf9761a7c
Sep 09 19:55:04.679774 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:04.679737    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6fafc35_09fa_4a2b_8a00_511938ca5f48.slice/crio-24b7a6f23f71eeb3247fcce9a8c8858a8935b09b256a4e4f2d076e0d597cb5f2 WatchSource:0}: Error finding container 24b7a6f23f71eeb3247fcce9a8c8858a8935b09b256a4e4f2d076e0d597cb5f2: Status 404 returned error can't find the container with id 24b7a6f23f71eeb3247fcce9a8c8858a8935b09b256a4e4f2d076e0d597cb5f2
Sep 09 19:55:04.962156 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.962066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:04.962156 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:04.962141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:04.962389 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.962291    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:04.962389 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.962352    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret podName:44c947ed-7f54-435e-a325-bc76db2aa6e2 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:06.962337659 +0000 UTC m=+5.012482722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret") pod "global-pull-secret-syncer-4q5g4" (UID: "44c947ed-7f54-435e-a325-bc76db2aa6e2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:04.962760 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.962735    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:04.962836 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:04.962815    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 19:55:06.962795836 +0000 UTC m=+5.012940914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:05.163658 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:05.163615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvdz\" (UniqueName: \"kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz\") pod \"network-check-target-f4k29\" (UID: \"a50f3dbf-6489-4d45-bca7-9630d61b593f\") " pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:05.163860 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:05.163840    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 19:55:05.163940 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:05.163868    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 19:55:05.163940 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:05.163884    2577 projected.go:196] Error preparing data for projected volume kube-api-access-slvdz for pod openshift-network-diagnostics/network-check-target-f4k29: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:05.164058 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:05.163949    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz podName:a50f3dbf-6489-4d45-bca7-9630d61b593f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:07.163929777 +0000 UTC m=+5.214074841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-slvdz" (UniqueName: "kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz") pod "network-check-target-f4k29" (UID: "a50f3dbf-6489-4d45-bca7-9630d61b593f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:05.260949 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:05.260568    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 19:55:05.389184 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:05.389012    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 19:50:04 +0000 UTC" deadline="2028-02-11 23:55:45.123667001 +0000 UTC"
Sep 09 19:55:05.389692 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:05.389182    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12484h0m39.734489688s"
Sep 09 19:55:05.441137 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:05.440578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:05.441137 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:05.440739    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:05.465198 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:05.465149    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerStarted","Data":"24b7a6f23f71eeb3247fcce9a8c8858a8935b09b256a4e4f2d076e0d597cb5f2"}
Sep 09 19:55:05.468088 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:05.468042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gttr6" event={"ID":"72906567-38dc-4a1e-b887-c6d2da4d3917","Type":"ContainerStarted","Data":"f8daf6623c10ed70dac76b336b05b6b6e8a5bd35ea45fc5e66261eabf9761a7c"}
Sep 09 19:55:06.279655 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:06.279621    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 19:55:06.441474 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:06.441441    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:06.441968 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:06.441619    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:06.442624 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:06.442595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:06.442764 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:06.442741    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:06.988781 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:06.988742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:06.988982 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:06.988847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:06.988982 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:06.988942    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:06.988982 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:06.988977    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:06.989137 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:06.989035    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret podName:44c947ed-7f54-435e-a325-bc76db2aa6e2 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:10.989010632 +0000 UTC m=+9.039155701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret") pod "global-pull-secret-syncer-4q5g4" (UID: "44c947ed-7f54-435e-a325-bc76db2aa6e2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:06.989137 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:06.989078    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 19:55:10.989047705 +0000 UTC m=+9.039192773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:07.191220 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:07.191178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvdz\" (UniqueName: \"kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz\") pod \"network-check-target-f4k29\" (UID: \"a50f3dbf-6489-4d45-bca7-9630d61b593f\") " pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:07.191421 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:07.191340    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 19:55:07.191421 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:07.191371    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 19:55:07.191421 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:07.191386    2577 projected.go:196] Error preparing data for projected volume kube-api-access-slvdz for pod openshift-network-diagnostics/network-check-target-f4k29: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:07.191593 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:07.191440    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz podName:a50f3dbf-6489-4d45-bca7-9630d61b593f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:11.191425213 +0000 UTC m=+9.241570275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-slvdz" (UniqueName: "kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz") pod "network-check-target-f4k29" (UID: "a50f3dbf-6489-4d45-bca7-9630d61b593f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:07.440386 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:07.440315    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:07.440540 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:07.440420    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:08.441221 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:08.441161    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:08.441221 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:08.441215    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:08.441743 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:08.441351    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:08.441953 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:08.441917    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:09.441078 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:09.441030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:09.441284 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:09.441211    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:10.442722 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:10.442681    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:10.443211 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:10.442843    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:10.443211 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:10.442878    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:10.443211 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:10.443005    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:11.026774 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:11.026735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:11.026980 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:11.026797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:11.026980 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:11.026917    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:11.026980 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:11.026974    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret podName:44c947ed-7f54-435e-a325-bc76db2aa6e2 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:19.026956894 +0000 UTC m=+17.077101965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret") pod "global-pull-secret-syncer-4q5g4" (UID: "44c947ed-7f54-435e-a325-bc76db2aa6e2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:11.027170 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:11.027046    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:11.027170 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:11.027084    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 19:55:19.027070892 +0000 UTC m=+17.077215954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:11.228310 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:11.228264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvdz\" (UniqueName: \"kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz\") pod \"network-check-target-f4k29\" (UID: \"a50f3dbf-6489-4d45-bca7-9630d61b593f\") " pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:11.228533 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:11.228456    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 19:55:11.228533 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:11.228477    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 19:55:11.228533 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:11.228487    2577 projected.go:196] Error preparing data for projected volume kube-api-access-slvdz for pod openshift-network-diagnostics/network-check-target-f4k29: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:11.228679 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:11.228574    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz podName:a50f3dbf-6489-4d45-bca7-9630d61b593f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:19.228554668 +0000 UTC m=+17.278699731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-slvdz" (UniqueName: "kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz") pod "network-check-target-f4k29" (UID: "a50f3dbf-6489-4d45-bca7-9630d61b593f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:11.440846 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:11.440765    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:11.441028 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:11.440920    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:12.441401 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:12.441363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:12.441869 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:12.441542    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:12.443103 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:12.443074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:12.443220 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:12.443175    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:13.440688 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:13.440656    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:13.440874 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:13.440779    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:14.441177 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:14.441141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:14.441679 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:14.441140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:14.441679 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:14.441305    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:14.441679 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:14.441366    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:15.440693 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:15.440651    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:15.440884 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:15.440782    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:16.440712 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:16.440676    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:16.441157 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:16.440695    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:16.441157 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:16.440826    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:16.441157 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:16.440879    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:17.441043 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:17.440849    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:17.441437 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:17.441145    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:18.441461 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:18.441414    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:18.441952 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:18.441625    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:18.442030 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:18.441426    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:18.442089 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:18.442031    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:19.086941 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:19.086908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:19.087115 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:19.086972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:19.087115 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:19.087072    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:19.087115 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:19.087084    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:19.087256 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:19.087128    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret podName:44c947ed-7f54-435e-a325-bc76db2aa6e2 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:35.087110699 +0000 UTC m=+33.137255761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret") pod "global-pull-secret-syncer-4q5g4" (UID: "44c947ed-7f54-435e-a325-bc76db2aa6e2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:19.087256 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:19.087153    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 19:55:35.087134155 +0000 UTC m=+33.137279232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:19.288243 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:19.288213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvdz\" (UniqueName: \"kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz\") pod \"network-check-target-f4k29\" (UID: \"a50f3dbf-6489-4d45-bca7-9630d61b593f\") " pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:19.288418 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:19.288385    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 19:55:19.288418 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:19.288410    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 19:55:19.288614 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:19.288422    2577 projected.go:196] Error preparing data for projected volume kube-api-access-slvdz for pod openshift-network-diagnostics/network-check-target-f4k29: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:19.288614 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:19.288500    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz podName:a50f3dbf-6489-4d45-bca7-9630d61b593f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:35.288480855 +0000 UTC m=+33.338625930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-slvdz" (UniqueName: "kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz") pod "network-check-target-f4k29" (UID: "a50f3dbf-6489-4d45-bca7-9630d61b593f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 19:55:19.440744 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:19.440657    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:19.440903 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:19.440777    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:20.441123 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:20.441086    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:20.441496 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:20.441240    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:20.441496 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:20.441290    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:20.441496 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:20.441438    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:21.441510 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.441185    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:21.442158 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:21.441528    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:21.513996 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.513954    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal" event={"ID":"904bc9f88e13bb5338c5d8bd66a5e7ec","Type":"ContainerStarted","Data":"b5676cbf1fe4b92d2fc965783179b6c2c6bd2e29e6ad9b561ac8e6f8330afd4a"}
Sep 09 19:55:21.533710 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.533676    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 19:55:21.534660 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.534627    2577 generic.go:356] "Generic (PLEG): container finished" podID="b6fafc35-09fa-4a2b-8a00-511938ca5f48" containerID="d5a4a9da210d99b562648486419f3397325ec86960013c15cd9687ad3ad5b9c7" exitCode=1
Sep 09 19:55:21.534791 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.534727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerStarted","Data":"727f4c9ad9e93f35133ad90b99b82e8287d9bca698b7738633355e303cb6deff"}
Sep 09 19:55:21.534854 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.534811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerStarted","Data":"b4af1db82cb73a55018d15c64aab00c9526c4a0935096e60357664730889da6a"}
Sep 09 19:55:21.534908 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.534865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerStarted","Data":"224e29622d5a3a838ab357f225500f8aefb7ab197b45c885a822abcde7376693"}
Sep 09 19:55:21.534960 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.534913    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerStarted","Data":"d19700b9e902126e4728743eeea7b3065eb5cd6289794c81d4a84f6ce073a778"}
Sep 09 19:55:21.535009 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.534963    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerDied","Data":"d5a4a9da210d99b562648486419f3397325ec86960013c15cd9687ad3ad5b9c7"}
Sep 09 19:55:21.535060 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.535010    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerStarted","Data":"e214b194d9fd2a80896e59126dc7e04d77b5ffe697ca52b57866d8523a9b12fe"}
Sep 09 19:55:21.538182 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.537872    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-182.ec2.internal" podStartSLOduration=18.537853381 podStartE2EDuration="18.537853381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:21.537023174 +0000 UTC m=+19.587168261" watchObservedRunningTime="2026-09-09 19:55:21.537853381 +0000 UTC m=+19.587998465"
Sep 09 19:55:21.541647 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.541577    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdk2z" event={"ID":"b18b5d0f-ca1d-4e49-895f-d7f2b42761fc","Type":"ContainerStarted","Data":"f19a17d4b284e58a890e6ec29ad35db2ef92f2d310a9ac214dc1dfbb3c489e3c"}
Sep 09 19:55:21.549029 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:21.548951    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wt7sp" event={"ID":"96493eca-d587-406b-9d39-a5e0dd8594dc","Type":"ContainerStarted","Data":"a73229619053bb037ad1456305b0079deb09c8529ae28412b620067dc1fa82fd"}
Sep 09 19:55:22.441713 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.441514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:22.442057 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.441551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:22.442057 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:22.441823    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:22.442057 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:22.441895    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:22.539195 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.539167    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 19:55:22.552448 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.552412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qdtq8" event={"ID":"c9077078-4773-47ab-8080-cdcc7b94f4e9","Type":"ContainerStarted","Data":"4776369de4aa31ecfc76d19badd1a1a91178cc8b9f7b842bb27b2901da8b7149"}
Sep 09 19:55:22.555096 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.555061    2577 generic.go:356] "Generic (PLEG): container finished" podID="07213de36b3d10e36e586e567fa23d0b" containerID="580caf6a24586d4e3e3358f85332c56ec32a77601460c52544b75658166aa8e5" exitCode=0
Sep 09 19:55:22.555188 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.555097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal" event={"ID":"07213de36b3d10e36e586e567fa23d0b","Type":"ContainerDied","Data":"580caf6a24586d4e3e3358f85332c56ec32a77601460c52544b75658166aa8e5"}
Sep 09 19:55:22.557086 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.557060    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c19fb1b-fe26-4be2-ab6a-aab24665d904" containerID="7305bb54d9aac7ab05a53f2c4c4d04abda3cf8a54a17a79a47dffc729da1e0c1" exitCode=0
Sep 09 19:55:22.557178 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.557144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkxfj" event={"ID":"6c19fb1b-fe26-4be2-ab6a-aab24665d904","Type":"ContainerDied","Data":"7305bb54d9aac7ab05a53f2c4c4d04abda3cf8a54a17a79a47dffc729da1e0c1"}
Sep 09 19:55:22.560296 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.560266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9" event={"ID":"d0bdea7a-40e7-4d07-80af-a66a93254c05","Type":"ContainerStarted","Data":"011e33e884a069dfb50d5b5aa4b305d0198d071a39b5b22b990ddeac74703983"}
Sep 09 19:55:22.560390 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.560325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9" event={"ID":"d0bdea7a-40e7-4d07-80af-a66a93254c05","Type":"ContainerStarted","Data":"cd3327d510df203b90301edc80d502d26b57078c6a1aa17feec63b0449976ede"}
Sep 09 19:55:22.563385 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.563364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hqxw8" event={"ID":"c951ba96-23fb-403a-b91d-e894f18cfc8f","Type":"ContainerStarted","Data":"04385d775540d09dda2593b2d08af124b732946bacc33c5f13c307d90b0908ea"}
Sep 09 19:55:22.565033 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.565011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbk66" event={"ID":"4372d0b8-fe33-401f-957a-ce20f16ef750","Type":"ContainerStarted","Data":"a213901ca6d120ff54f8192558ffb45d3d2aa4fc16cc3daeda821adea8695572"}
Sep 09 19:55:22.567001 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.566977    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gttr6" event={"ID":"72906567-38dc-4a1e-b887-c6d2da4d3917","Type":"ContainerStarted","Data":"38b23420e7176284ef7d5fd915909556745b9d62f1b85e4a1a914239b4914da3"}
Sep 09 19:55:22.568107 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.568071    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qdtq8" podStartSLOduration=2.837892167 podStartE2EDuration="19.568060034s" totalImagesPullingTime="16.730167867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:22.567895036 +0000 UTC m=+20.618040122" watchObservedRunningTime="2026-09-09 19:55:22.568060034 +0000 UTC m=+20.618205117"
Sep 09 19:55:22.568217 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.568192    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cdk2z" podStartSLOduration=2.590827451 podStartE2EDuration="19.568184703s" totalImagesPullingTime="16.977357252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:21.56192701 +0000 UTC m=+19.612072094" watchObservedRunningTime="2026-09-09 19:55:22.568184703 +0000 UTC m=+20.618329786"
Sep 09 19:55:22.597057 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.596993    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hqxw8" podStartSLOduration=3.272418529 podStartE2EDuration="19.596975455s" totalImagesPullingTime="16.324556926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:22.596060141 +0000 UTC m=+20.646205225" watchObservedRunningTime="2026-09-09 19:55:22.596975455 +0000 UTC m=+20.647120541"
Sep 09 19:55:22.610151 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.610066    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gttr6" podStartSLOduration=3.8320534950000003 podStartE2EDuration="19.610053037s" totalImagesPullingTime="15.777999542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:22.609389519 +0000 UTC m=+20.659534603" watchObservedRunningTime="2026-09-09 19:55:22.610053037 +0000 UTC m=+20.660198177"
Sep 09 19:55:22.650523 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.650452    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lbk66" podStartSLOduration=3.108220502 podStartE2EDuration="19.650435305s" totalImagesPullingTime="16.542214803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:22.650112644 +0000 UTC m=+20.700257726" watchObservedRunningTime="2026-09-09 19:55:22.650435305 +0000 UTC m=+20.700580388"
Sep 09 19:55:22.786058 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.786009    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:22.786628 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:22.786608    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:23.421658 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:23.421539    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T19:55:22.539190761Z","UUID":"1a76a8ce-9e08-4188-9b16-a7e5c301d19a","Handler":null,"Name":"","Endpoint":""}
Sep 09 19:55:23.423066 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:23.423038    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 19:55:23.423182 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:23.423076    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 19:55:23.441233 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:23.441208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:23.441382 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:23.441323    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:23.572651 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:23.572614    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal" event={"ID":"07213de36b3d10e36e586e567fa23d0b","Type":"ContainerStarted","Data":"71bdf8a93f80d4076b9f9fae28b3443aac0b0a15e857bb83cec5625343e59b5b"}
Sep 09 19:55:23.573341 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:23.572714    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:23.573788 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:23.573764    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gttr6"
Sep 09 19:55:24.441161 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:24.441087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:24.441161 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:24.441152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:24.441527 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:24.441320    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:24.441712 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:24.441675    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:24.579133 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:24.579103    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 19:55:24.579709 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:24.579608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerStarted","Data":"7a01749ee9fbe0d0d5cf3e39886d8875f3381fcdd2c2986866f9f4c92da95164"}
Sep 09 19:55:25.440373 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:25.440335    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:25.440638 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:25.440456    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:26.441388 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:26.441152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:26.441874 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:26.441174    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:26.441874 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:26.441529    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:26.441874 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:26.441669    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:27.441322 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:27.441289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:27.441531 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:27.441400    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:28.440573 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.440390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:28.440735 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.440390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:28.440735 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:28.440678    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:28.440841 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:28.440796    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:28.589899 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.589869    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c19fb1b-fe26-4be2-ab6a-aab24665d904" containerID="6a910d95479deb3d5f628e7c55fa74000e1eaddcfc9e238d3a8bbde61f945eb6" exitCode=0
Sep 09 19:55:28.590397 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.589942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkxfj" event={"ID":"6c19fb1b-fe26-4be2-ab6a-aab24665d904","Type":"ContainerDied","Data":"6a910d95479deb3d5f628e7c55fa74000e1eaddcfc9e238d3a8bbde61f945eb6"}
Sep 09 19:55:28.592300 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.592278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9" event={"ID":"d0bdea7a-40e7-4d07-80af-a66a93254c05","Type":"ContainerStarted","Data":"6fba7ac6b99252a3546ebf7b3ac404b052639c4110d945785759f770e8db5b29"}
Sep 09 19:55:28.596219 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.596201    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 19:55:28.596678 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.596657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerStarted","Data":"d2e3c6f4dfd55d621ceac69b996028b9ae290b55d3703c8de4ad6a590bc10143"}
Sep 09 19:55:28.596923 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.596874    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:28.596995 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.596932    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:28.596995 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.596985    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:28.597103 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.597036    2577 scope.go:117] "RemoveContainer" containerID="d5a4a9da210d99b562648486419f3397325ec86960013c15cd9687ad3ad5b9c7"
Sep 09 19:55:28.600856 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.600832    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wt7sp" event={"ID":"96493eca-d587-406b-9d39-a5e0dd8594dc","Type":"ContainerStarted","Data":"2889721e46a18dc8345d3db5faa82e2bd1ccc5eb2e60d5d23e949cb72761a885"}
Sep 09 19:55:28.614330 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.614187    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-182.ec2.internal" podStartSLOduration=25.614169060000002 podStartE2EDuration="25.61416906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:23.603437016 +0000 UTC m=+21.653582100" watchObservedRunningTime="2026-09-09 19:55:28.61416906 +0000 UTC m=+26.664314144"
Sep 09 19:55:28.616037 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.616015    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:28.617020 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.616987    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:55:28.660409 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.660371    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vxmv9" podStartSLOduration=2.898719842 podStartE2EDuration="25.660356932s" totalImagesPullingTime="22.76163709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:28.660163084 +0000 UTC m=+26.710308166" watchObservedRunningTime="2026-09-09 19:55:28.660356932 +0000 UTC m=+26.710502014"
Sep 09 19:55:28.677591 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:28.677547    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wt7sp" podStartSLOduration=18.574740595 podStartE2EDuration="25.677533246s" totalImagesPullingTime="7.102792651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:28.677222636 +0000 UTC m=+26.727367719" watchObservedRunningTime="2026-09-09 19:55:28.677533246 +0000 UTC m=+26.727678329"
Sep 09 19:55:29.441045 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:29.440993    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:29.441182 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:29.441131    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:29.607158 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:29.607130    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 19:55:29.607807 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:29.607557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" event={"ID":"b6fafc35-09fa-4a2b-8a00-511938ca5f48","Type":"ContainerStarted","Data":"248deb0193583fb08946328df535b6a322d158f459daabe522c3cd157334a9c3"}
Sep 09 19:55:29.638345 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:29.638304    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2" podStartSLOduration=10.521211971 podStartE2EDuration="26.638286735s" totalImagesPullingTime="16.117074764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:29.637124166 +0000 UTC m=+27.687269262" watchObservedRunningTime="2026-09-09 19:55:29.638286735 +0000 UTC m=+27.688431818"
Sep 09 19:55:30.056600 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:30.056425    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dbvkj"]
Sep 09 19:55:30.056874 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:30.056644    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:30.056874 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:30.056763    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:30.057346 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:30.057317    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4q5g4"]
Sep 09 19:55:30.057494 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:30.057440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:30.057573 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:30.057549    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:30.058292 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:30.058270    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4k29"]
Sep 09 19:55:30.058384 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:30.058366    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:30.058488 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:30.058451    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:30.612674 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:30.612638    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c19fb1b-fe26-4be2-ab6a-aab24665d904" containerID="b8d60cb66c3db3b570a4d6f12b28b470b8c398f2ee1d56ed5cb94d551923e270" exitCode=0
Sep 09 19:55:30.613080 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:30.612716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkxfj" event={"ID":"6c19fb1b-fe26-4be2-ab6a-aab24665d904","Type":"ContainerDied","Data":"b8d60cb66c3db3b570a4d6f12b28b470b8c398f2ee1d56ed5cb94d551923e270"}
Sep 09 19:55:31.441260 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:31.440852    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:31.441443 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:31.440974    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:31.441443 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:31.441119    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:31.441443 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:31.441389    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:31.441625 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:31.441462    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:31.441625 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:31.441547    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:31.617367 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:31.617336    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c19fb1b-fe26-4be2-ab6a-aab24665d904" containerID="60461562ea931f66e2a343aa9451f796d77ae8382eb81764b669cc3e343532d1" exitCode=0
Sep 09 19:55:31.617782 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:31.617401    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkxfj" event={"ID":"6c19fb1b-fe26-4be2-ab6a-aab24665d904","Type":"ContainerDied","Data":"60461562ea931f66e2a343aa9451f796d77ae8382eb81764b669cc3e343532d1"}
Sep 09 19:55:33.440693 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:33.440645    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:33.440693 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:33.440670    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:33.441178 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:33.440662    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:33.441178 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:33.440788    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:55:33.441178 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:33.440869    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4q5g4" podUID="44c947ed-7f54-435e-a325-bc76db2aa6e2"
Sep 09 19:55:33.441178 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:33.440983    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4k29" podUID="a50f3dbf-6489-4d45-bca7-9630d61b593f"
Sep 09 19:55:34.231394 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.231362    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-182.ec2.internal" event="NodeReady"
Sep 09 19:55:34.231574 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.231545    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 19:55:34.270832 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.270797    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75899d678-jvmfd"]
Sep 09 19:55:34.275447 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.275425    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-kf5w5"]
Sep 09 19:55:34.275589 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.275570    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.277617 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.277593    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 19:55:34.277903 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.277883    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 19:55:34.278108 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.278081    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-2cpgt"]
Sep 09 19:55:34.278108 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.278106    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 19:55:34.278420 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.278396    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6tbbl\""
Sep 09 19:55:34.278627 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.278606    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-kf5w5"
Sep 09 19:55:34.281948 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.281215    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:34.282653 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.282452    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 19:55:34.283582 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.283155    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q96l8\""
Sep 09 19:55:34.283582 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.283549    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 19:55:34.284400 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.283996    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 19:55:34.286111 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.285181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 19:55:34.286205 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.286142    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vfsnk\""
Sep 09 19:55:34.287059 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.287038    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-2cpgt"]
Sep 09 19:55:34.287726 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.287708    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-kf5w5"]
Sep 09 19:55:34.288852 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.288819    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6dthr"]
Sep 09 19:55:34.292155 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.291754    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 19:55:34.297104 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.297082    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75899d678-jvmfd"]
Sep 09 19:55:34.297207 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.297116    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-brct6"]
Sep 09 19:55:34.297261 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.297222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.299555 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.299536    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4z7jm\""
Sep 09 19:55:34.299555 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.299558    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 19:55:34.299746 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.299727    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 19:55:34.300295 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.300274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brct6"
Sep 09 19:55:34.302638 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.302619    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 19:55:34.303168 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.303146    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 19:55:34.303529 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.303511    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 19:55:34.303759 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.303719    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hd98l\""
Sep 09 19:55:34.304841 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.304822    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6dthr"]
Sep 09 19:55:34.309292 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.309079    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brct6"]
Sep 09 19:55:34.399623 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.399590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-nginx-conf\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:34.399783 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.399628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:34.399783 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.399656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-installation-pull-secrets\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.399783 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.399731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11e116db-c6b1-495b-8c10-c251e9a9b2e3-cert\") pod \"ingress-canary-brct6\" (UID: \"11e116db-c6b1-495b-8c10-c251e9a9b2e3\") " pod="openshift-ingress-canary/ingress-canary-brct6"
Sep 09 19:55:34.399931 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.399801    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngn5\" (UniqueName: \"kubernetes.io/projected/11e116db-c6b1-495b-8c10-c251e9a9b2e3-kube-api-access-tngn5\") pod \"ingress-canary-brct6\" (UID: \"11e116db-c6b1-495b-8c10-c251e9a9b2e3\") " pod="openshift-ingress-canary/ingress-canary-brct6"
Sep 09 19:55:34.399931 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.399841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-image-registry-private-configuration\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.399931 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.399863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksmp6\" (UniqueName: \"kubernetes.io/projected/c12f26b2-704f-4274-83ad-12f379929591-kube-api-access-ksmp6\") pod \"network-check-source-685456655f-kf5w5\" (UID: \"c12f26b2-704f-4274-83ad-12f379929591\") " pod="openshift-network-diagnostics/network-check-source-685456655f-kf5w5"
Sep 09 19:55:34.399931 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.399922    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n62t9\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-kube-api-access-n62t9\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.400116 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.399951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-tmp-dir\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.400116 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.400016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-config-volume\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.400116 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.400046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzw9s\" (UniqueName: \"kubernetes.io/projected/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-kube-api-access-bzw9s\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.400116 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.400073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-certificates\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.400116 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.400095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.400339 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.400121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-bound-sa-token\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.400339 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.400155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.400339 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.400181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c219f78f-2f2a-49a5-ba5e-8da22b61e858-ca-trust-extracted\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.400339 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.400205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-trusted-ca\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.501508 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-image-registry-private-configuration\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.501508 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksmp6\" (UniqueName: \"kubernetes.io/projected/c12f26b2-704f-4274-83ad-12f379929591-kube-api-access-ksmp6\") pod \"network-check-source-685456655f-kf5w5\" (UID: \"c12f26b2-704f-4274-83ad-12f379929591\") " pod="openshift-network-diagnostics/network-check-source-685456655f-kf5w5"
Sep 09 19:55:34.501508 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n62t9\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-kube-api-access-n62t9\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-tmp-dir\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-config-volume\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzw9s\" (UniqueName: \"kubernetes.io/projected/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-kube-api-access-bzw9s\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-certificates\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-bound-sa-token\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c219f78f-2f2a-49a5-ba5e-8da22b61e858-ca-trust-extracted\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-trusted-ca\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-nginx-conf\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-installation-pull-secrets\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11e116db-c6b1-495b-8c10-c251e9a9b2e3-cert\") pod \"ingress-canary-brct6\" (UID: \"11e116db-c6b1-495b-8c10-c251e9a9b2e3\") " pod="openshift-ingress-canary/ingress-canary-brct6"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngn5\" (UniqueName: \"kubernetes.io/projected/11e116db-c6b1-495b-8c10-c251e9a9b2e3-kube-api-access-tngn5\") pod \"ingress-canary-brct6\" (UID: \"11e116db-c6b1-495b-8c10-c251e9a9b2e3\") " pod="openshift-ingress-canary/ingress-canary-brct6"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.501947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-tmp-dir\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.502091 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:34.502024    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:55:34.502899 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:34.502074    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:35.002061351 +0000 UTC m=+33.052206412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:55:34.502899 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.502147    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-config-volume\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.502899 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:34.502242    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:55:34.502899 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.502267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c219f78f-2f2a-49a5-ba5e-8da22b61e858-ca-trust-extracted\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.502899 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:34.502303    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:35.002285681 +0000 UTC m=+33.052430764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:55:34.502899 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:34.502373    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:55:34.502899 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:34.502389    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:55:34.502899 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:34.502443    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:35.002426185 +0000 UTC m=+33.052571246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:55:34.502899 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.502874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-certificates\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.503272 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.502976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-nginx-conf\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:34.503272 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.503121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-trusted-ca\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.506666 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.506627    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-installation-pull-secrets\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.506666 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.506637    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-image-registry-private-configuration\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.506666 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.506657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11e116db-c6b1-495b-8c10-c251e9a9b2e3-cert\") pod \"ingress-canary-brct6\" (UID: \"11e116db-c6b1-495b-8c10-c251e9a9b2e3\") " pod="openshift-ingress-canary/ingress-canary-brct6"
Sep 09 19:55:34.517797 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.513578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n62t9\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-kube-api-access-n62t9\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.517797 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.513706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzw9s\" (UniqueName: \"kubernetes.io/projected/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-kube-api-access-bzw9s\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:34.517797 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.514199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksmp6\" (UniqueName: \"kubernetes.io/projected/c12f26b2-704f-4274-83ad-12f379929591-kube-api-access-ksmp6\") pod \"network-check-source-685456655f-kf5w5\" (UID: \"c12f26b2-704f-4274-83ad-12f379929591\") " pod="openshift-network-diagnostics/network-check-source-685456655f-kf5w5"
Sep 09 19:55:34.517797 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.514659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngn5\" (UniqueName: \"kubernetes.io/projected/11e116db-c6b1-495b-8c10-c251e9a9b2e3-kube-api-access-tngn5\") pod \"ingress-canary-brct6\" (UID: \"11e116db-c6b1-495b-8c10-c251e9a9b2e3\") " pod="openshift-ingress-canary/ingress-canary-brct6"
Sep 09 19:55:34.517797 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.515538    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-bound-sa-token\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:34.599341 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.599304    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-kf5w5"
Sep 09 19:55:34.621869 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:34.621838    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brct6"
Sep 09 19:55:35.006060 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.006026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:35.006230 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.006081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:35.006230 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.006152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:35.006230 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.006206    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:55:35.006389 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.006270    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:55:35.006389 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.006282    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:36.006260221 +0000 UTC m=+34.056405301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:55:35.006389 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.006289    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:55:35.006389 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.006289    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:55:35.006389 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.006337    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:36.006320487 +0000 UTC m=+34.056465559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:55:35.006389 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.006356    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:36.006346602 +0000 UTC m=+34.056491673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:55:35.107400 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.107364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:35.107616 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.107418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:35.107616 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.107544    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:35.107768 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.107624    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 19:56:07.107604859 +0000 UTC m=+65.157749939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 19:55:35.107768 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.107544    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:35.107768 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:35.107698    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret podName:44c947ed-7f54-435e-a325-bc76db2aa6e2 nodeName:}" failed. No retries permitted until 2026-09-09 19:56:07.107684842 +0000 UTC m=+65.157829903 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret") pod "global-pull-secret-syncer-4q5g4" (UID: "44c947ed-7f54-435e-a325-bc76db2aa6e2") : object "kube-system"/"original-pull-secret" not registered
Sep 09 19:55:35.309212 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.309172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvdz\" (UniqueName: \"kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz\") pod \"network-check-target-f4k29\" (UID: \"a50f3dbf-6489-4d45-bca7-9630d61b593f\") " pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:35.312193 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.312171    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slvdz\" (UniqueName: \"kubernetes.io/projected/a50f3dbf-6489-4d45-bca7-9630d61b593f-kube-api-access-slvdz\") pod \"network-check-target-f4k29\" (UID: \"a50f3dbf-6489-4d45-bca7-9630d61b593f\") " pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:35.440750 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.440710    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:55:35.440964 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.440760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:35.440964 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.440708    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:55:35.442942 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.442922    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 19:55:35.443620 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.443601    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 19:55:35.443715 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.443619    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbhmn\""
Sep 09 19:55:35.443715 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.443638    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cpmqx\""
Sep 09 19:55:35.461987 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.461968    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:35.769913 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.769874    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4k29"]
Sep 09 19:55:35.772778 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:35.772751    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50f3dbf_6489_4d45_bca7_9630d61b593f.slice/crio-3b63ec5bc8752dc9fe17e270db5ee6067d3bee88d5c7014e73b1c441e0a40ce6 WatchSource:0}: Error finding container 3b63ec5bc8752dc9fe17e270db5ee6067d3bee88d5c7014e73b1c441e0a40ce6: Status 404 returned error can't find the container with id 3b63ec5bc8752dc9fe17e270db5ee6067d3bee88d5c7014e73b1c441e0a40ce6
Sep 09 19:55:35.773583 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.773559    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brct6"]
Sep 09 19:55:35.774651 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:35.774629    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-kf5w5"]
Sep 09 19:55:35.776464 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:35.776440    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12f26b2_704f_4274_83ad_12f379929591.slice/crio-960b3e3eb1fa211a510b2f47fb2998de2adb7f9417008f449144b514e64c0f3e WatchSource:0}: Error finding container 960b3e3eb1fa211a510b2f47fb2998de2adb7f9417008f449144b514e64c0f3e: Status 404 returned error can't find the container with id 960b3e3eb1fa211a510b2f47fb2998de2adb7f9417008f449144b514e64c0f3e
Sep 09 19:55:35.776686 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:55:35.776664    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e116db_c6b1_495b_8c10_c251e9a9b2e3.slice/crio-5014fb2452368b6ffda03e6d8caef4bc3a1a8cd83c3042bf09acd42f00914bca WatchSource:0}: Error finding container 5014fb2452368b6ffda03e6d8caef4bc3a1a8cd83c3042bf09acd42f00914bca: Status 404 returned error can't find the container with id 5014fb2452368b6ffda03e6d8caef4bc3a1a8cd83c3042bf09acd42f00914bca
Sep 09 19:55:36.017147 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:36.017114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:36.017273 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:36.017260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:36.017338 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:36.017288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:36.017338 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:36.017287    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:55:36.017443 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:36.017346    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:55:36.017443 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:36.017365    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:38.017349672 +0000 UTC m=+36.067494746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:55:36.017443 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:36.017390    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:55:36.017443 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:36.017405    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:55:36.017443 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:36.017419    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:38.017388637 +0000 UTC m=+36.067533705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:55:36.017639 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:36.017454    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:38.017441978 +0000 UTC m=+36.067587038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:55:36.632499 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:36.632399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4k29" event={"ID":"a50f3dbf-6489-4d45-bca7-9630d61b593f","Type":"ContainerStarted","Data":"3b63ec5bc8752dc9fe17e270db5ee6067d3bee88d5c7014e73b1c441e0a40ce6"}
Sep 09 19:55:36.634248 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:36.634219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brct6" event={"ID":"11e116db-c6b1-495b-8c10-c251e9a9b2e3","Type":"ContainerStarted","Data":"5014fb2452368b6ffda03e6d8caef4bc3a1a8cd83c3042bf09acd42f00914bca"}
Sep 09 19:55:36.635485 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:36.635446    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-kf5w5" event={"ID":"c12f26b2-704f-4274-83ad-12f379929591","Type":"ContainerStarted","Data":"960b3e3eb1fa211a510b2f47fb2998de2adb7f9417008f449144b514e64c0f3e"}
Sep 09 19:55:36.639722 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:36.639068    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c19fb1b-fe26-4be2-ab6a-aab24665d904" containerID="f1f1536767c5e17149d300f3a098887777d18bb0e006faea4e9230e646af9c76" exitCode=0
Sep 09 19:55:36.639722 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:36.639128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkxfj" event={"ID":"6c19fb1b-fe26-4be2-ab6a-aab24665d904","Type":"ContainerDied","Data":"f1f1536767c5e17149d300f3a098887777d18bb0e006faea4e9230e646af9c76"}
Sep 09 19:55:37.279459 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:37.279422    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:37.358625 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:37.358592    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:37.646728 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:37.646687    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c19fb1b-fe26-4be2-ab6a-aab24665d904" containerID="d75945a3011699e330112e90e8791535d252fa8a899df0daa1d834791d389402" exitCode=0
Sep 09 19:55:37.646916 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:37.646776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkxfj" event={"ID":"6c19fb1b-fe26-4be2-ab6a-aab24665d904","Type":"ContainerDied","Data":"d75945a3011699e330112e90e8791535d252fa8a899df0daa1d834791d389402"}
Sep 09 19:55:38.036422 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:38.036381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:38.036609 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:38.036446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:38.036609 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:38.036508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:38.036719 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:38.036637    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:55:38.036719 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:38.036698    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:42.036682242 +0000 UTC m=+40.086827325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:55:38.037072 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:38.037047    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:55:38.037158 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:38.037107    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:42.037088814 +0000 UTC m=+40.087233897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:55:38.037158 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:38.037154    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:55:38.037253 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:38.037162    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:55:38.037253 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:38.037186    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:42.037179106 +0000 UTC m=+40.087324180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:55:38.654142 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:38.654105    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkxfj" event={"ID":"6c19fb1b-fe26-4be2-ab6a-aab24665d904","Type":"ContainerStarted","Data":"26bc631463364262dfbc8011fb2b51ddee579807999619e529f1abd8bea23883"}
Sep 09 19:55:38.675744 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:38.675696    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fkxfj" podStartSLOduration=7.919185255 podStartE2EDuration="35.675674953s" totalImagesPullingTime="27.756489698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:38.674750136 +0000 UTC m=+36.724895220" watchObservedRunningTime="2026-09-09 19:55:38.675674953 +0000 UTC m=+36.725820036"
Sep 09 19:55:38.798078 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:38.798040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:38.855037 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:38.855001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:39.659342 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:39.659301    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-kf5w5" event={"ID":"c12f26b2-704f-4274-83ad-12f379929591","Type":"ContainerStarted","Data":"57c80b0303f796eac83c4a46b6095fecb69e7cf3a7cae03871a498c0b25ad54a"}
Sep 09 19:55:39.661371 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:39.661340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4k29" event={"ID":"a50f3dbf-6489-4d45-bca7-9630d61b593f","Type":"ContainerStarted","Data":"3c4fcd822a16d23d3ac3fdfe6e7bee7b1bdd9fa8a14b863874c6685b218ae04f"}
Sep 09 19:55:39.661747 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:39.661728    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:55:39.675125 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:39.675078    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-kf5w5" podStartSLOduration=34.005835383 podStartE2EDuration="37.675062914s" totalImagesPullingTime="3.669227531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:39.674745989 +0000 UTC m=+37.724891072" watchObservedRunningTime="2026-09-09 19:55:39.675062914 +0000 UTC m=+37.725207998"
Sep 09 19:55:39.691320 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:39.691266    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f4k29" podStartSLOduration=33.009539753 podStartE2EDuration="36.691244906s" totalImagesPullingTime="3.681705153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:39.690799277 +0000 UTC m=+37.740944365" watchObservedRunningTime="2026-09-09 19:55:39.691244906 +0000 UTC m=+37.741389995"
Sep 09 19:55:40.508640 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:40.508607    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:40.673732 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:40.673703    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:42.072263 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:42.072234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:42.072720 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:42.072279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:42.072720 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:42.072305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:42.072720 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:42.072397    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:55:42.072720 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:42.072401    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:55:42.072720 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:42.072415    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:55:42.072720 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:42.072435    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:55:42.072720 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:42.072450    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:50.072437353 +0000 UTC m=+48.122582428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:55:42.072720 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:42.072462    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 19:55:50.072456643 +0000 UTC m=+48.122601704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:55:42.072720 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:42.072509    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 19:55:50.072490015 +0000 UTC m=+48.122635093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:55:42.590450 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:42.590412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:42.669910 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:42.669879    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brct6" event={"ID":"11e116db-c6b1-495b-8c10-c251e9a9b2e3","Type":"ContainerStarted","Data":"0859eaf15087bb900321f86f01ec739ee2b5dac97cb05bc8df2ed549134a8a79"}
Sep 09 19:55:42.684959 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:42.684911    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-brct6" podStartSLOduration=2.729061637 podStartE2EDuration="8.684896422s" totalImagesPullingTime="5.955834785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:55:42.68419005 +0000 UTC m=+40.734335134" watchObservedRunningTime="2026-09-09 19:55:42.684896422 +0000 UTC m=+40.735041502"
Sep 09 19:55:42.689660 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:42.689621    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:50.127530 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:50.127483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:55:50.127930 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:50.127547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:55:50.127930 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:50.127575    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:55:50.127930 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:50.127576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:55:50.127930 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:50.127639    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 19:56:06.127620826 +0000 UTC m=+64.177765887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:55:50.127930 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:50.127658    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:55:50.127930 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:50.127702    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:55:50.127930 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:50.127718    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:55:50.127930 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:50.127722    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 19:56:06.127707256 +0000 UTC m=+64.177852344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:55:50.127930 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:55:50.127763    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 19:56:06.127752963 +0000 UTC m=+64.177898024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:55:53.120873 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:53.120839    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:53.219408 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:53.219381    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:53.275964 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:53.275936    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:54.141424 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:54.141380    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:54.192614 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:54.192586    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:55:59.276834 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:55:59.276804    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:00.287454 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:00.287424    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:00.347516 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:00.347460    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:00.623625 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:00.623544    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h8j2"
Sep 09 19:56:00.794298 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:00.794269    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:00.854769 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:00.854736    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:04.741880 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:04.741839    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:04.842794 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:04.842756    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:06.143945 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:06.143903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:56:06.143945 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:06.143951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:56:06.144434 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:06.143977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:56:06.144434 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:06.144076    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:56:06.144434 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:06.144077    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:56:06.144434 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:06.144103    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:56:06.144434 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:06.144123    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 19:56:38.144110619 +0000 UTC m=+96.194255679 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:56:06.144434 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:06.144158    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 19:56:38.144144562 +0000 UTC m=+96.194289622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:56:06.144434 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:06.144079    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:56:06.144434 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:06.144187    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 19:56:38.144180976 +0000 UTC m=+96.194326036 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:56:07.150833 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:07.150795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:56:07.151319 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:07.150908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:56:07.153642 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:07.153621    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 19:56:07.153761 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:07.153627    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 19:56:07.161615 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:07.161592    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 19:56:07.161707 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:07.161653    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 19:57:11.161636992 +0000 UTC m=+129.211782052 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : secret "metrics-daemon-secret" not found
Sep 09 19:56:07.164022 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:07.164001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44c947ed-7f54-435e-a325-bc76db2aa6e2-original-pull-secret\") pod \"global-pull-secret-syncer-4q5g4\" (UID: \"44c947ed-7f54-435e-a325-bc76db2aa6e2\") " pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:56:07.256979 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:07.256923    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4q5g4"
Sep 09 19:56:07.529870 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:07.529802    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4q5g4"]
Sep 09 19:56:07.533203 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:56:07.533179    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c947ed_7f54_435e_a325_bc76db2aa6e2.slice/crio-8246de0d0a7a282322ef4700ffd53e3c0732868e28b2f65c93199c434bdcd010 WatchSource:0}: Error finding container 8246de0d0a7a282322ef4700ffd53e3c0732868e28b2f65c93199c434bdcd010: Status 404 returned error can't find the container with id 8246de0d0a7a282322ef4700ffd53e3c0732868e28b2f65c93199c434bdcd010
Sep 09 19:56:07.728723 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:07.728688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4q5g4" event={"ID":"44c947ed-7f54-435e-a325-bc76db2aa6e2","Type":"ContainerStarted","Data":"8246de0d0a7a282322ef4700ffd53e3c0732868e28b2f65c93199c434bdcd010"}
Sep 09 19:56:09.645393 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:09.645292    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:09.702689 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:09.702652    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:11.669255 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:11.669225    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f4k29"
Sep 09 19:56:12.743317 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:12.743285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4q5g4" event={"ID":"44c947ed-7f54-435e-a325-bc76db2aa6e2","Type":"ContainerStarted","Data":"ff32507291be6fef3bebbffc1cd973add225b331408c1154d0ad477f94f637f3"}
Sep 09 19:56:12.758814 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:12.758768    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4q5g4" podStartSLOduration=65.336806487 podStartE2EDuration="1m9.758752733s" totalImagesPullingTime="4.421946246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:56:12.758225103 +0000 UTC m=+70.808370185" watchObservedRunningTime="2026-09-09 19:56:12.758752733 +0000 UTC m=+70.808897870"
Sep 09 19:56:15.224791 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:15.224751    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:15.286148 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:15.286115    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:31.154493 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:31.154317    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:31.213666 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:31.213630    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:31.279836 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:31.279803    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:56:38.172056 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:38.171993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:56:38.172614 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:38.172079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:56:38.172614 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:56:38.172104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:56:38.172614 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:38.172178    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:56:38.172614 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:38.172189    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:56:38.172614 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:38.172204    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:56:38.172614 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:38.172204    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:56:38.172614 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:38.172262    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 19:57:42.172247365 +0000 UTC m=+160.222392426 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:56:38.172614 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:38.172274    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 19:57:42.172268624 +0000 UTC m=+160.222413686 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:56:38.172614 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:56:38.172284    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 19:57:42.172279493 +0000 UTC m=+160.222424554 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:57:04.901199 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:04.901161    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:57:05.001387 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:05.001354    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:57:11.201930 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:11.201878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:57:11.202393 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:11.202004    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 19:57:11.202393 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:11.202059    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 19:59:13.202044981 +0000 UTC m=+251.252190042 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : secret "metrics-daemon-secret" not found
Sep 09 19:57:37.287636 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:37.287594    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-75899d678-jvmfd" podUID="c219f78f-2f2a-49a5-ba5e-8da22b61e858"
Sep 09 19:57:37.307256 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:37.307232    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt" podUID="9bb964a1-a5d5-4d9c-99f7-5ad5427250f8"
Sep 09 19:57:37.315409 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:37.315383    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6dthr" podUID="722fc986-cfd8-49ad-abe7-c1ce42b9f52f"
Sep 09 19:57:37.949831 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:37.949796    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dthr"
Sep 09 19:57:37.950031 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:37.949799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:57:37.950031 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:37.949799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:57:38.450316 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:38.450280    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:57:42.220522 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:42.220450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:57:42.220522 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:42.220534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:57:42.220970 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:42.220564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:57:42.220970 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:42.220612    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:57:42.220970 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:42.220664    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:57:42.220970 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:42.220668    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:57:42.220970 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:42.220691    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:57:42.220970 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:42.220672    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 19:59:44.220657859 +0000 UTC m=+282.270802920 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:57:42.220970 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:42.220750    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:44.220735993 +0000 UTC m=+282.270881055 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:57:42.220970 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:57:42.220762    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:44.220755702 +0000 UTC m=+282.270900763 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:57:53.441122 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:57:53.441029    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:59:04.118626 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:04.118597    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:06.999375 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:06.999343    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:13.255138 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:13.255103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 19:59:13.255622 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:13.255226    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 19:59:13.255622 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:13.255292    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs podName:b0ea2929-722b-472c-ab75-2bd456540d9a nodeName:}" failed. No retries permitted until 2026-09-09 20:01:15.255275519 +0000 UTC m=+373.305420580 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs") pod "network-metrics-daemon-dbvkj" (UID: "b0ea2929-722b-472c-ab75-2bd456540d9a") : secret "metrics-daemon-secret" not found
Sep 09 19:59:33.435706 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.435619    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"]
Sep 09 19:59:33.438081 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.438059    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"]
Sep 09 19:59:33.438214 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.438177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.440451 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.440434    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"]
Sep 09 19:59:33.440563 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.440534    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:33.441590 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.441563    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jg22s\""
Sep 09 19:59:33.441690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.441641    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 19:59:33.441690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.441681    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 19:59:33.441799 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.441776    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 19:59:33.442949 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.442932    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:33.443497 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.443456    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 19:59:33.444169 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.444131    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 19:59:33.444274 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.444257    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ljhsk\""
Sep 09 19:59:33.445385 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.445366    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 09 19:59:33.445453 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.445388    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 09 19:59:33.447679 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.447660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 09 19:59:33.447780 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.447702    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 09 19:59:33.447926 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.447911    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 19:59:33.448321 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.448306    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-4dwxl\""
Sep 09 19:59:33.449928 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.449909    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 09 19:59:33.466279 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.466250    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"]
Sep 09 19:59:33.475399 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.475380    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"]
Sep 09 19:59:33.494259 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.494239    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"]
Sep 09 19:59:33.533261 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.533231    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt"]
Sep 09 19:59:33.535977 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.535962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt"
Sep 09 19:59:33.538363 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.538340    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hztbc\""
Sep 09 19:59:33.538518 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.538341    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 19:59:33.538672 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.538657    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 19:59:33.546758 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.546738    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt"]
Sep 09 19:59:33.599900 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.599868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f342115-6774-487f-b9f0-32e8ddda3db7-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-lwpq4\" (UID: \"1f342115-6774-487f-b9f0-32e8ddda3db7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.600068 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.599909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z444n\" (UniqueName: \"kubernetes.io/projected/11a12cd4-b43b-49a5-9fd4-f66f70b83793-kube-api-access-z444n\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:33.600068 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.599931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:33.600068 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.600000    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47q6z\" (UniqueName: \"kubernetes.io/projected/64129677-2c7c-4b80-8551-67556a7e947f-kube-api-access-47q6z\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:33.600068 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.600034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:33.600268 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.600084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f342115-6774-487f-b9f0-32e8ddda3db7-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-lwpq4\" (UID: \"1f342115-6774-487f-b9f0-32e8ddda3db7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.600268 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.600116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64129677-2c7c-4b80-8551-67556a7e947f-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:33.600268 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.600175    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qzhl\" (UniqueName: \"kubernetes.io/projected/1f342115-6774-487f-b9f0-32e8ddda3db7-kube-api-access-6qzhl\") pod \"kube-storage-version-migrator-operator-8d7dd4675-lwpq4\" (UID: \"1f342115-6774-487f-b9f0-32e8ddda3db7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.701364 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47q6z\" (UniqueName: \"kubernetes.io/projected/64129677-2c7c-4b80-8551-67556a7e947f-kube-api-access-47q6z\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:33.701364 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:33.701364 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f342115-6774-487f-b9f0-32e8ddda3db7-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-lwpq4\" (UID: \"1f342115-6774-487f-b9f0-32e8ddda3db7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.701663 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64129677-2c7c-4b80-8551-67556a7e947f-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:33.701663 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:33.701450    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 19:59:33.701663 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzhl\" (UniqueName: \"kubernetes.io/projected/1f342115-6774-487f-b9f0-32e8ddda3db7-kube-api-access-6qzhl\") pod \"kube-storage-version-migrator-operator-8d7dd4675-lwpq4\" (UID: \"1f342115-6774-487f-b9f0-32e8ddda3db7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.701663 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f342115-6774-487f-b9f0-32e8ddda3db7-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-lwpq4\" (UID: \"1f342115-6774-487f-b9f0-32e8ddda3db7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.701663 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:33.701586    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls podName:11a12cd4-b43b-49a5-9fd4-f66f70b83793 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:34.201565089 +0000 UTC m=+272.251710155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8z26f" (UID: "11a12cd4-b43b-49a5-9fd4-f66f70b83793") : secret "samples-operator-tls" not found
Sep 09 19:59:33.701663 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z444n\" (UniqueName: \"kubernetes.io/projected/11a12cd4-b43b-49a5-9fd4-f66f70b83793-kube-api-access-z444n\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:33.701981 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:33.701981 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjml\" (UniqueName: \"kubernetes.io/projected/114bc528-9793-4d97-ad10-b466541bd7b2-kube-api-access-hcjml\") pod \"volume-data-source-validator-695c895bd6-m2ptt\" (UID: \"114bc528-9793-4d97-ad10-b466541bd7b2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt"
Sep 09 19:59:33.701981 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:33.701811    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:33.701981 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:33.701898    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls podName:64129677-2c7c-4b80-8551-67556a7e947f nodeName:}" failed. No retries permitted until 2026-09-09 19:59:34.201874548 +0000 UTC m=+272.252019626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6jmnv" (UID: "64129677-2c7c-4b80-8551-67556a7e947f") : secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:33.702151 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.701990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f342115-6774-487f-b9f0-32e8ddda3db7-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-lwpq4\" (UID: \"1f342115-6774-487f-b9f0-32e8ddda3db7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.702203 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.702188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64129677-2c7c-4b80-8551-67556a7e947f-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:33.703632 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.703611    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:33.704061 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.704043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1f342115-6774-487f-b9f0-32e8ddda3db7-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-lwpq4\" (UID: \"1f342115-6774-487f-b9f0-32e8ddda3db7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.709411 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.709388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qzhl\" (UniqueName: \"kubernetes.io/projected/1f342115-6774-487f-b9f0-32e8ddda3db7-kube-api-access-6qzhl\") pod \"kube-storage-version-migrator-operator-8d7dd4675-lwpq4\" (UID: \"1f342115-6774-487f-b9f0-32e8ddda3db7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.712269 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.712248    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z444n\" (UniqueName: \"kubernetes.io/projected/11a12cd4-b43b-49a5-9fd4-f66f70b83793-kube-api-access-z444n\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:33.712378 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.712361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47q6z\" (UniqueName: \"kubernetes.io/projected/64129677-2c7c-4b80-8551-67556a7e947f-kube-api-access-47q6z\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:33.748214 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.748193    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"
Sep 09 19:59:33.802742 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.802713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjml\" (UniqueName: \"kubernetes.io/projected/114bc528-9793-4d97-ad10-b466541bd7b2-kube-api-access-hcjml\") pod \"volume-data-source-validator-695c895bd6-m2ptt\" (UID: \"114bc528-9793-4d97-ad10-b466541bd7b2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt"
Sep 09 19:59:33.803683 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.803656    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:33.811829 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.811806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjml\" (UniqueName: \"kubernetes.io/projected/114bc528-9793-4d97-ad10-b466541bd7b2-kube-api-access-hcjml\") pod \"volume-data-source-validator-695c895bd6-m2ptt\" (UID: \"114bc528-9793-4d97-ad10-b466541bd7b2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt"
Sep 09 19:59:33.844723 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:33.844691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt"
Sep 09 19:59:34.022486 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:34.022386    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4"]
Sep 09 19:59:34.025327 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:59:34.025300    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f342115_6774_487f_b9f0_32e8ddda3db7.slice/crio-9fd34e138e8efe1d08d426a5abb083393a224173c7a3a5f27fe5a3c501e03aee WatchSource:0}: Error finding container 9fd34e138e8efe1d08d426a5abb083393a224173c7a3a5f27fe5a3c501e03aee: Status 404 returned error can't find the container with id 9fd34e138e8efe1d08d426a5abb083393a224173c7a3a5f27fe5a3c501e03aee
Sep 09 19:59:34.112027 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:34.112001    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt"]
Sep 09 19:59:34.115030 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:59:34.115006    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114bc528_9793_4d97_ad10_b466541bd7b2.slice/crio-5527848e675e6b4fc2b4c2b4099b94379ba82c3267a95372eab7c42819849875 WatchSource:0}: Error finding container 5527848e675e6b4fc2b4c2b4099b94379ba82c3267a95372eab7c42819849875: Status 404 returned error can't find the container with id 5527848e675e6b4fc2b4c2b4099b94379ba82c3267a95372eab7c42819849875
Sep 09 19:59:34.206508 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:34.206450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:34.206728 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:34.206527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:34.206728 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:34.206609    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:34.206728 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:34.206647    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 19:59:34.206728 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:34.206682    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls podName:64129677-2c7c-4b80-8551-67556a7e947f nodeName:}" failed. No retries permitted until 2026-09-09 19:59:35.206665968 +0000 UTC m=+273.256811029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6jmnv" (UID: "64129677-2c7c-4b80-8551-67556a7e947f") : secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:34.206728 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:34.206705    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls podName:11a12cd4-b43b-49a5-9fd4-f66f70b83793 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:35.20668955 +0000 UTC m=+273.256834624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8z26f" (UID: "11a12cd4-b43b-49a5-9fd4-f66f70b83793") : secret "samples-operator-tls" not found
Sep 09 19:59:34.239445 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:34.239415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt" event={"ID":"114bc528-9793-4d97-ad10-b466541bd7b2","Type":"ContainerStarted","Data":"5527848e675e6b4fc2b4c2b4099b94379ba82c3267a95372eab7c42819849875"}
Sep 09 19:59:34.240450 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:34.240421    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4" event={"ID":"1f342115-6774-487f-b9f0-32e8ddda3db7","Type":"ContainerStarted","Data":"9fd34e138e8efe1d08d426a5abb083393a224173c7a3a5f27fe5a3c501e03aee"}
Sep 09 19:59:35.215325 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:35.215284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:35.215833 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:35.215354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:35.215833 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:35.215487    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:35.215833 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:35.215589    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls podName:64129677-2c7c-4b80-8551-67556a7e947f nodeName:}" failed. No retries permitted until 2026-09-09 19:59:37.215565915 +0000 UTC m=+275.265710981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6jmnv" (UID: "64129677-2c7c-4b80-8551-67556a7e947f") : secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:35.215833 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:35.215490    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 19:59:35.215833 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:35.215684    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls podName:11a12cd4-b43b-49a5-9fd4-f66f70b83793 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:37.215665593 +0000 UTC m=+275.265810669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8z26f" (UID: "11a12cd4-b43b-49a5-9fd4-f66f70b83793") : secret "samples-operator-tls" not found
Sep 09 19:59:36.248356 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:36.248315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4" event={"ID":"1f342115-6774-487f-b9f0-32e8ddda3db7","Type":"ContainerStarted","Data":"3bc1f2e065ebe3e9071b021868d8677e0a152901079586120a58ebf9f7233ac2"}
Sep 09 19:59:36.250072 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:36.250044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt" event={"ID":"114bc528-9793-4d97-ad10-b466541bd7b2","Type":"ContainerStarted","Data":"b3fec786273ced6ee12693c9a891c8d7c912ef3039d59363ca3ec7095f9b86e9"}
Sep 09 19:59:36.264656 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:36.264612    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4" podStartSLOduration=1.276814829 podStartE2EDuration="3.264599243s" totalImagesPullingTime="1.987784414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:59:36.263958128 +0000 UTC m=+274.314103212" watchObservedRunningTime="2026-09-09 19:59:36.264599243 +0000 UTC m=+274.314744324"
Sep 09 19:59:36.277821 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:36.277736    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-m2ptt" podStartSLOduration=1.950081594 podStartE2EDuration="3.277719802s" totalImagesPullingTime="1.327638208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:59:36.27712065 +0000 UTC m=+274.327265749" watchObservedRunningTime="2026-09-09 19:59:36.277719802 +0000 UTC m=+274.327864884"
Sep 09 19:59:36.400212 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:36.400167    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:37.230825 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.230769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:37.231043 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.230839    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:37.231043 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:37.230936    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:37.231043 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:37.230978    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 19:59:37.231043 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:37.231035    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls podName:64129677-2c7c-4b80-8551-67556a7e947f nodeName:}" failed. No retries permitted until 2026-09-09 19:59:41.231014147 +0000 UTC m=+279.281159223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6jmnv" (UID: "64129677-2c7c-4b80-8551-67556a7e947f") : secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:37.231258 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:37.231056    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls podName:11a12cd4-b43b-49a5-9fd4-f66f70b83793 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:41.231046879 +0000 UTC m=+279.281191943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8z26f" (UID: "11a12cd4-b43b-49a5-9fd4-f66f70b83793") : secret "samples-operator-tls" not found
Sep 09 19:59:37.562497 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.562446    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk"]
Sep 09 19:59:37.565949 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.565931    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk"
Sep 09 19:59:37.567835 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.567818    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 09 19:59:37.568376 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.568359    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-f6v75\""
Sep 09 19:59:37.568443 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.568381    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 09 19:59:37.576239 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.576217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk"]
Sep 09 19:59:37.576907 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.576883    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:37.634566 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.634529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9cj\" (UniqueName: \"kubernetes.io/projected/e79a23fb-cd3d-4423-9b4e-d3d7836e5838-kube-api-access-wm9cj\") pod \"migrator-fdbb8fdff-8gdlk\" (UID: \"e79a23fb-cd3d-4423-9b4e-d3d7836e5838\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk"
Sep 09 19:59:37.644641 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.644618    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:37.705598 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.705562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:37.735027 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.734988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9cj\" (UniqueName: \"kubernetes.io/projected/e79a23fb-cd3d-4423-9b4e-d3d7836e5838-kube-api-access-wm9cj\") pod \"migrator-fdbb8fdff-8gdlk\" (UID: \"e79a23fb-cd3d-4423-9b4e-d3d7836e5838\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk"
Sep 09 19:59:37.746012 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.745982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9cj\" (UniqueName: \"kubernetes.io/projected/e79a23fb-cd3d-4423-9b4e-d3d7836e5838-kube-api-access-wm9cj\") pod \"migrator-fdbb8fdff-8gdlk\" (UID: \"e79a23fb-cd3d-4423-9b4e-d3d7836e5838\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk"
Sep 09 19:59:37.875362 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:37.875265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk"
Sep 09 19:59:38.140804 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.140725    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk"]
Sep 09 19:59:38.143573 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:59:38.143545    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79a23fb_cd3d_4423_9b4e_d3d7836e5838.slice/crio-ffb573b445c296946f9e46c8fd21a2ddf27c2131c3a566ef8405863c508ee61b WatchSource:0}: Error finding container ffb573b445c296946f9e46c8fd21a2ddf27c2131c3a566ef8405863c508ee61b: Status 404 returned error can't find the container with id ffb573b445c296946f9e46c8fd21a2ddf27c2131c3a566ef8405863c508ee61b
Sep 09 19:59:38.257324 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.257282    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk" event={"ID":"e79a23fb-cd3d-4423-9b4e-d3d7836e5838","Type":"ContainerStarted","Data":"ffb573b445c296946f9e46c8fd21a2ddf27c2131c3a566ef8405863c508ee61b"}
Sep 09 19:59:38.528351 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.528273    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5l75p"]
Sep 09 19:59:38.532686 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.532664    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.534707 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.534689    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 19:59:38.534902 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.534880    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 19:59:38.534979 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.534943    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 19:59:38.535047 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.535026    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 19:59:38.535522 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.535506    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xxlzl\""
Sep 09 19:59:38.541543 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.541522    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5l75p"]
Sep 09 19:59:38.541774 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.541753    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg7pf\" (UniqueName: \"kubernetes.io/projected/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-api-access-kg7pf\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.541842 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.541785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.541842 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.541823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-crio-socket\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.541972 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.541950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-data-volume\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.542025 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.541999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.544790 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.544759    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:38.601705 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.601671    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:38.642830 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.642801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-data-volume\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.642989 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.642847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.642989 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.642878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg7pf\" (UniqueName: \"kubernetes.io/projected/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-api-access-kg7pf\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.642989 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.642896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.642989 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.642922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-crio-socket\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.643143 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:38.642993    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 19:59:38.643143 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.643008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-crio-socket\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.643143 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:38.643051    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:38.643143 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:38.643085    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:39.143065808 +0000 UTC m=+277.193210869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : configmap "kube-rbac-proxy" not found
Sep 09 19:59:38.643143 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:38.643125    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:39.143105253 +0000 UTC m=+277.193250351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:38.643315 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.643154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-data-volume\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.650971 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.650952    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg7pf\" (UniqueName: \"kubernetes.io/projected/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-api-access-kg7pf\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:38.931091 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:38.931053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:39.146500 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:39.146447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:39.146680 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:39.146550    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 19:59:39.146680 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:39.146596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:39.146680 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:39.146630    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:40.146613197 +0000 UTC m=+278.196758274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : configmap "kube-rbac-proxy" not found
Sep 09 19:59:39.146851 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:39.146711    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:39.146851 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:39.146781    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:40.146764509 +0000 UTC m=+278.196909593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:39.358484 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:39.358440    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:39.459233 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:39.459202    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:39.660602 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:39.660514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:39.718678 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:39.718638    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:40.154736 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:40.154702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:40.154906 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:40.154804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:40.154906 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:40.154826    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 19:59:40.154906 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:40.154904    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:42.154888651 +0000 UTC m=+280.205033711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : configmap "kube-rbac-proxy" not found
Sep 09 19:59:40.155026 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:40.154904    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:40.155026 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:40.154945    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:42.154934339 +0000 UTC m=+280.205079399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:40.266118 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:40.266085    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk" event={"ID":"e79a23fb-cd3d-4423-9b4e-d3d7836e5838","Type":"ContainerStarted","Data":"6bd752b4ee45619b256597aa958363f1ec9e3ff890330561f360f797027bb7d0"}
Sep 09 19:59:40.266286 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:40.266140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk" event={"ID":"e79a23fb-cd3d-4423-9b4e-d3d7836e5838","Type":"ContainerStarted","Data":"c4afd327ea4992f097032acf904a519784dd54106e4e040dfe1e821e1ae4d7cf"}
Sep 09 19:59:40.280708 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:40.280657    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-8gdlk" podStartSLOduration=2.063786548 podStartE2EDuration="3.280640346s" totalImagesPullingTime="1.216853798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:59:40.279679801 +0000 UTC m=+278.329824886" watchObservedRunningTime="2026-09-09 19:59:40.280640346 +0000 UTC m=+278.330785476"
Sep 09 19:59:40.359723 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:40.359692    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:40.459814 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:40.459743    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:40.950843 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:40.950787    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-75899d678-jvmfd" podUID="c219f78f-2f2a-49a5-ba5e-8da22b61e858"
Sep 09 19:59:40.950843 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:40.950787    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt" podUID="9bb964a1-a5d5-4d9c-99f7-5ad5427250f8"
Sep 09 19:59:40.950843 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:40.950787    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6dthr" podUID="722fc986-cfd8-49ad-abe7-c1ce42b9f52f"
Sep 09 19:59:41.263923 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:41.263825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:41.264074 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:41.263945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:41.264074 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:41.263979    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:41.264074 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:41.264061    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls podName:64129677-2c7c-4b80-8551-67556a7e947f nodeName:}" failed. No retries permitted until 2026-09-09 19:59:49.264041424 +0000 UTC m=+287.314186508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6jmnv" (UID: "64129677-2c7c-4b80-8551-67556a7e947f") : secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:41.264074 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:41.264070    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 19:59:41.264233 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:41.264107    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls podName:11a12cd4-b43b-49a5-9fd4-f66f70b83793 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:49.264096759 +0000 UTC m=+287.314241839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8z26f" (UID: "11a12cd4-b43b-49a5-9fd4-f66f70b83793") : secret "samples-operator-tls" not found
Sep 09 19:59:41.269322 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:41.269300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:59:41.269453 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:41.269324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dthr"
Sep 09 19:59:41.269453 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:41.269301    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:59:41.285560 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:41.285536    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:41.312687 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:41.312660    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qdtq8_c9077078-4773-47ab-8080-cdcc7b94f4e9/dns-node-resolver/0.log"
Sep 09 19:59:41.377954 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:41.377929    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:42.105329 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:42.105303    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hqxw8_c951ba96-23fb-403a-b91d-e894f18cfc8f/node-ca/0.log"
Sep 09 19:59:42.171779 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:42.171747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:42.171936 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:42.171794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:42.171936 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:42.171888    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:42.171936 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:42.171893    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 19:59:42.172051 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:42.171951    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:46.171933298 +0000 UTC m=+284.222078364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:42.172051 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:42.171965    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:46.171958588 +0000 UTC m=+284.222103649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : configmap "kube-rbac-proxy" not found
Sep 09 19:59:42.478278 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:42.478201    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:43.064214 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:43.064181    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:43.103182 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:43.103154    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-brct6_11e116db-c6b1-495b-8c10-c251e9a9b2e3/serve-healthcheck-canary/0.log"
Sep 09 19:59:43.334038 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:43.333935    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:43.452764 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:43.452726    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:43.504122 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:43.504097    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-8gdlk_e79a23fb-cd3d-4423-9b4e-d3d7836e5838/migrator/0.log"
Sep 09 19:59:43.554384 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:43.554360    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:43.704226 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:43.704157    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-8gdlk_e79a23fb-cd3d-4423-9b4e-d3d7836e5838/graceful-termination/0.log"
Sep 09 19:59:43.753237 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:43.753202    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:43.904671 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:43.904645    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-lwpq4_1f342115-6774-487f-b9f0-32e8ddda3db7/kube-storage-version-migrator-operator/0.log"
Sep 09 19:59:44.287320 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:44.287293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 19:59:44.287459 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:44.287331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 19:59:44.287459 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:44.287387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") pod \"image-registry-75899d678-jvmfd\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") " pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 19:59:44.287459 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:44.287432    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 19:59:44.287591 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:44.287503    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 19:59:44.287591 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:44.287507    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 19:59:44.287591 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:44.287513    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75899d678-jvmfd: secret "image-registry-tls" not found
Sep 09 19:59:44.287591 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:44.287510    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls podName:722fc986-cfd8-49ad-abe7-c1ce42b9f52f nodeName:}" failed. No retries permitted until 2026-09-09 20:01:46.28749144 +0000 UTC m=+404.337636520 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls") pod "dns-default-6dthr" (UID: "722fc986-cfd8-49ad-abe7-c1ce42b9f52f") : secret "dns-default-metrics-tls" not found
Sep 09 19:59:44.287591 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:44.287548    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls podName:c219f78f-2f2a-49a5-ba5e-8da22b61e858 nodeName:}" failed. No retries permitted until 2026-09-09 20:01:46.287537619 +0000 UTC m=+404.337682681 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls") pod "image-registry-75899d678-jvmfd" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858") : secret "image-registry-tls" not found
Sep 09 19:59:44.287591 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:44.287561    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert podName:9bb964a1-a5d5-4d9c-99f7-5ad5427250f8 nodeName:}" failed. No retries permitted until 2026-09-09 20:01:46.287554388 +0000 UTC m=+404.337699450 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-2cpgt" (UID: "9bb964a1-a5d5-4d9c-99f7-5ad5427250f8") : secret "networking-console-plugin-cert" not found
Sep 09 19:59:44.833353 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:44.833319    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:44.950763 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:44.950720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:45.398968 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:45.398939    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:45.493079 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:45.493046    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:45.594788 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:45.594757    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:45.952356 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:45.952322    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:46.202848 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:46.202744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:46.202848 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:46.202827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:46.203072 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:46.202906    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:46.203072 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:46.202921    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 19:59:46.203072 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:46.202969    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:54.202953937 +0000 UTC m=+292.253098998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : secret "insights-runtime-extractor-tls" not found
Sep 09 19:59:46.203072 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:46.202983    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm podName:f5690bb0-8552-40a9-8f0d-84bc8bd8f459 nodeName:}" failed. No retries permitted until 2026-09-09 19:59:54.202977304 +0000 UTC m=+292.253122364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5l75p" (UID: "f5690bb0-8552-40a9-8f0d-84bc8bd8f459") : configmap "kube-rbac-proxy" not found
Sep 09 19:59:46.554113 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:46.554087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:46.844205 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:46.844119    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:47.140204 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:47.140119    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:47.196401 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:47.196369    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:47.345745 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:47.345712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:47.747083 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:47.747051    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:47.951044 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:47.951010    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:48.597088 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:48.597059    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:48.695017 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:48.694986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:49.151551 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.151524    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:49.330460 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.330427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:49.330830 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.330808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 19:59:49.331187 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:49.331168    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:49.331355 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:49.331344    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls podName:64129677-2c7c-4b80-8551-67556a7e947f nodeName:}" failed. No retries permitted until 2026-09-09 20:00:05.331323647 +0000 UTC m=+303.381468711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-6jmnv" (UID: "64129677-2c7c-4b80-8551-67556a7e947f") : secret "cluster-monitoring-operator-tls" not found
Sep 09 19:59:49.335084 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.335062    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/11a12cd4-b43b-49a5-9fd4-f66f70b83793-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8z26f\" (UID: \"11a12cd4-b43b-49a5-9fd4-f66f70b83793\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:49.358679 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.358658    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"
Sep 09 19:59:49.490824 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.490783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:49.626709 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.626678    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f"]
Sep 09 19:59:49.701683 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.701652    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:49.802107 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.802074    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:49.953878 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:49.953796    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:50.295215 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:50.295177    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f" event={"ID":"11a12cd4-b43b-49a5-9fd4-f66f70b83793","Type":"ContainerStarted","Data":"26e152dd28460afc25b0a10fc3dd2be77923a051a096d279ee0d43e9670f9261"}
Sep 09 19:59:50.347803 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:50.347772    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:50.724302 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:50.724226    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:50.950942 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:50.950915    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:51.564740 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:51.564712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:51.745341 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:51.745267    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:51.951148 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:51.951117    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:52.303752 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:52.303719    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f" event={"ID":"11a12cd4-b43b-49a5-9fd4-f66f70b83793","Type":"ContainerStarted","Data":"8f993e1c537b8f750d410b8301ac8a278d9a6e75354bf749a82638603fbd4dfa"}
Sep 09 19:59:52.303910 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:52.303771    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f" event={"ID":"11a12cd4-b43b-49a5-9fd4-f66f70b83793","Type":"ContainerStarted","Data":"a344ad6ed966ecbd793e84c2db4dfee81bad84a242db418f465c00129548f95d"}
Sep 09 19:59:52.319107 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:52.319063    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8z26f" podStartSLOduration=17.57961911 podStartE2EDuration="19.319046901s" totalImagesPullingTime="1.739427791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:59:52.318975302 +0000 UTC m=+290.369120387" watchObservedRunningTime="2026-09-09 19:59:52.319046901 +0000 UTC m=+290.369191985"
Sep 09 19:59:52.348215 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:52.348191    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:53.149729 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:53.149695    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:53.350970 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:53.350924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:53.547188 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:53.547148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:53.754038 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:53.754001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:54.275211 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:54.275173    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:54.275617 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:54.275226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:54.275718 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:54.275698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:54.277690 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:54.277672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5690bb0-8552-40a9-8f0d-84bc8bd8f459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l75p\" (UID: \"f5690bb0-8552-40a9-8f0d-84bc8bd8f459\") " pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:54.442655 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:54.442626    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5l75p"
Sep 09 19:59:54.716492 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:54.716450    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5l75p"]
Sep 09 19:59:54.719802 ip-10-0-128-182 kubenswrapper[2577]: W0909 19:59:54.719775    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5690bb0_8552_40a9_8f0d_84bc8bd8f459.slice/crio-dfc3709f4fe017f9e6e64a9776387a19bc32923f9ea0139777a74eb9d5807554 WatchSource:0}: Error finding container dfc3709f4fe017f9e6e64a9776387a19bc32923f9ea0139777a74eb9d5807554: Status 404 returned error can't find the container with id dfc3709f4fe017f9e6e64a9776387a19bc32923f9ea0139777a74eb9d5807554
Sep 09 19:59:55.317527 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:55.317490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l75p" event={"ID":"f5690bb0-8552-40a9-8f0d-84bc8bd8f459","Type":"ContainerStarted","Data":"b7c1af5777b019b983eae48adc6edec9299085a7f0bcbea6018056f93b94374e"}
Sep 09 19:59:55.317909 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:55.317547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l75p" event={"ID":"f5690bb0-8552-40a9-8f0d-84bc8bd8f459","Type":"ContainerStarted","Data":"dfc3709f4fe017f9e6e64a9776387a19bc32923f9ea0139777a74eb9d5807554"}
Sep 09 19:59:56.323447 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:56.323414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l75p" event={"ID":"f5690bb0-8552-40a9-8f0d-84bc8bd8f459","Type":"ContainerStarted","Data":"038d873381f6e75b9489bda2bc23929eb622fedfb7d62b54ceb4577101d0a7a9"}
Sep 09 19:59:56.442099 ip-10-0-128-182 kubenswrapper[2577]: E0909 19:59:56.442050    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dbvkj" podUID="b0ea2929-722b-472c-ab75-2bd456540d9a"
Sep 09 19:59:56.448204 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:56.448179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:56.507992 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:56.507956    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 19:59:57.328456 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:57.328423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l75p" event={"ID":"f5690bb0-8552-40a9-8f0d-84bc8bd8f459","Type":"ContainerStarted","Data":"c8d9c7295c0d8b5d10ddbc516e38beac03f25973d92cfc5e283d058f8b8cbaa1"}
Sep 09 19:59:57.349187 ip-10-0-128-182 kubenswrapper[2577]: I0909 19:59:57.349143    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5l75p" podStartSLOduration=17.16555943 podStartE2EDuration="19.349125367s" totalImagesPullingTime="2.183565937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 19:59:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 19:59:57.348530869 +0000 UTC m=+295.398675953" watchObservedRunningTime="2026-09-09 19:59:57.349125367 +0000 UTC m=+295.399270477"
Sep 09 20:00:02.351177 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:02.351148    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:00:02.351739 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:02.351723    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:00:02.357518 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:02.357496    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 20:00:04.039843 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:04.039807    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:04.274228 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:04.274196    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:05.367738 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:05.367704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 20:00:05.370193 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:05.370174    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64129677-2c7c-4b80-8551-67556a7e947f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-6jmnv\" (UID: \"64129677-2c7c-4b80-8551-67556a7e947f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 20:00:05.556067 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:05.556033    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ljhsk\""
Sep 09 20:00:05.566907 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:05.566863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"
Sep 09 20:00:05.838362 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:05.838259    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv"]
Sep 09 20:00:05.841831 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:05.841802    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64129677_2c7c_4b80_8551_67556a7e947f.slice/crio-847e3a966f5c09ddb3c22798c481b02b95fde9b6d9a984302f61e3b3bb04a57d WatchSource:0}: Error finding container 847e3a966f5c09ddb3c22798c481b02b95fde9b6d9a984302f61e3b3bb04a57d: Status 404 returned error can't find the container with id 847e3a966f5c09ddb3c22798c481b02b95fde9b6d9a984302f61e3b3bb04a57d
Sep 09 20:00:05.843801 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:05.843784    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:00:06.356691 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:06.356658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv" event={"ID":"64129677-2c7c-4b80-8551-67556a7e947f","Type":"ContainerStarted","Data":"847e3a966f5c09ddb3c22798c481b02b95fde9b6d9a984302f61e3b3bb04a57d"}
Sep 09 20:00:07.440636 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:07.440604    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 20:00:09.007258 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.007171    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:09.171308 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.171278    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"]
Sep 09 20:00:09.174444 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.174429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"
Sep 09 20:00:09.176411 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.176394    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 20:00:09.176507 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.176458    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2z7dh\""
Sep 09 20:00:09.181992 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.181967    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"]
Sep 09 20:00:09.301050 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.301012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fd5eb11-8cac-4a1f-9075-a93d0e1b141c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-w9f5x\" (UID: \"8fd5eb11-8cac-4a1f-9075-a93d0e1b141c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"
Sep 09 20:00:09.370594 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.370557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv" event={"ID":"64129677-2c7c-4b80-8551-67556a7e947f","Type":"ContainerStarted","Data":"63fbeedd3b76d817e97b415172ecf5852ea31f9712691684686ed78a06546d3a"}
Sep 09 20:00:09.387919 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.387869    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-6jmnv" podStartSLOduration=33.533604764 podStartE2EDuration="36.38785122s" totalImagesPullingTime="2.854246456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:09.38721317 +0000 UTC m=+307.437358253" watchObservedRunningTime="2026-09-09 20:00:09.38785122 +0000 UTC m=+307.437996302"
Sep 09 20:00:09.401458 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.401430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fd5eb11-8cac-4a1f-9075-a93d0e1b141c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-w9f5x\" (UID: \"8fd5eb11-8cac-4a1f-9075-a93d0e1b141c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"
Sep 09 20:00:09.404030 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.404008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8fd5eb11-8cac-4a1f-9075-a93d0e1b141c-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-w9f5x\" (UID: \"8fd5eb11-8cac-4a1f-9075-a93d0e1b141c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"
Sep 09 20:00:09.483848 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.483814    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"
Sep 09 20:00:09.757339 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:09.757265    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"]
Sep 09 20:00:09.760064 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:09.760034    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd5eb11_8cac_4a1f_9075_a93d0e1b141c.slice/crio-d44e8c821352bf7d8f6512a57cd60ccd2452923f7641b42b64e7ea11339fe009 WatchSource:0}: Error finding container d44e8c821352bf7d8f6512a57cd60ccd2452923f7641b42b64e7ea11339fe009: Status 404 returned error can't find the container with id d44e8c821352bf7d8f6512a57cd60ccd2452923f7641b42b64e7ea11339fe009
Sep 09 20:00:10.374776 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:10.374741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x" event={"ID":"8fd5eb11-8cac-4a1f-9075-a93d0e1b141c","Type":"ContainerStarted","Data":"d44e8c821352bf7d8f6512a57cd60ccd2452923f7641b42b64e7ea11339fe009"}
Sep 09 20:00:12.561336 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:12.561297    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:13.386240 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:13.386208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x" event={"ID":"8fd5eb11-8cac-4a1f-9075-a93d0e1b141c","Type":"ContainerStarted","Data":"b8945fb645ca778db53db1911ce035834f5aaaaa269a38360a76cc64b345a899"}
Sep 09 20:00:13.386495 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:13.386456    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"
Sep 09 20:00:13.391185 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:13.391160    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x"
Sep 09 20:00:13.417679 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:13.417626    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9f5x" podStartSLOduration=1.391100352 podStartE2EDuration="4.41760428s" totalImagesPullingTime="3.026503928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:13.402652874 +0000 UTC m=+311.452797956" watchObservedRunningTime="2026-09-09 20:00:13.41760428 +0000 UTC m=+311.467749363"
Sep 09 20:00:14.198005 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.197971    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:14.240048 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.240017    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"]
Sep 09 20:00:14.242192 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.242177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.245123 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.245088    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 20:00:14.245123 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.245101    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 20:00:14.245283 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.245151    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 20:00:14.245283 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.245162    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fkj6g\""
Sep 09 20:00:14.253752 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.253730    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"]
Sep 09 20:00:14.268734 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.268694    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:14.344361 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.344329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.344520 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.344391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.344520 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.344503    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vs75\" (UniqueName: \"kubernetes.io/projected/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-kube-api-access-2vs75\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.344594 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.344536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.427726 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.427645    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:14.445263 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.445239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.445423 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.445288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.445423 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.445332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vs75\" (UniqueName: \"kubernetes.io/projected/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-kube-api-access-2vs75\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.445423 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.445354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.446052 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.446032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.447911 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.447883    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.447999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.447892    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.453094 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.453070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vs75\" (UniqueName: \"kubernetes.io/projected/0ef9241b-8c34-42b9-8677-ef4c561a4ed4-kube-api-access-2vs75\") pod \"prometheus-operator-6f4946db56-vgfsc\" (UID: \"0ef9241b-8c34-42b9-8677-ef4c561a4ed4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.551127 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.551090    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"
Sep 09 20:00:14.822041 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:14.822011    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-vgfsc"]
Sep 09 20:00:14.825017 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:14.824989    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef9241b_8c34_42b9_8677_ef4c561a4ed4.slice/crio-a817a3156ba0561248327e9927720a018d7eb5ad5d41ca745f818b53fa78fec1 WatchSource:0}: Error finding container a817a3156ba0561248327e9927720a018d7eb5ad5d41ca745f818b53fa78fec1: Status 404 returned error can't find the container with id a817a3156ba0561248327e9927720a018d7eb5ad5d41ca745f818b53fa78fec1
Sep 09 20:00:15.396238 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:15.396204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc" event={"ID":"0ef9241b-8c34-42b9-8677-ef4c561a4ed4","Type":"ContainerStarted","Data":"a817a3156ba0561248327e9927720a018d7eb5ad5d41ca745f818b53fa78fec1"}
Sep 09 20:00:16.657689 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:16.657601    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:17.404290 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:17.404260    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc" event={"ID":"0ef9241b-8c34-42b9-8677-ef4c561a4ed4","Type":"ContainerStarted","Data":"ecdff380337a71c62a80fa87daabf739cb2a43f520529c297c39eebccf7a10da"}
Sep 09 20:00:17.404460 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:17.404313    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc" event={"ID":"0ef9241b-8c34-42b9-8677-ef4c561a4ed4","Type":"ContainerStarted","Data":"9865fe8dd959f63fb9e61d7e3bd7b0510be4497f41f501558f102b62d5f21134"}
Sep 09 20:00:17.424213 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:17.424160    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-vgfsc" podStartSLOduration=1.86208456 podStartE2EDuration="3.424145931s" totalImagesPullingTime="1.562061371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:17.42307738 +0000 UTC m=+315.473222464" watchObservedRunningTime="2026-09-09 20:00:17.424145931 +0000 UTC m=+315.474291013"
Sep 09 20:00:19.328354 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.328317    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:19.430700 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.430665    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:19.553894 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.553865    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:19.588579 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.588493    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"]
Sep 09 20:00:19.590951 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.590928    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ppvvn"]
Sep 09 20:00:19.591097 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.591059    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.592834 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.592811    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 20:00:19.593235 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.593221    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.593370 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.593351    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 20:00:19.593721 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.593703    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4kps8\""
Sep 09 20:00:19.593785 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.593772    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 20:00:19.595014 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.594977    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gpvzs\""
Sep 09 20:00:19.595014 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.595006    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 20:00:19.595199 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.594987    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 20:00:19.595199 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.595051    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 20:00:19.601145 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.601123    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"]
Sep 09 20:00:19.682656 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.682622    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:19.684753 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.684733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.684816 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.684777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-wtmp\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.684858 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.684818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af1466ed-7285-4327-8623-ed01e7ddc2cc-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.684901 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.684866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz87z\" (UniqueName: \"kubernetes.io/projected/7afc4be2-d292-4493-a936-33967a45f9ce-kube-api-access-kz87z\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.684901 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.684887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7afc4be2-d292-4493-a936-33967a45f9ce-sys\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.684976 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.684908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knxwq\" (UniqueName: \"kubernetes.io/projected/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-api-access-knxwq\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.684976 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.684963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7afc4be2-d292-4493-a936-33967a45f9ce-metrics-client-ca\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.685043 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.684986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.685043 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.685022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-textfile\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.685144 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.685046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-tls\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.685144 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.685079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.685246 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.685152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7afc4be2-d292-4493-a936-33967a45f9ce-root\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.685246 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.685219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.685351 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.685251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/af1466ed-7285-4327-8623-ed01e7ddc2cc-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.685351 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.685294    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.786393 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.786393 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/af1466ed-7285-4327-8623-ed01e7ddc2cc-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.786637 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.786637 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786439    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.786637 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-wtmp\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.786637 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af1466ed-7285-4327-8623-ed01e7ddc2cc-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.786637 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz87z\" (UniqueName: \"kubernetes.io/projected/7afc4be2-d292-4493-a936-33967a45f9ce-kube-api-access-kz87z\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.786637 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7afc4be2-d292-4493-a936-33967a45f9ce-sys\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.786637 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knxwq\" (UniqueName: \"kubernetes.io/projected/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-api-access-knxwq\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.786637 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7afc4be2-d292-4493-a936-33967a45f9ce-metrics-client-ca\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.787018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-textfile\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-tls\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-wtmp\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786837    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/af1466ed-7285-4327-8623-ed01e7ddc2cc-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.787018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.787018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786907    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7afc4be2-d292-4493-a936-33967a45f9ce-sys\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.786920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7afc4be2-d292-4493-a936-33967a45f9ce-root\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.787001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7afc4be2-d292-4493-a936-33967a45f9ce-root\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787458 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.787058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787458 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.787196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-textfile\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787458 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.787421    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7afc4be2-d292-4493-a936-33967a45f9ce-metrics-client-ca\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.787805 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.787719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af1466ed-7285-4327-8623-ed01e7ddc2cc-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.788043 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.788018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.789393 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.789365    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-tls\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.789684 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.789662    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7afc4be2-d292-4493-a936-33967a45f9ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.789738 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.789664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.789780 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.789734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.798657 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.798637    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz87z\" (UniqueName: \"kubernetes.io/projected/7afc4be2-d292-4493-a936-33967a45f9ce-kube-api-access-kz87z\") pod \"node-exporter-ppvvn\" (UID: \"7afc4be2-d292-4493-a936-33967a45f9ce\") " pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.799126 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.799106    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knxwq\" (UniqueName: \"kubernetes.io/projected/af1466ed-7285-4327-8623-ed01e7ddc2cc-kube-api-access-knxwq\") pod \"kube-state-metrics-74cb57df7-lq9h4\" (UID: \"af1466ed-7285-4327-8623-ed01e7ddc2cc\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.902076 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.901999    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"
Sep 09 20:00:19.907446 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.907428    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ppvvn"
Sep 09 20:00:19.918150 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:19.918118    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7afc4be2_d292_4493_a936_33967a45f9ce.slice/crio-2d223ab52fa457c9aed8cdc655b656a82eef3f714a8957739cb0903fa0aa2a05 WatchSource:0}: Error finding container 2d223ab52fa457c9aed8cdc655b656a82eef3f714a8957739cb0903fa0aa2a05: Status 404 returned error can't find the container with id 2d223ab52fa457c9aed8cdc655b656a82eef3f714a8957739cb0903fa0aa2a05
Sep 09 20:00:19.966953 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:19.966865    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:20.064620 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.064583    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:20.165447 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.165371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:20.173327 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.173303    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4"]
Sep 09 20:00:20.176478 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:20.176442    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1466ed_7285_4327_8623_ed01e7ddc2cc.slice/crio-904025c5ad787bcccf7cba1083223d43fa5e4b77704bd1e4e6d7c535e18138a9 WatchSource:0}: Error finding container 904025c5ad787bcccf7cba1083223d43fa5e4b77704bd1e4e6d7c535e18138a9: Status 404 returned error can't find the container with id 904025c5ad787bcccf7cba1083223d43fa5e4b77704bd1e4e6d7c535e18138a9
Sep 09 20:00:20.418350 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.418254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ppvvn" event={"ID":"7afc4be2-d292-4493-a936-33967a45f9ce","Type":"ContainerStarted","Data":"2d223ab52fa457c9aed8cdc655b656a82eef3f714a8957739cb0903fa0aa2a05"}
Sep 09 20:00:20.419421 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.419397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4" event={"ID":"af1466ed-7285-4327-8623-ed01e7ddc2cc","Type":"ContainerStarted","Data":"904025c5ad787bcccf7cba1083223d43fa5e4b77704bd1e4e6d7c535e18138a9"}
Sep 09 20:00:20.575442 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.575403    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:20.679063 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.678949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:20.710701 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.710669    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:00:20.714019 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.714003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.716606 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.716584    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 20:00:20.725399 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.725377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 20:00:20.725526 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.725401    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 20:00:20.725526 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.725407    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 20:00:20.725820 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.725770    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 20:00:20.726039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.726020    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 20:00:20.726229 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.726205    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 20:00:20.726396 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.726382    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 20:00:20.726541 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.726519    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jh8v4\""
Sep 09 20:00:20.726704 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.726664    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 20:00:20.734743 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.734721    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:00:20.895710 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.895999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-config-volume\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.895999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895781    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-web-config\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.895999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.895999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.895999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.895999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.895999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.895999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnjnm\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-kube-api-access-tnjnm\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.895999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.895977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-config-out\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.896395 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.896031    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.896395 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.896110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.896395 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.896142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.997351 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.997197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.997351 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.997256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.997351 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.997289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.997351 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.997327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-config-volume\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.997705 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:00:20.997377    2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 09 20:00:20.997705 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:00:20.997454    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-main-tls podName:c711495a-fec1-4070-bbe4-389b9d571732 nodeName:}" failed. No retries permitted until 2026-09-09 20:00:21.497431897 +0000 UTC m=+319.547576961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c711495a-fec1-4070-bbe4-389b9d571732") : secret "alertmanager-main-tls" not found
Sep 09 20:00:20.997884 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.997378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-web-config\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.998045 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.998022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.998123 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.998063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.998123 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.998089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.998123 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.998111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.998274 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.998139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.998274 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.998182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnjnm\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-kube-api-access-tnjnm\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.998274 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.998210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-config-out\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.998274 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.998218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.998493 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.998277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.999172 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.999149    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:20.999273 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:20.999233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.000550 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.000410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-web-config\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.003600 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.003288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-config-out\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.003600 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.003562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.004194 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.004150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.004402 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.004331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-config-volume\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.004810 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.004774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.005948 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.005926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.007179 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.007150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.008823 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.008801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnjnm\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-kube-api-access-tnjnm\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.090053 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.090018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:21.190231 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.190202    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:21.502392 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.502312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.505412 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.505380    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.626034 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.626003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:00:21.926218 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:21.926193    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:00:21.927529 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:21.927463    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc711495a_fec1_4070_bbe4_389b9d571732.slice/crio-f72c11cabc923931877b0fb0611ee0fcdec4fe49526a3342b116ebbc138521a2 WatchSource:0}: Error finding container f72c11cabc923931877b0fb0611ee0fcdec4fe49526a3342b116ebbc138521a2: Status 404 returned error can't find the container with id f72c11cabc923931877b0fb0611ee0fcdec4fe49526a3342b116ebbc138521a2
Sep 09 20:00:22.428925 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.428895    2577 generic.go:356] "Generic (PLEG): container finished" podID="7afc4be2-d292-4493-a936-33967a45f9ce" containerID="d6e990d15a887a218cd7d4a5b83ebad2804d329b51437813a1460852edfb3295" exitCode=0
Sep 09 20:00:22.429101 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.428978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ppvvn" event={"ID":"7afc4be2-d292-4493-a936-33967a45f9ce","Type":"ContainerDied","Data":"d6e990d15a887a218cd7d4a5b83ebad2804d329b51437813a1460852edfb3295"}
Sep 09 20:00:22.431151 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.431125    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4" event={"ID":"af1466ed-7285-4327-8623-ed01e7ddc2cc","Type":"ContainerStarted","Data":"c5c046785cfb927fdaa17d24d59eaf65614239615a7fe252e323d6eea11f41c5"}
Sep 09 20:00:22.431264 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.431173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4" event={"ID":"af1466ed-7285-4327-8623-ed01e7ddc2cc","Type":"ContainerStarted","Data":"fed9e6a0f7dc4809f373c6376e2049262c669760ac4dbca5b0fa4318ba1e14b0"}
Sep 09 20:00:22.431264 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.431201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4" event={"ID":"af1466ed-7285-4327-8623-ed01e7ddc2cc","Type":"ContainerStarted","Data":"e5edfdd084c232759df94f9cb7e91858d49870c58e18ab4c2dec805969adf4d0"}
Sep 09 20:00:22.432365 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.432337    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerStarted","Data":"f72c11cabc923931877b0fb0611ee0fcdec4fe49526a3342b116ebbc138521a2"}
Sep 09 20:00:22.467398 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.467352    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-lq9h4" podStartSLOduration=1.996715853 podStartE2EDuration="3.467330292s" totalImagesPullingTime="1.470614439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:22.466037353 +0000 UTC m=+320.516182439" watchObservedRunningTime="2026-09-09 20:00:22.467330292 +0000 UTC m=+320.517475378"
Sep 09 20:00:22.520751 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.520715    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:22.621450 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.621419    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:22.721298 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.721196    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:22.776455 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:22.776422    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:23.438976 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.438937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ppvvn" event={"ID":"7afc4be2-d292-4493-a936-33967a45f9ce","Type":"ContainerStarted","Data":"9a5f7f0ce87a2d87656c811882527ec156deb8760ba33a436bd608b924298393"}
Sep 09 20:00:23.439160 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.439029    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ppvvn" event={"ID":"7afc4be2-d292-4493-a936-33967a45f9ce","Type":"ContainerStarted","Data":"effccb661a7cdc03d1d967e49089d7e175b1898cc0c9cfec31a91939802f3ec2"}
Sep 09 20:00:23.460591 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.460535    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ppvvn" podStartSLOduration=2.643006089 podStartE2EDuration="4.460511707s" totalImagesPullingTime="1.727715817s" totalInitContainerRuntime="89.789801ms" isStatefulPod=true podCreationTimestamp="2026-09-09 20:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:23.459960138 +0000 UTC m=+321.510105225" watchObservedRunningTime="2026-09-09 20:00:23.460511707 +0000 UTC m=+321.510656789"
Sep 09 20:00:23.905842 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.905803    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d5c855f46-xnvfs"]
Sep 09 20:00:23.909104 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.909078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:23.911880 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.911690    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cslekcbctqbr3\""
Sep 09 20:00:23.911880 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.911710    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 20:00:23.911880 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.911731    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 20:00:23.911880 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.911694    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 20:00:23.911880 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.911691    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 20:00:23.911880 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.911711    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-s6xl2\""
Sep 09 20:00:23.919383 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:23.919362    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d5c855f46-xnvfs"]
Sep 09 20:00:24.023479 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.023445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e622d1c-2f11-4075-a17d-6892ffed5201-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.023642 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.023547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9e622d1c-2f11-4075-a17d-6892ffed5201-audit-log\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.023642 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.023571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9e622d1c-2f11-4075-a17d-6892ffed5201-secret-metrics-server-client-certs\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.023642 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.023603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9e622d1c-2f11-4075-a17d-6892ffed5201-metrics-server-audit-profiles\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.023732 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.023659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxnmw\" (UniqueName: \"kubernetes.io/projected/9e622d1c-2f11-4075-a17d-6892ffed5201-kube-api-access-jxnmw\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.023732 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.023683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e622d1c-2f11-4075-a17d-6892ffed5201-client-ca-bundle\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.023732 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.023716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9e622d1c-2f11-4075-a17d-6892ffed5201-secret-metrics-server-tls\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.124865 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.124834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e622d1c-2f11-4075-a17d-6892ffed5201-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.125000 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.124880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9e622d1c-2f11-4075-a17d-6892ffed5201-audit-log\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.125000 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.124899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9e622d1c-2f11-4075-a17d-6892ffed5201-secret-metrics-server-client-certs\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.125000 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.124934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9e622d1c-2f11-4075-a17d-6892ffed5201-metrics-server-audit-profiles\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.125000 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.124996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxnmw\" (UniqueName: \"kubernetes.io/projected/9e622d1c-2f11-4075-a17d-6892ffed5201-kube-api-access-jxnmw\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.125183 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.125024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e622d1c-2f11-4075-a17d-6892ffed5201-client-ca-bundle\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.125183 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.125062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9e622d1c-2f11-4075-a17d-6892ffed5201-secret-metrics-server-tls\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.125400 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.125379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9e622d1c-2f11-4075-a17d-6892ffed5201-audit-log\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.125735 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.125704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e622d1c-2f11-4075-a17d-6892ffed5201-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.125932 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.125915    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9e622d1c-2f11-4075-a17d-6892ffed5201-metrics-server-audit-profiles\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.127773 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.127752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9e622d1c-2f11-4075-a17d-6892ffed5201-secret-metrics-server-tls\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.128204 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.128186    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9e622d1c-2f11-4075-a17d-6892ffed5201-secret-metrics-server-client-certs\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.128342 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.128324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9e622d1c-2f11-4075-a17d-6892ffed5201-client-ca-bundle\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.132974 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.132955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxnmw\" (UniqueName: \"kubernetes.io/projected/9e622d1c-2f11-4075-a17d-6892ffed5201-kube-api-access-jxnmw\") pod \"metrics-server-7d5c855f46-xnvfs\" (UID: \"9e622d1c-2f11-4075-a17d-6892ffed5201\") " pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.218200 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.218115    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:24.354374 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.354327    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:24.357115 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.357092    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"]
Sep 09 20:00:24.360425 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.360407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:24.362308 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.362292    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 20:00:24.362415 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.362315    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-t94mv\""
Sep 09 20:00:24.371067 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.371014    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"]
Sep 09 20:00:24.444534 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.444499    2577 generic.go:356] "Generic (PLEG): container finished" podID="c711495a-fec1-4070-bbe4-389b9d571732" containerID="c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172" exitCode=0
Sep 09 20:00:24.445067 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.445041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerDied","Data":"c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172"}
Sep 09 20:00:24.490167 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.490086    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d5c855f46-xnvfs"]
Sep 09 20:00:24.494947 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:24.492878    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e622d1c_2f11_4075_a17d_6892ffed5201.slice/crio-1cc15372a2ac5543c3e7311cfa01d0eca03590c524514d9df3fd908ea0675204 WatchSource:0}: Error finding container 1cc15372a2ac5543c3e7311cfa01d0eca03590c524514d9df3fd908ea0675204: Status 404 returned error can't find the container with id 1cc15372a2ac5543c3e7311cfa01d0eca03590c524514d9df3fd908ea0675204
Sep 09 20:00:24.530193 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.530165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7200ec65-bb90-4cf4-ab84-b67d13355f6d-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-2pq7g\" (UID: \"7200ec65-bb90-4cf4-ab84-b67d13355f6d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:24.530333 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.530212    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tbt\" (UniqueName: \"kubernetes.io/projected/7200ec65-bb90-4cf4-ab84-b67d13355f6d-kube-api-access-62tbt\") pod \"monitoring-plugin-85bbbbbf4-2pq7g\" (UID: \"7200ec65-bb90-4cf4-ab84-b67d13355f6d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:24.630986 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.630943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7200ec65-bb90-4cf4-ab84-b67d13355f6d-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-2pq7g\" (UID: \"7200ec65-bb90-4cf4-ab84-b67d13355f6d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:24.631165 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.631104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62tbt\" (UniqueName: \"kubernetes.io/projected/7200ec65-bb90-4cf4-ab84-b67d13355f6d-kube-api-access-62tbt\") pod \"monitoring-plugin-85bbbbbf4-2pq7g\" (UID: \"7200ec65-bb90-4cf4-ab84-b67d13355f6d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:24.638399 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.638367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7200ec65-bb90-4cf4-ab84-b67d13355f6d-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-2pq7g\" (UID: \"7200ec65-bb90-4cf4-ab84-b67d13355f6d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:24.640282 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.640259    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tbt\" (UniqueName: \"kubernetes.io/projected/7200ec65-bb90-4cf4-ab84-b67d13355f6d-kube-api-access-62tbt\") pod \"monitoring-plugin-85bbbbbf4-2pq7g\" (UID: \"7200ec65-bb90-4cf4-ab84-b67d13355f6d\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:24.670602 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.670572    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:24.786941 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.786788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:24.940361 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:24.940338    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"]
Sep 09 20:00:24.942700 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:24.942673    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7200ec65_bb90_4cf4_ab84_b67d13355f6d.slice/crio-c5615e8b8bee3a5a771008c7e5bfec0df3b2d264d1814986f9d7ee7d5ec0c0f0 WatchSource:0}: Error finding container c5615e8b8bee3a5a771008c7e5bfec0df3b2d264d1814986f9d7ee7d5ec0c0f0: Status 404 returned error can't find the container with id c5615e8b8bee3a5a771008c7e5bfec0df3b2d264d1814986f9d7ee7d5ec0c0f0
Sep 09 20:00:25.451326 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:25.451283    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g" event={"ID":"7200ec65-bb90-4cf4-ab84-b67d13355f6d","Type":"ContainerStarted","Data":"c5615e8b8bee3a5a771008c7e5bfec0df3b2d264d1814986f9d7ee7d5ec0c0f0"}
Sep 09 20:00:25.452888 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:25.452858    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs" event={"ID":"9e622d1c-2f11-4075-a17d-6892ffed5201","Type":"ContainerStarted","Data":"1cc15372a2ac5543c3e7311cfa01d0eca03590c524514d9df3fd908ea0675204"}
Sep 09 20:00:25.853073 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:25.853011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:27.468275 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.468240    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerStarted","Data":"7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0"}
Sep 09 20:00:27.468715 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.468325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerStarted","Data":"665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1"}
Sep 09 20:00:27.468715 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.468371    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerStarted","Data":"bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda"}
Sep 09 20:00:27.468715 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.468398    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerStarted","Data":"4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2"}
Sep 09 20:00:27.468715 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.468422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerStarted","Data":"3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3"}
Sep 09 20:00:27.469880 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.469854    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs" event={"ID":"9e622d1c-2f11-4075-a17d-6892ffed5201","Type":"ContainerStarted","Data":"dd285615bcf841740f2a7f9168747260b19aa393f8c540fa87ba38cf5d41ebbe"}
Sep 09 20:00:27.471420 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.471399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g" event={"ID":"7200ec65-bb90-4cf4-ab84-b67d13355f6d","Type":"ContainerStarted","Data":"cc87e8d691144b1634a1b0763b910d1557095179256db1bbaddbcca9a4f8d15e"}
Sep 09 20:00:27.471593 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.471579    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:27.476340 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.476323    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g"
Sep 09 20:00:27.490670 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.490584    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs" podStartSLOduration=1.979546766 podStartE2EDuration="4.490570915s" totalImagesPullingTime="2.511024149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:27.490010212 +0000 UTC m=+325.540155298" watchObservedRunningTime="2026-09-09 20:00:27.490570915 +0000 UTC m=+325.540715989"
Sep 09 20:00:27.506980 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:27.506933    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-2pq7g" podStartSLOduration=1.440581754 podStartE2EDuration="3.506915731s" totalImagesPullingTime="2.066333977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:27.505551414 +0000 UTC m=+325.555696499" watchObservedRunningTime="2026-09-09 20:00:27.506915731 +0000 UTC m=+325.557060817"
Sep 09 20:00:28.660057 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:28.660025    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:28.732097 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:28.732058    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:29.482624 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.482537    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerStarted","Data":"47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b"}
Sep 09 20:00:29.510650 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.510301    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.454726066 podStartE2EDuration="9.510279664s" totalImagesPullingTime="6.040265687s" totalInitContainerRuntime="15.287911ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:00:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:29.508492622 +0000 UTC m=+327.558637705" watchObservedRunningTime="2026-09-09 20:00:29.510279664 +0000 UTC m=+327.560424747"
Sep 09 20:00:29.579828 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.579798    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-942ng"]
Sep 09 20:00:29.583037 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.583021    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-942ng"
Sep 09 20:00:29.585328 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.585294    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hl9rk\""
Sep 09 20:00:29.585495 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.585393    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 20:00:29.585560 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.585511    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 20:00:29.586011 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.585992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:29.592309 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.592290    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-942ng"]
Sep 09 20:00:29.648558 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.648525    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:29.684858 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.684834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmhr\" (UniqueName: \"kubernetes.io/projected/462ca00c-a3af-41f4-adaf-da453d446497-kube-api-access-7gmhr\") pod \"downloads-85d98c998f-942ng\" (UID: \"462ca00c-a3af-41f4-adaf-da453d446497\") " pod="openshift-console/downloads-85d98c998f-942ng"
Sep 09 20:00:29.705316 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.705285    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:29.785667 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.785638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmhr\" (UniqueName: \"kubernetes.io/projected/462ca00c-a3af-41f4-adaf-da453d446497-kube-api-access-7gmhr\") pod \"downloads-85d98c998f-942ng\" (UID: \"462ca00c-a3af-41f4-adaf-da453d446497\") " pod="openshift-console/downloads-85d98c998f-942ng"
Sep 09 20:00:29.794869 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.794840    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmhr\" (UniqueName: \"kubernetes.io/projected/462ca00c-a3af-41f4-adaf-da453d446497-kube-api-access-7gmhr\") pod \"downloads-85d98c998f-942ng\" (UID: \"462ca00c-a3af-41f4-adaf-da453d446497\") " pod="openshift-console/downloads-85d98c998f-942ng"
Sep 09 20:00:29.877082 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.877048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:29.892564 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:29.892532    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-942ng"
Sep 09 20:00:30.165809 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:30.165712    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-942ng"]
Sep 09 20:00:30.168132 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:30.168101    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462ca00c_a3af_41f4_adaf_da453d446497.slice/crio-ce24ecb8aa4fe1384cd1be9b0cf403e6c8322b31c5c0276534c31230988b4e58 WatchSource:0}: Error finding container ce24ecb8aa4fe1384cd1be9b0cf403e6c8322b31c5c0276534c31230988b4e58: Status 404 returned error can't find the container with id ce24ecb8aa4fe1384cd1be9b0cf403e6c8322b31c5c0276534c31230988b4e58
Sep 09 20:00:30.249372 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:30.249338    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:30.309170 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:30.309142    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:30.450399 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:30.450316    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:30.487101 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:30.487070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-942ng" event={"ID":"462ca00c-a3af-41f4-adaf-da453d446497","Type":"ContainerStarted","Data":"ce24ecb8aa4fe1384cd1be9b0cf403e6c8322b31c5c0276534c31230988b4e58"}
Sep 09 20:00:30.505722 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:30.505691    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:30.671209 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:30.671170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:30.771270 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:30.771186    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:31.466133 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:31.466099    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:31.651510 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:31.651448    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:31.709717 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:31.709678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:32.086325 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:32.086287    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:32.145092 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:32.145060    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:34.819868 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:34.819825    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:34.888637 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:34.888577    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:34.926555 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:34.926522    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75899d678-jvmfd"]
Sep 09 20:00:34.926836 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:00:34.926813    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-75899d678-jvmfd" podUID="c219f78f-2f2a-49a5-ba5e-8da22b61e858"
Sep 09 20:00:35.009615 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.009579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:35.113660 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.113582    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:35.175515 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.175485    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:35.509915 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.509838    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 20:00:35.518151 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.518127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 20:00:35.641538 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.641500    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-image-registry-private-configuration\") pod \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") "
Sep 09 20:00:35.641721 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.641548    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-trusted-ca\") pod \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") "
Sep 09 20:00:35.641721 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.641591    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c219f78f-2f2a-49a5-ba5e-8da22b61e858-ca-trust-extracted\") pod \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") "
Sep 09 20:00:35.641721 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.641636    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n62t9\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-kube-api-access-n62t9\") pod \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") "
Sep 09 20:00:35.641721 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.641684    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-bound-sa-token\") pod \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") "
Sep 09 20:00:35.641721 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.641718    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-certificates\") pod \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") "
Sep 09 20:00:35.641985 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.641765    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-installation-pull-secrets\") pod \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\" (UID: \"c219f78f-2f2a-49a5-ba5e-8da22b61e858\") "
Sep 09 20:00:35.641985 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.641926    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c219f78f-2f2a-49a5-ba5e-8da22b61e858-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c219f78f-2f2a-49a5-ba5e-8da22b61e858" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:00:35.642102 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.642065    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c219f78f-2f2a-49a5-ba5e-8da22b61e858" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:00:35.642153 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.642069    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c219f78f-2f2a-49a5-ba5e-8da22b61e858-ca-trust-extracted\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:00:35.642399 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.642361    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c219f78f-2f2a-49a5-ba5e-8da22b61e858" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:00:35.644591 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.644551    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c219f78f-2f2a-49a5-ba5e-8da22b61e858" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:00:35.646827 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.646788    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c219f78f-2f2a-49a5-ba5e-8da22b61e858" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:00:35.646827 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.646798    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c219f78f-2f2a-49a5-ba5e-8da22b61e858" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:00:35.647099 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.647081    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-kube-api-access-n62t9" (OuterVolumeSpecName: "kube-api-access-n62t9") pod "c219f78f-2f2a-49a5-ba5e-8da22b61e858" (UID: "c219f78f-2f2a-49a5-ba5e-8da22b61e858"). InnerVolumeSpecName "kube-api-access-n62t9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:00:35.742908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.742800    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-image-registry-private-configuration\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:00:35.742908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.742840    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-trusted-ca\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:00:35.742908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.742854    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n62t9\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-kube-api-access-n62t9\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:00:35.742908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.742863    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-bound-sa-token\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:00:35.742908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.742873    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-certificates\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:00:35.742908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:35.742882    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c219f78f-2f2a-49a5-ba5e-8da22b61e858-installation-pull-secrets\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:00:36.514272 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:36.514235    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75899d678-jvmfd"
Sep 09 20:00:36.548080 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:36.548029    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75899d678-jvmfd"]
Sep 09 20:00:36.553865 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:36.553836    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75899d678-jvmfd"]
Sep 09 20:00:36.651422 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:36.651386    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c219f78f-2f2a-49a5-ba5e-8da22b61e858-registry-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:00:37.195035 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:37.195000    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:37.251545 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:37.251509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:38.446996 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:38.446957    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c219f78f-2f2a-49a5-ba5e-8da22b61e858" path="/var/lib/kubelet/pods/c219f78f-2f2a-49a5-ba5e-8da22b61e858/volumes"
Sep 09 20:00:39.102030 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.101999    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c4ff4c579-9jb88"]
Sep 09 20:00:39.106882 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.106854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.109263 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.109231    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 09 20:00:39.109395 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.109277    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 09 20:00:39.109395 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.109315    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 09 20:00:39.109395 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.109370    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tcjjq\""
Sep 09 20:00:39.109567 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.109406    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 09 20:00:39.109567 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.109279    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 09 20:00:39.116831 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.116810    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4ff4c579-9jb88"]
Sep 09 20:00:39.176916 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.176878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-oauth-config\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.177078 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.176925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-serving-cert\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.177078 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.176953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znncj\" (UniqueName: \"kubernetes.io/projected/8499d285-fa68-441c-b414-9fcc9af38e67-kube-api-access-znncj\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.177078 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.176987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-console-config\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.177078 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.177015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-oauth-serving-cert\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.177265 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.177125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-service-ca\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.278051 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.278018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-oauth-config\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.278051 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.278051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-serving-cert\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.278279 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.278071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znncj\" (UniqueName: \"kubernetes.io/projected/8499d285-fa68-441c-b414-9fcc9af38e67-kube-api-access-znncj\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.278279 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.278096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-console-config\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.278279 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.278232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-oauth-serving-cert\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.278426 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.278385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-service-ca\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.278849 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.278822    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-console-config\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.279093 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.279068    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-oauth-serving-cert\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.279582 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.279537    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-service-ca\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.281100 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.281082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-serving-cert\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.281421 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.281405    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-oauth-config\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.286620 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.286595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znncj\" (UniqueName: \"kubernetes.io/projected/8499d285-fa68-441c-b414-9fcc9af38e67-kube-api-access-znncj\") pod \"console-c4ff4c579-9jb88\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") " pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.419584 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.419491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:00:39.703329 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:39.703253    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c4ff4c579-9jb88"]
Sep 09 20:00:39.705664 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:39.705631    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8499d285_fa68_441c_b414_9fcc9af38e67.slice/crio-3ddc30300ab6b62d294fde868688d069d9f34003cc3b4ff2e22b4ea695ec004d WatchSource:0}: Error finding container 3ddc30300ab6b62d294fde868688d069d9f34003cc3b4ff2e22b4ea695ec004d: Status 404 returned error can't find the container with id 3ddc30300ab6b62d294fde868688d069d9f34003cc3b4ff2e22b4ea695ec004d
Sep 09 20:00:40.533949 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:40.533915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4ff4c579-9jb88" event={"ID":"8499d285-fa68-441c-b414-9fcc9af38e67","Type":"ContainerStarted","Data":"3ddc30300ab6b62d294fde868688d069d9f34003cc3b4ff2e22b4ea695ec004d"}
Sep 09 20:00:42.531832 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:42.531788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:42.631169 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:42.631122    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:43.883093 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:43.882914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:43.983126 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:43.983088    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:44.085209 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:44.085167    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:44.218340 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:44.218256    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:44.218514 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:44.218365    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:00:47.088029 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.087995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:47.273358 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.272493    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b7d8497b-gplxh"]
Sep 09 20:00:47.277311 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.277280    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.285418 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.285391    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7d8497b-gplxh"]
Sep 09 20:00:47.286192 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.285781    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 09 20:00:47.354448 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.354408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-console-config\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.354633 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.354487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-oauth-config\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.354633 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.354529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-serving-cert\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.354633 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.354574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdmvl\" (UniqueName: \"kubernetes.io/projected/f2222a13-d5a9-4716-be76-afafb43c4e38-kube-api-access-kdmvl\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.354633 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.354602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-trusted-ca-bundle\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.354633 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.354631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-service-ca\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.354859 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.354687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-oauth-serving-cert\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.455714 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.455651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-oauth-serving-cert\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.455908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.455791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-console-config\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.455908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.455832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-oauth-config\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.455908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.455860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-serving-cert\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.455908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.455906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdmvl\" (UniqueName: \"kubernetes.io/projected/f2222a13-d5a9-4716-be76-afafb43c4e38-kube-api-access-kdmvl\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.456171 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.455940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-trusted-ca-bundle\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.456171 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.455971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-service-ca\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.456611 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.456579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-oauth-serving-cert\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.456740 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.456716    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-service-ca\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.457724 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.457688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-console-config\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.457860 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.457753    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-trusted-ca-bundle\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.461925 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.460668    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-oauth-config\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.461925 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.461144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-serving-cert\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.466392 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.466349    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdmvl\" (UniqueName: \"kubernetes.io/projected/f2222a13-d5a9-4716-be76-afafb43c4e38-kube-api-access-kdmvl\") pod \"console-b7d8497b-gplxh\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") " pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.571701 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.570639    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-942ng" event={"ID":"462ca00c-a3af-41f4-adaf-da453d446497","Type":"ContainerStarted","Data":"3400513c31fab00c934386e6d82b5e6d2921c831b1bf36de1ad4dea4207253bf"}
Sep 09 20:00:47.571701 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.571653    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-942ng"
Sep 09 20:00:47.581515 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.581433    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-942ng"
Sep 09 20:00:47.589048 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.588980    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-942ng" podStartSLOduration=1.750676519 podStartE2EDuration="18.588964301s" totalImagesPullingTime="16.838287782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:47.587188975 +0000 UTC m=+345.637334089" watchObservedRunningTime="2026-09-09 20:00:47.588964301 +0000 UTC m=+345.639109400"
Sep 09 20:00:47.608181 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.608145    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:47.924119 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:47.924030    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7d8497b-gplxh"]
Sep 09 20:00:47.929549 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:00:47.929506    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2222a13_d5a9_4716_be76_afafb43c4e38.slice/crio-668c172686a69188410eae84aaa1a0c06ed042d36a64a5e7947a93435e95acb0 WatchSource:0}: Error finding container 668c172686a69188410eae84aaa1a0c06ed042d36a64a5e7947a93435e95acb0: Status 404 returned error can't find the container with id 668c172686a69188410eae84aaa1a0c06ed042d36a64a5e7947a93435e95acb0
Sep 09 20:00:48.097824 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:48.097791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:48.578384 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:48.578339    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7d8497b-gplxh" event={"ID":"f2222a13-d5a9-4716-be76-afafb43c4e38","Type":"ContainerStarted","Data":"668c172686a69188410eae84aaa1a0c06ed042d36a64a5e7947a93435e95acb0"}
Sep 09 20:00:48.682764 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:48.682703    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:49.308191 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:49.308064    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:51.595633 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:51.595597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4ff4c579-9jb88" event={"ID":"8499d285-fa68-441c-b414-9fcc9af38e67","Type":"ContainerStarted","Data":"30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2"}
Sep 09 20:00:51.613863 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:51.613814    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c4ff4c579-9jb88" podStartSLOduration=1.814756431 podStartE2EDuration="12.613795509s" totalImagesPullingTime="10.799039078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:51.613063827 +0000 UTC m=+349.663208906" watchObservedRunningTime="2026-09-09 20:00:51.613795509 +0000 UTC m=+349.663940594"
Sep 09 20:00:52.602743 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:52.602701    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7d8497b-gplxh" event={"ID":"f2222a13-d5a9-4716-be76-afafb43c4e38","Type":"ContainerStarted","Data":"365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15"}
Sep 09 20:00:52.620835 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:52.620778    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b7d8497b-gplxh" podStartSLOduration=1.7914937659999999 podStartE2EDuration="5.620755302s" totalImagesPullingTime="3.829261536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:00:52.619686238 +0000 UTC m=+350.669831333" watchObservedRunningTime="2026-09-09 20:00:52.620755302 +0000 UTC m=+350.670900389"
Sep 09 20:00:56.152930 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:56.152831    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:56.211087 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:56.211050    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:56.397873 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:56.397842    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:56.457145 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:56.457070    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:57.608768 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:57.608734    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:57.609183 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:57.608816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:57.613495 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:57.613451    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:57.629292 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:57.629271    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:00:57.678103 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:57.678072    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4ff4c579-9jb88"]
Sep 09 20:00:57.785182 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:57.785145    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:57.886080 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:57.885998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:57.939829 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:57.939796    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:58.330756 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:58.330721    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:58.382523 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:58.382488    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:00:59.419618 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:00:59.419579    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:01:04.223588 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:04.223555    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:01:04.227455 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:04.227436    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d5c855f46-xnvfs"
Sep 09 20:01:06.661854 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:06.661772    2577 generic.go:356] "Generic (PLEG): container finished" podID="1f342115-6774-487f-b9f0-32e8ddda3db7" containerID="3bc1f2e065ebe3e9071b021868d8677e0a152901079586120a58ebf9f7233ac2" exitCode=0
Sep 09 20:01:06.661854 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:06.661835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4" event={"ID":"1f342115-6774-487f-b9f0-32e8ddda3db7","Type":"ContainerDied","Data":"3bc1f2e065ebe3e9071b021868d8677e0a152901079586120a58ebf9f7233ac2"}
Sep 09 20:01:06.662229 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:06.662163    2577 scope.go:117] "RemoveContainer" containerID="3bc1f2e065ebe3e9071b021868d8677e0a152901079586120a58ebf9f7233ac2"
Sep 09 20:01:07.672030 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:07.671994    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-lwpq4" event={"ID":"1f342115-6774-487f-b9f0-32e8ddda3db7","Type":"ContainerStarted","Data":"12707ca470d80e4f3ff6d5538209a4930c018e732b15c9bc5897d8e0900dec0e"}
Sep 09 20:01:08.835968 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:08.835914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:08.936596 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:08.936556    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:11.399459 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:11.399428    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:11.501415 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:11.501379    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:15.305916 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:15.305880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 20:01:15.308405 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:15.308384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0ea2929-722b-472c-ab75-2bd456540d9a-metrics-certs\") pod \"network-metrics-daemon-dbvkj\" (UID: \"b0ea2929-722b-472c-ab75-2bd456540d9a\") " pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 20:01:15.544120 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:15.544087    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cpmqx\""
Sep 09 20:01:15.552809 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:15.552787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbvkj"
Sep 09 20:01:15.872953 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:15.872930    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dbvkj"]
Sep 09 20:01:15.875332 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:01:15.875300    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ea2929_722b_472c_ab75_2bd456540d9a.slice/crio-bf2c0d4ff6ad8e5fe5e6f49e3dadfd980a53e717c21ea0c59197a6fbb9537615 WatchSource:0}: Error finding container bf2c0d4ff6ad8e5fe5e6f49e3dadfd980a53e717c21ea0c59197a6fbb9537615: Status 404 returned error can't find the container with id bf2c0d4ff6ad8e5fe5e6f49e3dadfd980a53e717c21ea0c59197a6fbb9537615
Sep 09 20:01:16.705906 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:16.705873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbvkj" event={"ID":"b0ea2929-722b-472c-ab75-2bd456540d9a","Type":"ContainerStarted","Data":"bf2c0d4ff6ad8e5fe5e6f49e3dadfd980a53e717c21ea0c59197a6fbb9537615"}
Sep 09 20:01:18.209171 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:18.209143    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:18.309594 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:18.309566    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:18.715504 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:18.715385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbvkj" event={"ID":"b0ea2929-722b-472c-ab75-2bd456540d9a","Type":"ContainerStarted","Data":"e98ebf05353a1f13e4f8486da5b92bfe8899baea2e6fd562f6c48b083fe0d497"}
Sep 09 20:01:18.715504 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:18.715439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbvkj" event={"ID":"b0ea2929-722b-472c-ab75-2bd456540d9a","Type":"ContainerStarted","Data":"81920a555f4374b227085210dda89436f9bea293f3f5f01465e63b880773bb8d"}
Sep 09 20:01:18.734301 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:18.734046    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dbvkj" podStartSLOduration=373.479680241 podStartE2EDuration="6m15.734027937s" totalImagesPullingTime="2.254347696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:01:18.733398126 +0000 UTC m=+376.783543212" watchObservedRunningTime="2026-09-09 20:01:18.734027937 +0000 UTC m=+376.784173023"
Sep 09 20:01:18.829655 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:18.829622    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:19.495839 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:19.495805    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:22.698317 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:22.698256    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c4ff4c579-9jb88" podUID="8499d285-fa68-441c-b414-9fcc9af38e67" containerName="console" containerID="cri-o://30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2" gracePeriod=15
Sep 09 20:01:22.971034 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:22.970978    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:01:23.075146 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.075112    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znncj\" (UniqueName: \"kubernetes.io/projected/8499d285-fa68-441c-b414-9fcc9af38e67-kube-api-access-znncj\") pod \"8499d285-fa68-441c-b414-9fcc9af38e67\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") "
Sep 09 20:01:23.075317 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.075180    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-oauth-config\") pod \"8499d285-fa68-441c-b414-9fcc9af38e67\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") "
Sep 09 20:01:23.075317 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.075211    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-console-config\") pod \"8499d285-fa68-441c-b414-9fcc9af38e67\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") "
Sep 09 20:01:23.075317 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.075240    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-oauth-serving-cert\") pod \"8499d285-fa68-441c-b414-9fcc9af38e67\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") "
Sep 09 20:01:23.075518 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.075353    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-serving-cert\") pod \"8499d285-fa68-441c-b414-9fcc9af38e67\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") "
Sep 09 20:01:23.075518 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.075405    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-service-ca\") pod \"8499d285-fa68-441c-b414-9fcc9af38e67\" (UID: \"8499d285-fa68-441c-b414-9fcc9af38e67\") "
Sep 09 20:01:23.075735 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.075693    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-console-config" (OuterVolumeSpecName: "console-config") pod "8499d285-fa68-441c-b414-9fcc9af38e67" (UID: "8499d285-fa68-441c-b414-9fcc9af38e67"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:01:23.075735 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.075712    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8499d285-fa68-441c-b414-9fcc9af38e67" (UID: "8499d285-fa68-441c-b414-9fcc9af38e67"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:01:23.075887 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.075787    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-service-ca" (OuterVolumeSpecName: "service-ca") pod "8499d285-fa68-441c-b414-9fcc9af38e67" (UID: "8499d285-fa68-441c-b414-9fcc9af38e67"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:01:23.077704 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.077677    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8499d285-fa68-441c-b414-9fcc9af38e67" (UID: "8499d285-fa68-441c-b414-9fcc9af38e67"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:01:23.078096 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.078072    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8499d285-fa68-441c-b414-9fcc9af38e67" (UID: "8499d285-fa68-441c-b414-9fcc9af38e67"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:01:23.078096 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.078082    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8499d285-fa68-441c-b414-9fcc9af38e67-kube-api-access-znncj" (OuterVolumeSpecName: "kube-api-access-znncj") pod "8499d285-fa68-441c-b414-9fcc9af38e67" (UID: "8499d285-fa68-441c-b414-9fcc9af38e67"). InnerVolumeSpecName "kube-api-access-znncj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:01:23.176710 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.176674    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znncj\" (UniqueName: \"kubernetes.io/projected/8499d285-fa68-441c-b414-9fcc9af38e67-kube-api-access-znncj\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:23.176710 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.176703    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-oauth-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:23.176710 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.176712    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-console-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:23.176710 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.176721    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-oauth-serving-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:23.176975 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.176729    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8499d285-fa68-441c-b414-9fcc9af38e67-console-serving-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:23.176975 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.176738    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8499d285-fa68-441c-b414-9fcc9af38e67-service-ca\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:23.735428 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.735394    2577 generic.go:356] "Generic (PLEG): container finished" podID="8499d285-fa68-441c-b414-9fcc9af38e67" containerID="30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2" exitCode=0
Sep 09 20:01:23.735862 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.735441    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c4ff4c579-9jb88"
Sep 09 20:01:23.735862 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.735494    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4ff4c579-9jb88" event={"ID":"8499d285-fa68-441c-b414-9fcc9af38e67","Type":"ContainerDied","Data":"30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2"}
Sep 09 20:01:23.735862 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.735545    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c4ff4c579-9jb88" event={"ID":"8499d285-fa68-441c-b414-9fcc9af38e67","Type":"ContainerDied","Data":"3ddc30300ab6b62d294fde868688d069d9f34003cc3b4ff2e22b4ea695ec004d"}
Sep 09 20:01:23.735862 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.735565    2577 scope.go:117] "RemoveContainer" containerID="30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2"
Sep 09 20:01:23.752582 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.752568    2577 scope.go:117] "RemoveContainer" containerID="30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2"
Sep 09 20:01:23.752889 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:23.752862    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2\": container with ID starting with 30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2 not found: ID does not exist" containerID="30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2"
Sep 09 20:01:23.752933 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.752895    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2"} err="failed to get container status \"30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2\": rpc error: code = NotFound desc = could not find container \"30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2\": container with ID starting with 30e21b00bf324bd7cacfed2c38db9368922686de9768719ce9a988d45f8a42f2 not found: ID does not exist"
Sep 09 20:01:23.755547 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.755525    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c4ff4c579-9jb88"]
Sep 09 20:01:23.760564 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:23.760545    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c4ff4c579-9jb88"]
Sep 09 20:01:24.451370 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:24.451338    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8499d285-fa68-441c-b414-9fcc9af38e67" path="/var/lib/kubelet/pods/8499d285-fa68-441c-b414-9fcc9af38e67/volumes"
Sep 09 20:01:38.801840 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:38.801804    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:38.902487 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:38.902444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:39.868609 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:39.868575    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:01:39.868992 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:39.868851    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="alertmanager" containerID="cri-o://3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3" gracePeriod=120
Sep 09 20:01:39.868992 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:39.868916    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy-metric" containerID="cri-o://7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0" gracePeriod=120
Sep 09 20:01:39.868992 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:39.868954    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="prom-label-proxy" containerID="cri-o://47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b" gracePeriod=120
Sep 09 20:01:39.869171 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:39.868999    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy" containerID="cri-o://665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1" gracePeriod=120
Sep 09 20:01:39.869171 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:39.868999    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="config-reloader" containerID="cri-o://4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2" gracePeriod=120
Sep 09 20:01:39.869171 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:39.868974    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy-web" containerID="cri-o://bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda" gracePeriod=120
Sep 09 20:01:40.805973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.805944    2577 generic.go:356] "Generic (PLEG): container finished" podID="c711495a-fec1-4070-bbe4-389b9d571732" containerID="47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b" exitCode=0
Sep 09 20:01:40.805973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.805966    2577 generic.go:356] "Generic (PLEG): container finished" podID="c711495a-fec1-4070-bbe4-389b9d571732" containerID="7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0" exitCode=0
Sep 09 20:01:40.805973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.805972    2577 generic.go:356] "Generic (PLEG): container finished" podID="c711495a-fec1-4070-bbe4-389b9d571732" containerID="665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1" exitCode=0
Sep 09 20:01:40.805973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.805977    2577 generic.go:356] "Generic (PLEG): container finished" podID="c711495a-fec1-4070-bbe4-389b9d571732" containerID="4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2" exitCode=0
Sep 09 20:01:40.805973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.805982    2577 generic.go:356] "Generic (PLEG): container finished" podID="c711495a-fec1-4070-bbe4-389b9d571732" containerID="3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3" exitCode=0
Sep 09 20:01:40.806255 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.806013    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerDied","Data":"47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b"}
Sep 09 20:01:40.806255 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.806078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerDied","Data":"7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0"}
Sep 09 20:01:40.806255 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.806106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerDied","Data":"665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1"}
Sep 09 20:01:40.806255 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.806132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerDied","Data":"4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2"}
Sep 09 20:01:40.806255 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:40.806158    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerDied","Data":"3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3"}
Sep 09 20:01:41.113350 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.113327    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:41.232388 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232354    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnjnm\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-kube-api-access-tnjnm\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232388 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232388    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232408    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-config-out\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232427    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-config-volume\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232462    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-web-config\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232522    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-metrics-client-ca\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232549    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-tls-assets\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232589    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-trusted-ca-bundle\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232619    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-cluster-tls-config\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232658    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-main-db\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232692    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-web\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232720    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-main-tls\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232809    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c711495a-fec1-4070-bbe4-389b9d571732\" (UID: \"c711495a-fec1-4070-bbe4-389b9d571732\") "
Sep 09 20:01:41.232973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.232888    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:01:41.233558 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.233248    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-metrics-client-ca\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.235428 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.235405    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-config-out" (OuterVolumeSpecName: "config-out") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:01:41.235751 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.235719    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-kube-api-access-tnjnm" (OuterVolumeSpecName: "kube-api-access-tnjnm") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "kube-api-access-tnjnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:01:41.235849 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.235750    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:01:41.236076 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.236015    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-config-volume" (OuterVolumeSpecName: "config-volume") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:01:41.236076 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.236015    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:01:41.236076 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.236038    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:01:41.236382 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.236349    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:01:41.236454 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.236413    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:01:41.237938 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.237913    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:01:41.238485 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.238446    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:01:41.240272 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.240177    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:01:41.245963 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.245943    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-web-config" (OuterVolumeSpecName: "web-config") pod "c711495a-fec1-4070-bbe4-389b9d571732" (UID: "c711495a-fec1-4070-bbe4-389b9d571732"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:01:41.333979 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.333947    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.333979 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.333973    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnjnm\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-kube-api-access-tnjnm\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.333979 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.333982    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.334214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.333992    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-config-out\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.334214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.334001    2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-config-volume\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.334214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.334008    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-web-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.334214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.334015    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c711495a-fec1-4070-bbe4-389b9d571732-tls-assets\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.334214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.334022    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.334214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.334031    2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-cluster-tls-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.334214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.334040    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c711495a-fec1-4070-bbe4-389b9d571732-alertmanager-main-db\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.334214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.334048    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.334214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.334056    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c711495a-fec1-4070-bbe4-389b9d571732-secret-alertmanager-main-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:01:41.813703 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.813661    2577 generic.go:356] "Generic (PLEG): container finished" podID="c711495a-fec1-4070-bbe4-389b9d571732" containerID="bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda" exitCode=0
Sep 09 20:01:41.813874 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.813714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerDied","Data":"bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda"}
Sep 09 20:01:41.813874 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.813756    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:41.813874 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.813792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c711495a-fec1-4070-bbe4-389b9d571732","Type":"ContainerDied","Data":"f72c11cabc923931877b0fb0611ee0fcdec4fe49526a3342b116ebbc138521a2"}
Sep 09 20:01:41.813874 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.813840    2577 scope.go:117] "RemoveContainer" containerID="47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b"
Sep 09 20:01:41.821980 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.821962    2577 scope.go:117] "RemoveContainer" containerID="7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0"
Sep 09 20:01:41.829690 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.829670    2577 scope.go:117] "RemoveContainer" containerID="665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1"
Sep 09 20:01:41.837032 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.837010    2577 scope.go:117] "RemoveContainer" containerID="bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda"
Sep 09 20:01:41.837753 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.837730    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:01:41.844238 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.844213    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:01:41.844853 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.844836    2577 scope.go:117] "RemoveContainer" containerID="4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2"
Sep 09 20:01:41.851815 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.851785    2577 scope.go:117] "RemoveContainer" containerID="3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3"
Sep 09 20:01:41.858581 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.858558    2577 scope.go:117] "RemoveContainer" containerID="c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172"
Sep 09 20:01:41.870573 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.870546    2577 scope.go:117] "RemoveContainer" containerID="47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b"
Sep 09 20:01:41.870904 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:41.870884    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b\": container with ID starting with 47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b not found: ID does not exist" containerID="47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b"
Sep 09 20:01:41.870962 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.870912    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b"} err="failed to get container status \"47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b\": rpc error: code = NotFound desc = could not find container \"47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b\": container with ID starting with 47aadc8354fa320e048ad5f0dd31cc6adf102bdaecdb6685fbac60eb54716d8b not found: ID does not exist"
Sep 09 20:01:41.870962 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.870931    2577 scope.go:117] "RemoveContainer" containerID="7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0"
Sep 09 20:01:41.871196 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:41.871173    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0\": container with ID starting with 7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0 not found: ID does not exist" containerID="7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0"
Sep 09 20:01:41.871272 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871207    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0"} err="failed to get container status \"7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0\": rpc error: code = NotFound desc = could not find container \"7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0\": container with ID starting with 7d1d80677202d7208f90708b0c4197505b1ee472c9e5f32d0b268f7b3d8cc5d0 not found: ID does not exist"
Sep 09 20:01:41.871272 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871229    2577 scope.go:117] "RemoveContainer" containerID="665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1"
Sep 09 20:01:41.871501 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:41.871461    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1\": container with ID starting with 665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1 not found: ID does not exist" containerID="665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1"
Sep 09 20:01:41.871572 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871504    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1"} err="failed to get container status \"665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1\": rpc error: code = NotFound desc = could not find container \"665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1\": container with ID starting with 665d1fa832dfa931ecfca743a184c151a6c8da4f7038e8aff40a837f25505af1 not found: ID does not exist"
Sep 09 20:01:41.871572 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871517    2577 scope.go:117] "RemoveContainer" containerID="bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda"
Sep 09 20:01:41.871674 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871661    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:01:41.871784 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:41.871767    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda\": container with ID starting with bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda not found: ID does not exist" containerID="bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda"
Sep 09 20:01:41.871823 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871788    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda"} err="failed to get container status \"bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda\": rpc error: code = NotFound desc = could not find container \"bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda\": container with ID starting with bfb4d37b5116265c075aa65c44e838c20e381c07f2a6c401cc6cbcdadc4bbbda not found: ID does not exist"
Sep 09 20:01:41.871823 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871801    2577 scope.go:117] "RemoveContainer" containerID="4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2"
Sep 09 20:01:41.871968 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871951    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy"
Sep 09 20:01:41.871968 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871967    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871979    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="prom-label-proxy"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871984    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="prom-label-proxy"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871990    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="config-reloader"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.871996    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="config-reloader"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872001    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8499d285-fa68-441c-b414-9fcc9af38e67" containerName="console"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872006    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8499d285-fa68-441c-b414-9fcc9af38e67" containerName="console"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872016    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="init-config-reloader"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:41.872013    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2\": container with ID starting with 4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2 not found: ID does not exist" containerID="4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872029    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2"} err="failed to get container status \"4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2\": rpc error: code = NotFound desc = could not find container \"4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2\": container with ID starting with 4338290b48ac40053643be9fa101f435fefd03b8a7935954f6dcad4a957abae2 not found: ID does not exist"
Sep 09 20:01:41.872039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872040    2577 scope.go:117] "RemoveContainer" containerID="3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872021    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="init-config-reloader"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872097    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy-web"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872104    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy-web"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872111    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy-metric"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872116    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy-metric"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872130    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="alertmanager"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872135    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="alertmanager"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872221    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy-web"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872234    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="prom-label-proxy"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872240    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872252    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="kube-rbac-proxy-metric"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872260    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8499d285-fa68-441c-b414-9fcc9af38e67" containerName="console"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872266    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="alertmanager"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872274    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c711495a-fec1-4070-bbe4-389b9d571732" containerName="config-reloader"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:41.872336    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3\": container with ID starting with 3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3 not found: ID does not exist" containerID="3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872360    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3"} err="failed to get container status \"3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3\": rpc error: code = NotFound desc = could not find container \"3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3\": container with ID starting with 3027b341ea9237c38f16e4605537fa8193dd043ca149305c2d450d4493295ef3 not found: ID does not exist"
Sep 09 20:01:41.872391 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872379    2577 scope.go:117] "RemoveContainer" containerID="c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172"
Sep 09 20:01:41.872964 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:41.872652    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172\": container with ID starting with c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172 not found: ID does not exist" containerID="c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172"
Sep 09 20:01:41.872964 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.872680    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172"} err="failed to get container status \"c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172\": rpc error: code = NotFound desc = could not find container \"c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172\": container with ID starting with c15df59252354ce875345fc1e12a057ea1f241450676caae78ccd23a75e90172 not found: ID does not exist"
Sep 09 20:01:41.876264 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.876249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:41.878610 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.878586    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 20:01:41.878711 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.878615    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 20:01:41.878711 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.878622    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jh8v4\""
Sep 09 20:01:41.878711 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.878631    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 20:01:41.878943 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.878926    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 20:01:41.879250 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.879232    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 20:01:41.879326 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.879265    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 20:01:41.879326 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.879277    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 20:01:41.879554 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.879541    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 20:01:41.884012 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.883992    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 20:01:41.890743 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:41.890724    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:01:42.039994 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.039952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01768fca-c185-4ece-8d98-af8ef4ab17b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.039994 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.039999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l82h\" (UniqueName: \"kubernetes.io/projected/01768fca-c185-4ece-8d98-af8ef4ab17b7-kube-api-access-6l82h\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-web-config\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01768fca-c185-4ece-8d98-af8ef4ab17b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01768fca-c185-4ece-8d98-af8ef4ab17b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040139    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040170    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040199    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01768fca-c185-4ece-8d98-af8ef4ab17b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040440 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040440 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01768fca-c185-4ece-8d98-af8ef4ab17b7-config-out\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.040440 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.040303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.141398 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01768fca-c185-4ece-8d98-af8ef4ab17b7-config-out\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.141398 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.141398 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01768fca-c185-4ece-8d98-af8ef4ab17b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141404    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l82h\" (UniqueName: \"kubernetes.io/projected/01768fca-c185-4ece-8d98-af8ef4ab17b7-kube-api-access-6l82h\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141533    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-web-config\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01768fca-c185-4ece-8d98-af8ef4ab17b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01768fca-c185-4ece-8d98-af8ef4ab17b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01768fca-c185-4ece-8d98-af8ef4ab17b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.141765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142701 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.142630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01768fca-c185-4ece-8d98-af8ef4ab17b7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.142792 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.142766    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01768fca-c185-4ece-8d98-af8ef4ab17b7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.143071 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.143031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01768fca-c185-4ece-8d98-af8ef4ab17b7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.144783 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.144691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-web-config\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.144783 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.144719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.144969 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.144827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01768fca-c185-4ece-8d98-af8ef4ab17b7-config-out\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.144969 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.144887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.145489 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.145448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.145572 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.145550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-config-volume\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.145866 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.145842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.146131 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.146112    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01768fca-c185-4ece-8d98-af8ef4ab17b7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.146881 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.146863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01768fca-c185-4ece-8d98-af8ef4ab17b7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.149970 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.149949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l82h\" (UniqueName: \"kubernetes.io/projected/01768fca-c185-4ece-8d98-af8ef4ab17b7-kube-api-access-6l82h\") pod \"alertmanager-main-0\" (UID: \"01768fca-c185-4ece-8d98-af8ef4ab17b7\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.185907 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.185879    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 20:01:42.446319 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.446246    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c711495a-fec1-4070-bbe4-389b9d571732" path="/var/lib/kubelet/pods/c711495a-fec1-4070-bbe4-389b9d571732/volumes"
Sep 09 20:01:42.465008 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.464986    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 20:01:42.467133 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:01:42.467109    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01768fca_c185_4ece_8d98_af8ef4ab17b7.slice/crio-714d00736c479503d2358d452faf6b3c215a10785a4236c626c6fc0bdd1fbed5 WatchSource:0}: Error finding container 714d00736c479503d2358d452faf6b3c215a10785a4236c626c6fc0bdd1fbed5: Status 404 returned error can't find the container with id 714d00736c479503d2358d452faf6b3c215a10785a4236c626c6fc0bdd1fbed5
Sep 09 20:01:42.819388 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.819361    2577 generic.go:356] "Generic (PLEG): container finished" podID="01768fca-c185-4ece-8d98-af8ef4ab17b7" containerID="472e84d60667c4758ddef630ddecfdad4fb8c8c8ea09eda701acf34787bda971" exitCode=0
Sep 09 20:01:42.819580 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.819456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01768fca-c185-4ece-8d98-af8ef4ab17b7","Type":"ContainerDied","Data":"472e84d60667c4758ddef630ddecfdad4fb8c8c8ea09eda701acf34787bda971"}
Sep 09 20:01:42.819580 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:42.819565    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01768fca-c185-4ece-8d98-af8ef4ab17b7","Type":"ContainerStarted","Data":"714d00736c479503d2358d452faf6b3c215a10785a4236c626c6fc0bdd1fbed5"}
Sep 09 20:01:43.831018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.830981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01768fca-c185-4ece-8d98-af8ef4ab17b7","Type":"ContainerStarted","Data":"612a57d4f8c799f72157cb0196c17148a6860cd484e8accb947f0e7859236c81"}
Sep 09 20:01:43.831532 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.831082    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01768fca-c185-4ece-8d98-af8ef4ab17b7","Type":"ContainerStarted","Data":"5bd0cef1bd5f64ebc70d4f7458c5c0d0bb4a4a73eb85616db4260adee04eb236"}
Sep 09 20:01:43.831532 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.831115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01768fca-c185-4ece-8d98-af8ef4ab17b7","Type":"ContainerStarted","Data":"5b41e7d2365a8f259730a4609f8959f479b8d932f62576b92d3e98d6e6a51eeb"}
Sep 09 20:01:43.831532 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.831139    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01768fca-c185-4ece-8d98-af8ef4ab17b7","Type":"ContainerStarted","Data":"424f2349755981a5b6c33e2610536d125fa524603e30726890859a449ac40d01"}
Sep 09 20:01:43.831532 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.831172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01768fca-c185-4ece-8d98-af8ef4ab17b7","Type":"ContainerStarted","Data":"6be45581ecdeeb17a3b6dc42894ae69be83d9255c9715cf1144265c39caf4c36"}
Sep 09 20:01:43.831532 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.831196    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01768fca-c185-4ece-8d98-af8ef4ab17b7","Type":"ContainerStarted","Data":"29cc9df924f9ef4fd8dcbc25cdfbf80d6ea89358a52dd0a5962f3807d189b366"}
Sep 09 20:01:43.858164 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.858108    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.841390155 podStartE2EDuration="2.858093234s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.703079ms" isStatefulPod=false podCreationTimestamp="2026-09-09 20:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:01:43.856361797 +0000 UTC m=+401.906506880" watchObservedRunningTime="2026-09-09 20:01:43.858093234 +0000 UTC m=+401.908238317"
Sep 09 20:01:43.915776 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.915739    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"]
Sep 09 20:01:43.919190 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.919160    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:43.922775 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.922749    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 09 20:01:43.922920 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.922808    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-g9s96\""
Sep 09 20:01:43.922920 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.922751    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 09 20:01:43.923094 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.923079    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 09 20:01:43.923154 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.923100    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 09 20:01:43.923259 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.923229    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 09 20:01:43.930820 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.930633    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 09 20:01:43.934044 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:43.934014    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"]
Sep 09 20:01:44.057562 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.057515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ee206-2394-41f8-9506-2ccd29f9fe26-serving-certs-ca-bundle\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.057708 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.057570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ee206-2394-41f8-9506-2ccd29f9fe26-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.057765 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.057720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-telemeter-client-tls\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.057800 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.057764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp4vf\" (UniqueName: \"kubernetes.io/projected/d21ee206-2394-41f8-9506-2ccd29f9fe26-kube-api-access-rp4vf\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.057847 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.057831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-secret-telemeter-client\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.057884 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.057862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.057947 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.057934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21ee206-2394-41f8-9506-2ccd29f9fe26-metrics-client-ca\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.057993 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.057979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-federate-client-tls\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.158857 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.158749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-telemeter-client-tls\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.158857 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.158794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp4vf\" (UniqueName: \"kubernetes.io/projected/d21ee206-2394-41f8-9506-2ccd29f9fe26-kube-api-access-rp4vf\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.159091 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.158937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-secret-telemeter-client\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.159091 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.158987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.159091 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.159063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21ee206-2394-41f8-9506-2ccd29f9fe26-metrics-client-ca\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.159254 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.159107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-federate-client-tls\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.159314 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.159290    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ee206-2394-41f8-9506-2ccd29f9fe26-serving-certs-ca-bundle\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.159370 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.159337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ee206-2394-41f8-9506-2ccd29f9fe26-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.159842 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.159811    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d21ee206-2394-41f8-9506-2ccd29f9fe26-metrics-client-ca\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.160613 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.160591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ee206-2394-41f8-9506-2ccd29f9fe26-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.161185 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.161156    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d21ee206-2394-41f8-9506-2ccd29f9fe26-serving-certs-ca-bundle\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.161606 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.161586    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-secret-telemeter-client\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.161904 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.161878    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-telemeter-client-tls\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.161992 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.161964    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.162124 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.162105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d21ee206-2394-41f8-9506-2ccd29f9fe26-federate-client-tls\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.166338 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.166318    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp4vf\" (UniqueName: \"kubernetes.io/projected/d21ee206-2394-41f8-9506-2ccd29f9fe26-kube-api-access-rp4vf\") pod \"telemeter-client-6c89c46b95-lxwp4\" (UID: \"d21ee206-2394-41f8-9506-2ccd29f9fe26\") " pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.233928 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.233868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"
Sep 09 20:01:44.270346 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:44.270291    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt" podUID="9bb964a1-a5d5-4d9c-99f7-5ad5427250f8"
Sep 09 20:01:44.270556 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:01:44.270400    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6dthr" podUID="722fc986-cfd8-49ad-abe7-c1ce42b9f52f"
Sep 09 20:01:44.518879 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.518856    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c89c46b95-lxwp4"]
Sep 09 20:01:44.521243 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:01:44.521215    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21ee206_2394_41f8_9506_2ccd29f9fe26.slice/crio-fa976a2856fda36cd9e685740c169aca13be971f7ba120e3555a350cdaf852d8 WatchSource:0}: Error finding container fa976a2856fda36cd9e685740c169aca13be971f7ba120e3555a350cdaf852d8: Status 404 returned error can't find the container with id fa976a2856fda36cd9e685740c169aca13be971f7ba120e3555a350cdaf852d8
Sep 09 20:01:44.836956 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.836930    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dthr"
Sep 09 20:01:44.837342 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.836979    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4" event={"ID":"d21ee206-2394-41f8-9506-2ccd29f9fe26","Type":"ContainerStarted","Data":"fa976a2856fda36cd9e685740c169aca13be971f7ba120e3555a350cdaf852d8"}
Sep 09 20:01:44.837342 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:44.837023    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 20:01:46.383546 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:46.383462    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 20:01:46.383981 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:46.383666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 20:01:46.386100 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:46.386070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/722fc986-cfd8-49ad-abe7-c1ce42b9f52f-metrics-tls\") pod \"dns-default-6dthr\" (UID: \"722fc986-cfd8-49ad-abe7-c1ce42b9f52f\") " pod="openshift-dns/dns-default-6dthr"
Sep 09 20:01:46.386222 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:46.386159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9bb964a1-a5d5-4d9c-99f7-5ad5427250f8-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-2cpgt\" (UID: \"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8\") " pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 20:01:46.639941 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:46.639851    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vfsnk\""
Sep 09 20:01:46.640392 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:46.640364    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4z7jm\""
Sep 09 20:01:46.647950 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:46.647924    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt"
Sep 09 20:01:46.648069 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:46.647953    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6dthr"
Sep 09 20:01:47.058698 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.058628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6dthr"]
Sep 09 20:01:47.060667 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:01:47.060596    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722fc986_cfd8_49ad_abe7_c1ce42b9f52f.slice/crio-7fbb22b84ffb3536400aa1dabbb066ed808dab0cd12e35564ce92d8adc46ff46 WatchSource:0}: Error finding container 7fbb22b84ffb3536400aa1dabbb066ed808dab0cd12e35564ce92d8adc46ff46: Status 404 returned error can't find the container with id 7fbb22b84ffb3536400aa1dabbb066ed808dab0cd12e35564ce92d8adc46ff46
Sep 09 20:01:47.061023 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.060958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-2cpgt"]
Sep 09 20:01:47.063125 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:01:47.063106    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb964a1_a5d5_4d9c_99f7_5ad5427250f8.slice/crio-d454cb55df136afb6f1c41d30ea3e19c95c1513b6159e748785f336ad275ce16 WatchSource:0}: Error finding container d454cb55df136afb6f1c41d30ea3e19c95c1513b6159e748785f336ad275ce16: Status 404 returned error can't find the container with id d454cb55df136afb6f1c41d30ea3e19c95c1513b6159e748785f336ad275ce16
Sep 09 20:01:47.859001 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.858964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6dthr" event={"ID":"722fc986-cfd8-49ad-abe7-c1ce42b9f52f","Type":"ContainerStarted","Data":"7fbb22b84ffb3536400aa1dabbb066ed808dab0cd12e35564ce92d8adc46ff46"}
Sep 09 20:01:47.860979 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.860953    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4" event={"ID":"d21ee206-2394-41f8-9506-2ccd29f9fe26","Type":"ContainerStarted","Data":"1de10bef4108367a111c81dd12ff4a1cef018bf255ee39c077797e7cc01e0c7b"}
Sep 09 20:01:47.861102 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.861009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4" event={"ID":"d21ee206-2394-41f8-9506-2ccd29f9fe26","Type":"ContainerStarted","Data":"a40f3cc91a88e5a43c4a06d4ce7fc22f651ac814d6858cb9492c408c006e3dab"}
Sep 09 20:01:47.861102 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.861039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4" event={"ID":"d21ee206-2394-41f8-9506-2ccd29f9fe26","Type":"ContainerStarted","Data":"a4540fdf4ea4b54e5dafb9cf8b4fbf911e030b82993ff6a047deedd598ea6b9b"}
Sep 09 20:01:47.862097 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.862076    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt" event={"ID":"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8","Type":"ContainerStarted","Data":"d454cb55df136afb6f1c41d30ea3e19c95c1513b6159e748785f336ad275ce16"}
Sep 09 20:01:47.885229 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.885072    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c89c46b95-lxwp4" podStartSLOduration=2.590605717 podStartE2EDuration="4.88505238s" totalImagesPullingTime="2.294446663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:01:47.882856248 +0000 UTC m=+405.933001331" watchObservedRunningTime="2026-09-09 20:01:47.88505238 +0000 UTC m=+405.935197469"
Sep 09 20:01:47.967002 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.966965    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d68b8c69f-4nzhd"]
Sep 09 20:01:47.969618 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.969594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:47.981699 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:47.981675    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d68b8c69f-4nzhd"]
Sep 09 20:01:48.021704 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.021669    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:48.098102 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.098066    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-config\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.098102 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.098107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-serving-cert\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.098306 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.098126    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-oauth-config\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.098306 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.098166    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wddjs\" (UniqueName: \"kubernetes.io/projected/39d275fc-bde3-439b-8abb-48e3faf80ba4-kube-api-access-wddjs\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.098306 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.098215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-oauth-serving-cert\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.098306 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.098264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-trusted-ca-bundle\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.098434 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.098309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-service-ca\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.106478 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.106447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:48.199033 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.198953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wddjs\" (UniqueName: \"kubernetes.io/projected/39d275fc-bde3-439b-8abb-48e3faf80ba4-kube-api-access-wddjs\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.199033 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.199030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-oauth-serving-cert\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.199267 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.199069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-trusted-ca-bundle\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.199267 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.199101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-service-ca\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.199267 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.199140    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-config\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.199267 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.199167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-serving-cert\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.199267 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.199192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-oauth-config\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.199972 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.199912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-oauth-serving-cert\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.199972 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.199948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-config\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.200141 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.200010    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-trusted-ca-bundle\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.200191 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.200171    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-service-ca\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.202056 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.202024    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-oauth-config\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.202423 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.202400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-serving-cert\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.208813 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.208780    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wddjs\" (UniqueName: \"kubernetes.io/projected/39d275fc-bde3-439b-8abb-48e3faf80ba4-kube-api-access-wddjs\") pod \"console-6d68b8c69f-4nzhd\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") " pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.282506 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.282446    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:48.769249 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.769214    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d68b8c69f-4nzhd"]
Sep 09 20:01:48.772004 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:01:48.771981    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d275fc_bde3_439b_8abb_48e3faf80ba4.slice/crio-0fc430530f2a8d5e773cdcd807848b9727e06af955ba44428ab7c184998f7460 WatchSource:0}: Error finding container 0fc430530f2a8d5e773cdcd807848b9727e06af955ba44428ab7c184998f7460: Status 404 returned error can't find the container with id 0fc430530f2a8d5e773cdcd807848b9727e06af955ba44428ab7c184998f7460
Sep 09 20:01:48.823927 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.823903    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:48.869818 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.869777    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d68b8c69f-4nzhd" event={"ID":"39d275fc-bde3-439b-8abb-48e3faf80ba4","Type":"ContainerStarted","Data":"bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76"}
Sep 09 20:01:48.870246 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.869840    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d68b8c69f-4nzhd" event={"ID":"39d275fc-bde3-439b-8abb-48e3faf80ba4","Type":"ContainerStarted","Data":"0fc430530f2a8d5e773cdcd807848b9727e06af955ba44428ab7c184998f7460"}
Sep 09 20:01:48.871751 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.871717    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt" event={"ID":"9bb964a1-a5d5-4d9c-99f7-5ad5427250f8","Type":"ContainerStarted","Data":"a4a4c0ffa1a368b1f6f834c2cfca41c6bb85f5348702fb08e7ad2f7747463e5a"}
Sep 09 20:01:48.889040 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.888995    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d68b8c69f-4nzhd" podStartSLOduration=1.88897765 podStartE2EDuration="1.88897765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:01:48.887619144 +0000 UTC m=+406.937764236" watchObservedRunningTime="2026-09-09 20:01:48.88897765 +0000 UTC m=+406.939122734"
Sep 09 20:01:48.892331 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.892306    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:48.905738 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:48.905683    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-2cpgt" podStartSLOduration=377.439789776 podStartE2EDuration="6m18.905661585s" totalImagesPullingTime="1.465871809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:01:48.903299798 +0000 UTC m=+406.953444882" watchObservedRunningTime="2026-09-09 20:01:48.905661585 +0000 UTC m=+406.955806669"
Sep 09 20:01:49.033159 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:49.033120    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:49.822906 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:49.822870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:50.882398 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:50.882363    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6dthr" event={"ID":"722fc986-cfd8-49ad-abe7-c1ce42b9f52f","Type":"ContainerStarted","Data":"9f55e8740417e6bb0f3db97c6cc72811f5cb14189a126a325fd7b2120ac3d046"}
Sep 09 20:01:50.882761 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:50.882411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6dthr" event={"ID":"722fc986-cfd8-49ad-abe7-c1ce42b9f52f","Type":"ContainerStarted","Data":"1ab2441dae8200379ed53e962bcd0e317cebf285349df576aa1ceccc5166c56f"}
Sep 09 20:01:50.882761 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:50.882521    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6dthr"
Sep 09 20:01:50.901215 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:50.901170    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6dthr" podStartSLOduration=373.986165778 podStartE2EDuration="6m16.901155982s" totalImagesPullingTime="2.914990204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 19:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:01:50.900574367 +0000 UTC m=+408.950719451" watchObservedRunningTime="2026-09-09 20:01:50.901155982 +0000 UTC m=+408.951301065"
Sep 09 20:01:58.282681 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:58.282631    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:58.283076 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:58.282702    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:58.287389 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:58.287366    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:58.923287 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:58.923257    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:01:58.970883 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:58.970851    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7d8497b-gplxh"]
Sep 09 20:01:59.793536 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:59.793489    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:01:59.894624 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:01:59.894589    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:02:00.889173 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:00.889136    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6dthr"
Sep 09 20:02:10.041052 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:10.041013    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:02:10.098336 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:10.098303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:02:19.051424 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:19.051389    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:02:23.997135 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:23.997048    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b7d8497b-gplxh" podUID="f2222a13-d5a9-4716-be76-afafb43c4e38" containerName="console" containerID="cri-o://365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15" gracePeriod=15
Sep 09 20:02:24.241578 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.241555    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:02:24.310214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310179    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-console-config\") pod \"f2222a13-d5a9-4716-be76-afafb43c4e38\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") "
Sep 09 20:02:24.310390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310237    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdmvl\" (UniqueName: \"kubernetes.io/projected/f2222a13-d5a9-4716-be76-afafb43c4e38-kube-api-access-kdmvl\") pod \"f2222a13-d5a9-4716-be76-afafb43c4e38\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") "
Sep 09 20:02:24.310390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310282    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-serving-cert\") pod \"f2222a13-d5a9-4716-be76-afafb43c4e38\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") "
Sep 09 20:02:24.310390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310302    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-oauth-serving-cert\") pod \"f2222a13-d5a9-4716-be76-afafb43c4e38\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") "
Sep 09 20:02:24.310390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310320    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-oauth-config\") pod \"f2222a13-d5a9-4716-be76-afafb43c4e38\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") "
Sep 09 20:02:24.310608 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310423    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-service-ca\") pod \"f2222a13-d5a9-4716-be76-afafb43c4e38\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") "
Sep 09 20:02:24.310608 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310524    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-trusted-ca-bundle\") pod \"f2222a13-d5a9-4716-be76-afafb43c4e38\" (UID: \"f2222a13-d5a9-4716-be76-afafb43c4e38\") "
Sep 09 20:02:24.310745 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310716    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-console-config" (OuterVolumeSpecName: "console-config") pod "f2222a13-d5a9-4716-be76-afafb43c4e38" (UID: "f2222a13-d5a9-4716-be76-afafb43c4e38"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:02:24.310862 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310771    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f2222a13-d5a9-4716-be76-afafb43c4e38" (UID: "f2222a13-d5a9-4716-be76-afafb43c4e38"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:02:24.310862 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.310841    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-service-ca" (OuterVolumeSpecName: "service-ca") pod "f2222a13-d5a9-4716-be76-afafb43c4e38" (UID: "f2222a13-d5a9-4716-be76-afafb43c4e38"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:02:24.311069 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.311046    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f2222a13-d5a9-4716-be76-afafb43c4e38" (UID: "f2222a13-d5a9-4716-be76-afafb43c4e38"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:02:24.312674 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.312652    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f2222a13-d5a9-4716-be76-afafb43c4e38" (UID: "f2222a13-d5a9-4716-be76-afafb43c4e38"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:02:24.313210 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.313187    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f2222a13-d5a9-4716-be76-afafb43c4e38" (UID: "f2222a13-d5a9-4716-be76-afafb43c4e38"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:02:24.313210 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.313196    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2222a13-d5a9-4716-be76-afafb43c4e38-kube-api-access-kdmvl" (OuterVolumeSpecName: "kube-api-access-kdmvl") pod "f2222a13-d5a9-4716-be76-afafb43c4e38" (UID: "f2222a13-d5a9-4716-be76-afafb43c4e38"). InnerVolumeSpecName "kube-api-access-kdmvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:02:24.411221 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.411183    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-console-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:02:24.411221 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.411213    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdmvl\" (UniqueName: \"kubernetes.io/projected/f2222a13-d5a9-4716-be76-afafb43c4e38-kube-api-access-kdmvl\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:02:24.411221 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.411227    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-serving-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:02:24.411457 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.411239    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-oauth-serving-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:02:24.411457 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.411250    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2222a13-d5a9-4716-be76-afafb43c4e38-console-oauth-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:02:24.411457 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.411262    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-service-ca\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:02:24.411457 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:24.411272    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2222a13-d5a9-4716-be76-afafb43c4e38-trusted-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:02:25.032970 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:25.032937    2577 generic.go:356] "Generic (PLEG): container finished" podID="f2222a13-d5a9-4716-be76-afafb43c4e38" containerID="365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15" exitCode=0
Sep 09 20:02:25.033380 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:25.032990    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7d8497b-gplxh" event={"ID":"f2222a13-d5a9-4716-be76-afafb43c4e38","Type":"ContainerDied","Data":"365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15"}
Sep 09 20:02:25.033380 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:25.032995    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7d8497b-gplxh"
Sep 09 20:02:25.033380 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:25.033034    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7d8497b-gplxh" event={"ID":"f2222a13-d5a9-4716-be76-afafb43c4e38","Type":"ContainerDied","Data":"668c172686a69188410eae84aaa1a0c06ed042d36a64a5e7947a93435e95acb0"}
Sep 09 20:02:25.033380 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:25.033057    2577 scope.go:117] "RemoveContainer" containerID="365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15"
Sep 09 20:02:25.041422 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:25.041405    2577 scope.go:117] "RemoveContainer" containerID="365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15"
Sep 09 20:02:25.041723 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:02:25.041703    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15\": container with ID starting with 365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15 not found: ID does not exist" containerID="365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15"
Sep 09 20:02:25.041814 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:25.041730    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15"} err="failed to get container status \"365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15\": rpc error: code = NotFound desc = could not find container \"365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15\": container with ID starting with 365deba65e6b4eca92172919f628aaf37562f7b87f6a4158f21292939b8bfc15 not found: ID does not exist"
Sep 09 20:02:25.050919 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:25.050896    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7d8497b-gplxh"]
Sep 09 20:02:25.054765 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:25.054745    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b7d8497b-gplxh"]
Sep 09 20:02:26.445705 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:26.445666    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2222a13-d5a9-4716-be76-afafb43c4e38" path="/var/lib/kubelet/pods/f2222a13-d5a9-4716-be76-afafb43c4e38/volumes"
Sep 09 20:02:54.061916 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:54.061876    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:02:54.122658 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:02:54.122623    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:00.722986 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.722948    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bd8d5bddd-ldhkn"]
Sep 09 20:03:00.723580 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.723298    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2222a13-d5a9-4716-be76-afafb43c4e38" containerName="console"
Sep 09 20:03:00.723580 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.723309    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2222a13-d5a9-4716-be76-afafb43c4e38" containerName="console"
Sep 09 20:03:00.723580 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.723370    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2222a13-d5a9-4716-be76-afafb43c4e38" containerName="console"
Sep 09 20:03:00.725676 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.725660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.738939 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.738914    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bd8d5bddd-ldhkn"]
Sep 09 20:03:00.780713 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.780683    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:00.821754 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.821724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-console-config\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.821888 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.821770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrfk8\" (UniqueName: \"kubernetes.io/projected/c63ce30d-f675-4419-b2e9-c853d6e819af-kube-api-access-lrfk8\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.821888 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.821827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-serving-cert\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.821888 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.821843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-service-ca\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.821888 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.821868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-oauth-config\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.822023 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.821887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-trusted-ca-bundle\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.822023 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.821903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-oauth-serving-cert\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.911920 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.911870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:00.923103 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.923073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-console-config\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.923218 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.923130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfk8\" (UniqueName: \"kubernetes.io/projected/c63ce30d-f675-4419-b2e9-c853d6e819af-kube-api-access-lrfk8\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.923218 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.923183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-serving-cert\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.923218 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.923206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-service-ca\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.923381 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.923230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-oauth-config\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.923381 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.923255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-trusted-ca-bundle\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.923514 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.923280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-oauth-serving-cert\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.923871 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.923847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-console-config\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.923982 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.923895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-service-ca\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.924198 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.924176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-oauth-serving-cert\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.924272 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.924255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-trusted-ca-bundle\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.926386 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.926361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-oauth-config\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.926386 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.926377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-serving-cert\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.931228 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.931208    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfk8\" (UniqueName: \"kubernetes.io/projected/c63ce30d-f675-4419-b2e9-c853d6e819af-kube-api-access-lrfk8\") pod \"console-6bd8d5bddd-ldhkn\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") " pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:00.968544 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:00.968517    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:01.035657 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:01.035622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:01.304663 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:01.304590    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bd8d5bddd-ldhkn"]
Sep 09 20:03:01.308450 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:03:01.308422    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63ce30d_f675_4419_b2e9_c853d6e819af.slice/crio-424d1ad57c0306e5ca221c3411af3c98d4393f3870f4b139fbc6312951591541 WatchSource:0}: Error finding container 424d1ad57c0306e5ca221c3411af3c98d4393f3870f4b139fbc6312951591541: Status 404 returned error can't find the container with id 424d1ad57c0306e5ca221c3411af3c98d4393f3870f4b139fbc6312951591541
Sep 09 20:03:01.519922 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:01.519888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:01.576237 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:01.576154    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:02.199186 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:02.199151    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd8d5bddd-ldhkn" event={"ID":"c63ce30d-f675-4419-b2e9-c853d6e819af","Type":"ContainerStarted","Data":"8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c"}
Sep 09 20:03:02.199569 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:02.199209    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd8d5bddd-ldhkn" event={"ID":"c63ce30d-f675-4419-b2e9-c853d6e819af","Type":"ContainerStarted","Data":"424d1ad57c0306e5ca221c3411af3c98d4393f3870f4b139fbc6312951591541"}
Sep 09 20:03:02.228818 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:02.228772    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bd8d5bddd-ldhkn" podStartSLOduration=2.228757044 podStartE2EDuration="2.228757044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:03:02.226691788 +0000 UTC m=+480.276836871" watchObservedRunningTime="2026-09-09 20:03:02.228757044 +0000 UTC m=+480.278902127"
Sep 09 20:03:06.071684 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:06.071647    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:06.140171 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:06.140130    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:11.036731 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:11.036695    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:11.037188 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:11.036753    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:11.041569 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:11.041549    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:11.242363 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:11.242327    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:03:11.288730 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:11.288641    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d68b8c69f-4nzhd"]
Sep 09 20:03:11.401321 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:11.401288    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:11.502125 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:11.502094    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:11.597922 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:11.597843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:11.774109 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:11.774078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:03:36.313412 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.313369    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d68b8c69f-4nzhd" podUID="39d275fc-bde3-439b-8abb-48e3faf80ba4" containerName="console" containerID="cri-o://bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76" gracePeriod=15
Sep 09 20:03:36.565800 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.565742    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:03:36.620387 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.620362    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-config\") pod \"39d275fc-bde3-439b-8abb-48e3faf80ba4\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") "
Sep 09 20:03:36.620567 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.620400    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-serving-cert\") pod \"39d275fc-bde3-439b-8abb-48e3faf80ba4\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") "
Sep 09 20:03:36.620567 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.620445    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-oauth-config\") pod \"39d275fc-bde3-439b-8abb-48e3faf80ba4\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") "
Sep 09 20:03:36.620567 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.620516    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-trusted-ca-bundle\") pod \"39d275fc-bde3-439b-8abb-48e3faf80ba4\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") "
Sep 09 20:03:36.620567 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.620538    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wddjs\" (UniqueName: \"kubernetes.io/projected/39d275fc-bde3-439b-8abb-48e3faf80ba4-kube-api-access-wddjs\") pod \"39d275fc-bde3-439b-8abb-48e3faf80ba4\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") "
Sep 09 20:03:36.620567 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.620558    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-oauth-serving-cert\") pod \"39d275fc-bde3-439b-8abb-48e3faf80ba4\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") "
Sep 09 20:03:36.620819 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.620610    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-service-ca\") pod \"39d275fc-bde3-439b-8abb-48e3faf80ba4\" (UID: \"39d275fc-bde3-439b-8abb-48e3faf80ba4\") "
Sep 09 20:03:36.620898 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.620794    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-config" (OuterVolumeSpecName: "console-config") pod "39d275fc-bde3-439b-8abb-48e3faf80ba4" (UID: "39d275fc-bde3-439b-8abb-48e3faf80ba4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:03:36.621017 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.620977    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39d275fc-bde3-439b-8abb-48e3faf80ba4" (UID: "39d275fc-bde3-439b-8abb-48e3faf80ba4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:03:36.621082 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.621025    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "39d275fc-bde3-439b-8abb-48e3faf80ba4" (UID: "39d275fc-bde3-439b-8abb-48e3faf80ba4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:03:36.621082 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.621071    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-service-ca" (OuterVolumeSpecName: "service-ca") pod "39d275fc-bde3-439b-8abb-48e3faf80ba4" (UID: "39d275fc-bde3-439b-8abb-48e3faf80ba4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:03:36.622884 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.622853    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d275fc-bde3-439b-8abb-48e3faf80ba4-kube-api-access-wddjs" (OuterVolumeSpecName: "kube-api-access-wddjs") pod "39d275fc-bde3-439b-8abb-48e3faf80ba4" (UID: "39d275fc-bde3-439b-8abb-48e3faf80ba4"). InnerVolumeSpecName "kube-api-access-wddjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:03:36.623142 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.623114    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39d275fc-bde3-439b-8abb-48e3faf80ba4" (UID: "39d275fc-bde3-439b-8abb-48e3faf80ba4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:03:36.623142 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.623133    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39d275fc-bde3-439b-8abb-48e3faf80ba4" (UID: "39d275fc-bde3-439b-8abb-48e3faf80ba4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:03:36.721900 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.721871    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-oauth-serving-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:03:36.721900 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.721896    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-service-ca\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:03:36.721900 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.721905    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:03:36.722106 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.721913    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-serving-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:03:36.722106 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.721921    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39d275fc-bde3-439b-8abb-48e3faf80ba4-console-oauth-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:03:36.722106 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.721928    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d275fc-bde3-439b-8abb-48e3faf80ba4-trusted-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:03:36.722106 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:36.721936    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wddjs\" (UniqueName: \"kubernetes.io/projected/39d275fc-bde3-439b-8abb-48e3faf80ba4-kube-api-access-wddjs\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:03:37.354304 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:37.354271    2577 generic.go:356] "Generic (PLEG): container finished" podID="39d275fc-bde3-439b-8abb-48e3faf80ba4" containerID="bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76" exitCode=0
Sep 09 20:03:37.354760 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:37.354312    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d68b8c69f-4nzhd"
Sep 09 20:03:37.354760 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:37.354351    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d68b8c69f-4nzhd" event={"ID":"39d275fc-bde3-439b-8abb-48e3faf80ba4","Type":"ContainerDied","Data":"bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76"}
Sep 09 20:03:37.354760 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:37.354400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d68b8c69f-4nzhd" event={"ID":"39d275fc-bde3-439b-8abb-48e3faf80ba4","Type":"ContainerDied","Data":"0fc430530f2a8d5e773cdcd807848b9727e06af955ba44428ab7c184998f7460"}
Sep 09 20:03:37.354760 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:37.354421    2577 scope.go:117] "RemoveContainer" containerID="bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76"
Sep 09 20:03:37.365362 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:37.365344    2577 scope.go:117] "RemoveContainer" containerID="bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76"
Sep 09 20:03:37.365865 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:03:37.365846    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76\": container with ID starting with bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76 not found: ID does not exist" containerID="bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76"
Sep 09 20:03:37.365945 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:37.365873    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76"} err="failed to get container status \"bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76\": rpc error: code = NotFound desc = could not find container \"bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76\": container with ID starting with bc5eb2b583adab0f34f29d0dcc9bbeff2bfc69934c12b115e86eca4725142d76 not found: ID does not exist"
Sep 09 20:03:37.387561 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:37.387536    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d68b8c69f-4nzhd"]
Sep 09 20:03:37.391560 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:37.391541    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d68b8c69f-4nzhd"]
Sep 09 20:03:38.446331 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:38.446298    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d275fc-bde3-439b-8abb-48e3faf80ba4" path="/var/lib/kubelet/pods/39d275fc-bde3-439b-8abb-48e3faf80ba4/volumes"
Sep 09 20:03:53.502389 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:03:53.502295    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:02.379958 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:02.379920    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:05:02.380629 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:02.380611    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:05:06.423144 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:06.423098    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:07.710745 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:07.710709    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:07.794600 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:07.794560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:25.943897 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:25.943824    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:28.936708 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:28.936675    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:45.749294 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.749262    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b89c6958f-w9dg9"]
Sep 09 20:05:45.749791 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.749631    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d275fc-bde3-439b-8abb-48e3faf80ba4" containerName="console"
Sep 09 20:05:45.749791 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.749643    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d275fc-bde3-439b-8abb-48e3faf80ba4" containerName="console"
Sep 09 20:05:45.749791 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.749696    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d275fc-bde3-439b-8abb-48e3faf80ba4" containerName="console"
Sep 09 20:05:45.751679 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.751661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:45.797019 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.796991    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b89c6958f-w9dg9"]
Sep 09 20:05:45.830025 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.829996    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:45.901071 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.901037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qxfn\" (UniqueName: \"kubernetes.io/projected/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-kube-api-access-7qxfn\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:45.901071 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.901073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-console-oauth-config\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:45.901288 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.901108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-console-serving-cert\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:45.901288 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.901127    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-trusted-ca-bundle\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:45.901288 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.901233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-oauth-serving-cert\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:45.901409 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.901293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-console-config\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:45.901409 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.901320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-service-ca\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:45.927503 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:45.927456    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:46.002339 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.002263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-console-serving-cert\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.002339 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.002295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-trusted-ca-bundle\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.002561 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.002371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-oauth-serving-cert\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.002561 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.002408    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-console-config\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.002561 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.002432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-service-ca\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.002561 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.002464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qxfn\" (UniqueName: \"kubernetes.io/projected/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-kube-api-access-7qxfn\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.002561 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.002513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-console-oauth-config\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.003243 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.003215    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-console-config\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.003339 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.003281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-service-ca\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.003339 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.003297    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-trusted-ca-bundle\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.003504 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.003460    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-oauth-serving-cert\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.005045 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.005020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-console-oauth-config\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.005123 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.005063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-console-serving-cert\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.011168 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.011143    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qxfn\" (UniqueName: \"kubernetes.io/projected/4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed-kube-api-access-7qxfn\") pod \"console-6b89c6958f-w9dg9\" (UID: \"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed\") " pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.060216 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.060189    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:46.331650 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.331588    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b89c6958f-w9dg9"]
Sep 09 20:05:46.334624 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:05:46.334596    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcf5c25_e15a_4593_b701_ad1bf2e4f3ed.slice/crio-75afca4bf18a5d7272e9cde5ae24d7dda51b15f5d43e9eedd7a0e414dfd846be WatchSource:0}: Error finding container 75afca4bf18a5d7272e9cde5ae24d7dda51b15f5d43e9eedd7a0e414dfd846be: Status 404 returned error can't find the container with id 75afca4bf18a5d7272e9cde5ae24d7dda51b15f5d43e9eedd7a0e414dfd846be
Sep 09 20:05:46.870806 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.870779    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b89c6958f-w9dg9" event={"ID":"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed","Type":"ContainerStarted","Data":"f8b5b5cdf95eb6c1bc0bbc49b0ad5e0e455ea9fc57c8411364ba7d17506b2aa2"}
Sep 09 20:05:46.871194 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.870823    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b89c6958f-w9dg9" event={"ID":"4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed","Type":"ContainerStarted","Data":"75afca4bf18a5d7272e9cde5ae24d7dda51b15f5d43e9eedd7a0e414dfd846be"}
Sep 09 20:05:46.892238 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:46.892192    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b89c6958f-w9dg9" podStartSLOduration=1.892178247 podStartE2EDuration="1.892178247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:05:46.890376978 +0000 UTC m=+644.940522075" watchObservedRunningTime="2026-09-09 20:05:46.892178247 +0000 UTC m=+644.942323329"
Sep 09 20:05:54.061362 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:54.061325    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:56.061223 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:56.061176    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:56.061724 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:56.061244    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:56.066150 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:56.066127    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:56.919140 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:56.919112    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b89c6958f-w9dg9"
Sep 09 20:05:56.973752 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:56.973718    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bd8d5bddd-ldhkn"]
Sep 09 20:05:57.099507 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:57.099451    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:57.189243 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:57.189171    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:05:57.251159 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:05:57.251128    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:06:03.969874 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:03.969843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:06:21.994070 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:21.994025    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bd8d5bddd-ldhkn" podUID="c63ce30d-f675-4419-b2e9-c853d6e819af" containerName="console" containerID="cri-o://8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c" gracePeriod=15
Sep 09 20:06:22.234932 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.234897    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:06:22.317632 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.317595    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-console-config\") pod \"c63ce30d-f675-4419-b2e9-c853d6e819af\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") "
Sep 09 20:06:22.317821 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.317658    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-service-ca\") pod \"c63ce30d-f675-4419-b2e9-c853d6e819af\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") "
Sep 09 20:06:22.317821 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.317688    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-oauth-serving-cert\") pod \"c63ce30d-f675-4419-b2e9-c853d6e819af\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") "
Sep 09 20:06:22.317821 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.317714    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-serving-cert\") pod \"c63ce30d-f675-4419-b2e9-c853d6e819af\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") "
Sep 09 20:06:22.317821 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.317762    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-oauth-config\") pod \"c63ce30d-f675-4419-b2e9-c853d6e819af\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") "
Sep 09 20:06:22.317821 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.317807    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrfk8\" (UniqueName: \"kubernetes.io/projected/c63ce30d-f675-4419-b2e9-c853d6e819af-kube-api-access-lrfk8\") pod \"c63ce30d-f675-4419-b2e9-c853d6e819af\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") "
Sep 09 20:06:22.318070 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.317828    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-trusted-ca-bundle\") pod \"c63ce30d-f675-4419-b2e9-c853d6e819af\" (UID: \"c63ce30d-f675-4419-b2e9-c853d6e819af\") "
Sep 09 20:06:22.318117 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.318092    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-console-config" (OuterVolumeSpecName: "console-config") pod "c63ce30d-f675-4419-b2e9-c853d6e819af" (UID: "c63ce30d-f675-4419-b2e9-c853d6e819af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:06:22.318225 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.318102    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-service-ca" (OuterVolumeSpecName: "service-ca") pod "c63ce30d-f675-4419-b2e9-c853d6e819af" (UID: "c63ce30d-f675-4419-b2e9-c853d6e819af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:06:22.318286 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.318119    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c63ce30d-f675-4419-b2e9-c853d6e819af" (UID: "c63ce30d-f675-4419-b2e9-c853d6e819af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:06:22.318380 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.318353    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c63ce30d-f675-4419-b2e9-c853d6e819af" (UID: "c63ce30d-f675-4419-b2e9-c853d6e819af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:06:22.320085 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.320060    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63ce30d-f675-4419-b2e9-c853d6e819af-kube-api-access-lrfk8" (OuterVolumeSpecName: "kube-api-access-lrfk8") pod "c63ce30d-f675-4419-b2e9-c853d6e819af" (UID: "c63ce30d-f675-4419-b2e9-c853d6e819af"). InnerVolumeSpecName "kube-api-access-lrfk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:06:22.320085 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.320075    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c63ce30d-f675-4419-b2e9-c853d6e819af" (UID: "c63ce30d-f675-4419-b2e9-c853d6e819af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:06:22.320253 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.320171    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c63ce30d-f675-4419-b2e9-c853d6e819af" (UID: "c63ce30d-f675-4419-b2e9-c853d6e819af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:06:22.418711 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.418661    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrfk8\" (UniqueName: \"kubernetes.io/projected/c63ce30d-f675-4419-b2e9-c853d6e819af-kube-api-access-lrfk8\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:06:22.418711 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.418702    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-trusted-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:06:22.418711 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.418712    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-console-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:06:22.418711 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.418723    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-service-ca\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:06:22.418711 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.418732    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c63ce30d-f675-4419-b2e9-c853d6e819af-oauth-serving-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:06:22.419010 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.418740    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-serving-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:06:22.419010 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:22.418748    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c63ce30d-f675-4419-b2e9-c853d6e819af-console-oauth-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:06:23.030116 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.030078    2577 generic.go:356] "Generic (PLEG): container finished" podID="c63ce30d-f675-4419-b2e9-c853d6e819af" containerID="8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c" exitCode=0
Sep 09 20:06:23.030526 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.030141    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bd8d5bddd-ldhkn"
Sep 09 20:06:23.030526 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.030165    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd8d5bddd-ldhkn" event={"ID":"c63ce30d-f675-4419-b2e9-c853d6e819af","Type":"ContainerDied","Data":"8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c"}
Sep 09 20:06:23.030526 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.030214    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bd8d5bddd-ldhkn" event={"ID":"c63ce30d-f675-4419-b2e9-c853d6e819af","Type":"ContainerDied","Data":"424d1ad57c0306e5ca221c3411af3c98d4393f3870f4b139fbc6312951591541"}
Sep 09 20:06:23.030526 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.030235    2577 scope.go:117] "RemoveContainer" containerID="8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c"
Sep 09 20:06:23.038546 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.038526    2577 scope.go:117] "RemoveContainer" containerID="8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c"
Sep 09 20:06:23.038826 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:06:23.038807    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c\": container with ID starting with 8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c not found: ID does not exist" containerID="8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c"
Sep 09 20:06:23.038900 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.038834    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c"} err="failed to get container status \"8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c\": rpc error: code = NotFound desc = could not find container \"8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c\": container with ID starting with 8388b9baa0f1e6f51f28552be9165de7db5492b43cceac44c89509b7ffcf615c not found: ID does not exist"
Sep 09 20:06:23.053114 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.053085    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bd8d5bddd-ldhkn"]
Sep 09 20:06:23.058238 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.058216    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bd8d5bddd-ldhkn"]
Sep 09 20:06:23.258216 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.258172    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:06:23.316111 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:23.316082    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:06:24.447524 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:24.447495    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c63ce30d-f675-4419-b2e9-c853d6e819af" path="/var/lib/kubelet/pods/c63ce30d-f675-4419-b2e9-c853d6e819af/volumes"
Sep 09 20:06:47.663047 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:47.663006    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:06:47.766194 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:47.766160    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:06:47.863218 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:47.863182    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:06:48.851242 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.851207    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"]
Sep 09 20:06:48.851641 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.851577    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c63ce30d-f675-4419-b2e9-c853d6e819af" containerName="console"
Sep 09 20:06:48.851641 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.851588    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c63ce30d-f675-4419-b2e9-c853d6e819af" containerName="console"
Sep 09 20:06:48.851715 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.851658    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c63ce30d-f675-4419-b2e9-c853d6e819af" containerName="console"
Sep 09 20:06:48.858064 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.854547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:48.858624 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.858602    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 20:06:48.858868 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.858855    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xj558\""
Sep 09 20:06:48.858948 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.858860    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 20:06:48.862857 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.862836    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"]
Sep 09 20:06:48.945857 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.945824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:48.945857 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.945857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:48.946048 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:48.945982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgpw\" (UniqueName: \"kubernetes.io/projected/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-kube-api-access-zrgpw\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:49.046614 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:49.046579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgpw\" (UniqueName: \"kubernetes.io/projected/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-kube-api-access-zrgpw\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:49.046756 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:49.046633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:49.046756 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:49.046652    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:49.047039 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:49.047019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:49.047076 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:49.047052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:49.055692 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:49.055665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgpw\" (UniqueName: \"kubernetes.io/projected/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-kube-api-access-zrgpw\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:49.168203 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:49.168122    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:06:49.438732 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:49.438580    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"]
Sep 09 20:06:49.441644 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:06:49.441613    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45367e65_cda1_4098_a1f5_c2e0fcd1fcdd.slice/crio-4d83c914cafbb265ed139e52252d6a8abe1dcd9e92de66d0be2373c9e6005c3e WatchSource:0}: Error finding container 4d83c914cafbb265ed139e52252d6a8abe1dcd9e92de66d0be2373c9e6005c3e: Status 404 returned error can't find the container with id 4d83c914cafbb265ed139e52252d6a8abe1dcd9e92de66d0be2373c9e6005c3e
Sep 09 20:06:49.443532 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:49.443512    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:06:50.150906 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:50.150873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg" event={"ID":"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd","Type":"ContainerStarted","Data":"4d83c914cafbb265ed139e52252d6a8abe1dcd9e92de66d0be2373c9e6005c3e"}
Sep 09 20:06:58.192310 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:58.192274    2577 generic.go:356] "Generic (PLEG): container finished" podID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerID="587e8f53ee2b93f887caeed72edabeef01ba344e2a5d1f33a6d7a703ca25e69f" exitCode=0
Sep 09 20:06:58.192825 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:06:58.192357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg" event={"ID":"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd","Type":"ContainerDied","Data":"587e8f53ee2b93f887caeed72edabeef01ba344e2a5d1f33a6d7a703ca25e69f"}
Sep 09 20:07:01.215205 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:01.215167    2577 generic.go:356] "Generic (PLEG): container finished" podID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerID="b4e82f3b3d72458240b9fa055d6179cb814ba14d3b3c0d2fbf29174b8777505c" exitCode=0
Sep 09 20:07:01.215622 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:01.215258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg" event={"ID":"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd","Type":"ContainerDied","Data":"b4e82f3b3d72458240b9fa055d6179cb814ba14d3b3c0d2fbf29174b8777505c"}
Sep 09 20:07:09.259305 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:09.259267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg" event={"ID":"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd","Type":"ContainerStarted","Data":"9d94807e88118cd4ccc223edbaad9e2f125e2528158dd9c04dad27ea9416bc83"}
Sep 09 20:07:09.277731 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:09.277683    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg" podStartSLOduration=3.262089398 podStartE2EDuration="21.27766761s" totalImagesPullingTime="18.015578212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:06:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:07:09.276258726 +0000 UTC m=+727.326403810" watchObservedRunningTime="2026-09-09 20:07:09.27766761 +0000 UTC m=+727.327812692"
Sep 09 20:07:10.265555 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:10.265510    2577 generic.go:356] "Generic (PLEG): container finished" podID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerID="9d94807e88118cd4ccc223edbaad9e2f125e2528158dd9c04dad27ea9416bc83" exitCode=0
Sep 09 20:07:10.265943 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:10.265570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg" event={"ID":"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd","Type":"ContainerDied","Data":"9d94807e88118cd4ccc223edbaad9e2f125e2528158dd9c04dad27ea9416bc83"}
Sep 09 20:07:11.436559 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.436532    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:07:11.541362 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.541336    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrgpw\" (UniqueName: \"kubernetes.io/projected/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-kube-api-access-zrgpw\") pod \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") "
Sep 09 20:07:11.541552 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.541384    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-bundle\") pod \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") "
Sep 09 20:07:11.541552 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.541495    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-util\") pod \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\" (UID: \"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd\") "
Sep 09 20:07:11.542074 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.542053    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-bundle" (OuterVolumeSpecName: "bundle") pod "45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" (UID: "45367e65-cda1-4098-a1f5-c2e0fcd1fcdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:07:11.543941 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.543920    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-kube-api-access-zrgpw" (OuterVolumeSpecName: "kube-api-access-zrgpw") pod "45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" (UID: "45367e65-cda1-4098-a1f5-c2e0fcd1fcdd"). InnerVolumeSpecName "kube-api-access-zrgpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:07:11.546564 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.546541    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-util" (OuterVolumeSpecName: "util") pod "45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" (UID: "45367e65-cda1-4098-a1f5-c2e0fcd1fcdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:07:11.642559 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.642525    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrgpw\" (UniqueName: \"kubernetes.io/projected/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-kube-api-access-zrgpw\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:07:11.642559 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.642555    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:07:11.642559 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:11.642563    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45367e65-cda1-4098-a1f5-c2e0fcd1fcdd-util\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:07:12.276053 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:12.276013    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg" event={"ID":"45367e65-cda1-4098-a1f5-c2e0fcd1fcdd","Type":"ContainerDied","Data":"4d83c914cafbb265ed139e52252d6a8abe1dcd9e92de66d0be2373c9e6005c3e"}
Sep 09 20:07:12.276053 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:12.276037    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1ag2jcg"
Sep 09 20:07:12.276301 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:12.276086    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d83c914cafbb265ed139e52252d6a8abe1dcd9e92de66d0be2373c9e6005c3e"
Sep 09 20:07:15.340170 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:15.340135    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:15.436402 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:15.436371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:21.174659 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.174626    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:21.477088 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.477007    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:21.485003 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.484977    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-zplgn"]
Sep 09 20:07:21.485317 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.485304    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerName="extract"
Sep 09 20:07:21.485365 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.485319    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerName="extract"
Sep 09 20:07:21.485365 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.485330    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerName="util"
Sep 09 20:07:21.485365 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.485336    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerName="util"
Sep 09 20:07:21.485365 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.485344    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerName="pull"
Sep 09 20:07:21.485365 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.485349    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerName="pull"
Sep 09 20:07:21.485552 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.485401    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="45367e65-cda1-4098-a1f5-c2e0fcd1fcdd" containerName="extract"
Sep 09 20:07:21.487577 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.487561    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:21.489608 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.489587    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Sep 09 20:07:21.489984 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.489970    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 09 20:07:21.490192 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.490172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 09 20:07:21.490245 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.490174    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 09 20:07:21.490448 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.490428    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 09 20:07:21.490559 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.490449    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-65zq4\""
Sep 09 20:07:21.499107 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.499089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-zplgn"]
Sep 09 20:07:21.630209 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.630176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjmln\" (UniqueName: \"kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-kube-api-access-vjmln\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:21.630399 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.630226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-cabundle0\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:21.630399 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.630247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-certificates\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:21.660094 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.660064    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:21.731802 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.731712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-cabundle0\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:21.731802 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.731751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-certificates\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:21.732018 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.731835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjmln\" (UniqueName: \"kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-kube-api-access-vjmln\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:21.732018 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:21.731917    2577 secret.go:281] references non-existent secret key: ca.crt
Sep 09 20:07:21.732018 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:21.731936    2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Sep 09 20:07:21.732018 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:21.731944    2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-zplgn: references non-existent secret key: ca.crt
Sep 09 20:07:21.732018 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:21.732001    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-certificates podName:8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3 nodeName:}" failed. No retries permitted until 2026-09-09 20:07:22.231986698 +0000 UTC m=+740.282131759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-certificates") pod "keda-operator-579c8958f7-zplgn" (UID: "8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3") : references non-existent secret key: ca.crt
Sep 09 20:07:21.732286 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.732265    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-cabundle0\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:21.749600 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.749577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjmln\" (UniqueName: \"kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-kube-api-access-vjmln\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:21.761108 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.761086    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:21.805545 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.805512    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"]
Sep 09 20:07:21.807841 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.807824    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:21.809918 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.809901    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Sep 09 20:07:21.820784 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.820764    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"]
Sep 09 20:07:21.934361 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.934332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:21.934542 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.934383    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knmtp\" (UniqueName: \"kubernetes.io/projected/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-kube-api-access-knmtp\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:21.934542 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:21.934452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-certificates\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:22.035181 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.035142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knmtp\" (UniqueName: \"kubernetes.io/projected/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-kube-api-access-knmtp\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:22.035424 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.035191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-certificates\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:22.035424 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.035244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:22.035424 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:22.035358    2577 secret.go:281] references non-existent secret key: tls.crt
Sep 09 20:07:22.035424 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:22.035378    2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt
Sep 09 20:07:22.035424 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:22.035393    2577 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
Sep 09 20:07:22.035424 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:22.035409    2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Sep 09 20:07:22.035753 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:22.035490    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-certificates podName:e9ffe31d-8df2-45da-814c-3d3f2f97fbb2 nodeName:}" failed. No retries permitted until 2026-09-09 20:07:22.535452155 +0000 UTC m=+740.585597216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-certificates") pod "keda-metrics-apiserver-77857b7b98-m6l5m" (UID: "e9ffe31d-8df2-45da-814c-3d3f2f97fbb2") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found]
Sep 09 20:07:22.035753 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.035601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:22.043746 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.043727    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knmtp\" (UniqueName: \"kubernetes.io/projected/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-kube-api-access-knmtp\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:22.196068 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.196037    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:22.237411 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.237367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-certificates\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:22.237586 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:22.237528    2577 secret.go:281] references non-existent secret key: ca.crt
Sep 09 20:07:22.237586 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:22.237550    2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Sep 09 20:07:22.237586 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:22.237559    2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-zplgn: references non-existent secret key: ca.crt
Sep 09 20:07:22.237725 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:07:22.237607    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-certificates podName:8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3 nodeName:}" failed. No retries permitted until 2026-09-09 20:07:23.237593724 +0000 UTC m=+741.287738785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-certificates") pod "keda-operator-579c8958f7-zplgn" (UID: "8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3") : references non-existent secret key: ca.crt
Sep 09 20:07:22.508640 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.508556    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:22.540021 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.539990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-certificates\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:22.542747 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.542725    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e9ffe31d-8df2-45da-814c-3d3f2f97fbb2-certificates\") pod \"keda-metrics-apiserver-77857b7b98-m6l5m\" (UID: \"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:22.612638 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.612604    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:22.718523 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.718453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:22.728348 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:22.728311    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:23.010053 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.009911    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"]
Sep 09 20:07:23.012747 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:07:23.012717    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ffe31d_8df2_45da_814c_3d3f2f97fbb2.slice/crio-4aed4de5c80cfde69d6630661f4576ecf59459d764395a6dda80d9b45068b4b1 WatchSource:0}: Error finding container 4aed4de5c80cfde69d6630661f4576ecf59459d764395a6dda80d9b45068b4b1: Status 404 returned error can't find the container with id 4aed4de5c80cfde69d6630661f4576ecf59459d764395a6dda80d9b45068b4b1
Sep 09 20:07:23.019057 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.019030    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:23.205707 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.205665    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:23.246951 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.246920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-certificates\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:23.249421 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.249390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3-certificates\") pod \"keda-operator-579c8958f7-zplgn\" (UID: \"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3\") " pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:23.298959 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.298933    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:23.326257 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.326230    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m" event={"ID":"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2","Type":"ContainerStarted","Data":"4aed4de5c80cfde69d6630661f4576ecf59459d764395a6dda80d9b45068b4b1"}
Sep 09 20:07:23.409702 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.409664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:23.505794 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.505696    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:23.572919 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:23.572894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-zplgn"]
Sep 09 20:07:23.575408 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:07:23.575379    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb1dfe6_e8ce_4ae1_bb1f_a7bc963d2ce3.slice/crio-f70bbe5416226b61d9d307b1cbf96819aeea43c78390337c650ac5d9b06e2b4a WatchSource:0}: Error finding container f70bbe5416226b61d9d307b1cbf96819aeea43c78390337c650ac5d9b06e2b4a: Status 404 returned error can't find the container with id f70bbe5416226b61d9d307b1cbf96819aeea43c78390337c650ac5d9b06e2b4a
Sep 09 20:07:24.333077 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:24.333037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-zplgn" event={"ID":"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3","Type":"ContainerStarted","Data":"f70bbe5416226b61d9d307b1cbf96819aeea43c78390337c650ac5d9b06e2b4a"}
Sep 09 20:07:26.345822 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:26.345785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m" event={"ID":"e9ffe31d-8df2-45da-814c-3d3f2f97fbb2","Type":"ContainerStarted","Data":"d6c3b0149da6cd858bd852e2134a732162ffde02290e150f26b55f1d7bbc63f8"}
Sep 09 20:07:26.346303 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:26.345903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:26.361533 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:26.361460    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m" podStartSLOduration=2.6046450549999998 podStartE2EDuration="5.361421284s" totalImagesPullingTime="2.756776229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:07:26.360720268 +0000 UTC m=+744.410865362" watchObservedRunningTime="2026-09-09 20:07:26.361421284 +0000 UTC m=+744.411566373"
Sep 09 20:07:29.364918 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:29.364817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-zplgn" event={"ID":"8cb1dfe6-e8ce-4ae1-bb1f-a7bc963d2ce3","Type":"ContainerStarted","Data":"f5996eb0919e3499ad1ec9a8636911e070a65171d5d2637dbb9ac8405680850a"}
Sep 09 20:07:29.365336 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:29.365084    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:07:29.382791 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:29.382736    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-zplgn" podStartSLOduration=2.865224756 podStartE2EDuration="8.382714121s" totalImagesPullingTime="5.517489365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:07:29.381108834 +0000 UTC m=+747.431253920" watchObservedRunningTime="2026-09-09 20:07:29.382714121 +0000 UTC m=+747.432859204"
Sep 09 20:07:37.357288 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:37.357259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-m6l5m"
Sep 09 20:07:46.288982 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:46.288946    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:07:50.371827 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:07:50.371799    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-zplgn"
Sep 09 20:08:14.258821 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:14.258785    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:08:14.323540 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:14.323512    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:08:43.138864 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.138773    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:08:43.208672 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.208644    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:08:43.208835 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.208706    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7676c798d9-tf2pq"]
Sep 09 20:08:43.211221 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.211204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:43.215658 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.215640    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 09 20:08:43.215823 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.215691    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 09 20:08:43.215823 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.215737    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Sep 09 20:08:43.216241 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.216215    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-m5nw5\""
Sep 09 20:08:43.223924 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.223904    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"]
Sep 09 20:08:43.230272 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.229908    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7676c798d9-tf2pq"]
Sep 09 20:08:43.230272 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.230029    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:43.232702 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.232679    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-l727n\""
Sep 09 20:08:43.232808 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.232728    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Sep 09 20:08:43.244228 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.244207    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"]
Sep 09 20:08:43.273238 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.273202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwc4l\" (UniqueName: \"kubernetes.io/projected/ec3df166-6dca-4f05-bbaf-0c5d8a8d8244-kube-api-access-qwc4l\") pod \"llmisvc-controller-manager-645f9c8fd6-c6wqk\" (UID: \"ec3df166-6dca-4f05-bbaf-0c5d8a8d8244\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:43.273238 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.273238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec3df166-6dca-4f05-bbaf-0c5d8a8d8244-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-c6wqk\" (UID: \"ec3df166-6dca-4f05-bbaf-0c5d8a8d8244\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:43.273448 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.273353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fz8t\" (UniqueName: \"kubernetes.io/projected/995a976e-8241-44c5-a320-ec3cc9e550f2-kube-api-access-9fz8t\") pod \"kserve-controller-manager-7676c798d9-tf2pq\" (UID: \"995a976e-8241-44c5-a320-ec3cc9e550f2\") " pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:43.273521 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.273444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/995a976e-8241-44c5-a320-ec3cc9e550f2-cert\") pod \"kserve-controller-manager-7676c798d9-tf2pq\" (UID: \"995a976e-8241-44c5-a320-ec3cc9e550f2\") " pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:43.315046 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.315009    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:08:43.374198 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.374170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/995a976e-8241-44c5-a320-ec3cc9e550f2-cert\") pod \"kserve-controller-manager-7676c798d9-tf2pq\" (UID: \"995a976e-8241-44c5-a320-ec3cc9e550f2\") " pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:43.374345 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.374209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwc4l\" (UniqueName: \"kubernetes.io/projected/ec3df166-6dca-4f05-bbaf-0c5d8a8d8244-kube-api-access-qwc4l\") pod \"llmisvc-controller-manager-645f9c8fd6-c6wqk\" (UID: \"ec3df166-6dca-4f05-bbaf-0c5d8a8d8244\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:43.374345 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.374238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec3df166-6dca-4f05-bbaf-0c5d8a8d8244-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-c6wqk\" (UID: \"ec3df166-6dca-4f05-bbaf-0c5d8a8d8244\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:43.374345 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.374309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fz8t\" (UniqueName: \"kubernetes.io/projected/995a976e-8241-44c5-a320-ec3cc9e550f2-kube-api-access-9fz8t\") pod \"kserve-controller-manager-7676c798d9-tf2pq\" (UID: \"995a976e-8241-44c5-a320-ec3cc9e550f2\") " pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:43.374345 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:08:43.374332    2577 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 09 20:08:43.374578 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:08:43.374403    2577 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 09 20:08:43.374578 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:08:43.374407    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/995a976e-8241-44c5-a320-ec3cc9e550f2-cert podName:995a976e-8241-44c5-a320-ec3cc9e550f2 nodeName:}" failed. No retries permitted until 2026-09-09 20:08:43.874386412 +0000 UTC m=+821.924531491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/995a976e-8241-44c5-a320-ec3cc9e550f2-cert") pod "kserve-controller-manager-7676c798d9-tf2pq" (UID: "995a976e-8241-44c5-a320-ec3cc9e550f2") : secret "kserve-webhook-server-cert" not found
Sep 09 20:08:43.374578 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:08:43.374537    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec3df166-6dca-4f05-bbaf-0c5d8a8d8244-cert podName:ec3df166-6dca-4f05-bbaf-0c5d8a8d8244 nodeName:}" failed. No retries permitted until 2026-09-09 20:08:43.874510206 +0000 UTC m=+821.924655267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec3df166-6dca-4f05-bbaf-0c5d8a8d8244-cert") pod "llmisvc-controller-manager-645f9c8fd6-c6wqk" (UID: "ec3df166-6dca-4f05-bbaf-0c5d8a8d8244") : secret "llmisvc-webhook-server-cert" not found
Sep 09 20:08:43.382828 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.382800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwc4l\" (UniqueName: \"kubernetes.io/projected/ec3df166-6dca-4f05-bbaf-0c5d8a8d8244-kube-api-access-qwc4l\") pod \"llmisvc-controller-manager-645f9c8fd6-c6wqk\" (UID: \"ec3df166-6dca-4f05-bbaf-0c5d8a8d8244\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:43.382941 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.382842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fz8t\" (UniqueName: \"kubernetes.io/projected/995a976e-8241-44c5-a320-ec3cc9e550f2-kube-api-access-9fz8t\") pod \"kserve-controller-manager-7676c798d9-tf2pq\" (UID: \"995a976e-8241-44c5-a320-ec3cc9e550f2\") " pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:43.493096 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.492992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:08:43.749220 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.749098    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:08:43.838009 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.837968    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:08:43.880236 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.880201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec3df166-6dca-4f05-bbaf-0c5d8a8d8244-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-c6wqk\" (UID: \"ec3df166-6dca-4f05-bbaf-0c5d8a8d8244\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:43.880393 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.880332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/995a976e-8241-44c5-a320-ec3cc9e550f2-cert\") pod \"kserve-controller-manager-7676c798d9-tf2pq\" (UID: \"995a976e-8241-44c5-a320-ec3cc9e550f2\") " pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:43.882778 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.882750    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec3df166-6dca-4f05-bbaf-0c5d8a8d8244-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-c6wqk\" (UID: \"ec3df166-6dca-4f05-bbaf-0c5d8a8d8244\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:43.882908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.882884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/995a976e-8241-44c5-a320-ec3cc9e550f2-cert\") pod \"kserve-controller-manager-7676c798d9-tf2pq\" (UID: \"995a976e-8241-44c5-a320-ec3cc9e550f2\") " pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:43.901259 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:43.901232    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:08:44.121106 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:44.121069    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:44.144188 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:44.144163    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:44.392519 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:44.392221    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7676c798d9-tf2pq"]
Sep 09 20:08:44.394806 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:08:44.394777    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995a976e_8241_44c5_a320_ec3cc9e550f2.slice/crio-4b293e41b01ce94238afc3b1a841acb15f7c10f8cdfdc75a104e7dc5b40f57e8 WatchSource:0}: Error finding container 4b293e41b01ce94238afc3b1a841acb15f7c10f8cdfdc75a104e7dc5b40f57e8: Status 404 returned error can't find the container with id 4b293e41b01ce94238afc3b1a841acb15f7c10f8cdfdc75a104e7dc5b40f57e8
Sep 09 20:08:44.420098 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:44.420075    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"]
Sep 09 20:08:44.422400 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:08:44.422373    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podec3df166_6dca_4f05_bbaf_0c5d8a8d8244.slice/crio-5fc32d68205bb2ce8189797b8dbb203098672d90a965b27f60a8f0e4201dc21c WatchSource:0}: Error finding container 5fc32d68205bb2ce8189797b8dbb203098672d90a965b27f60a8f0e4201dc21c: Status 404 returned error can't find the container with id 5fc32d68205bb2ce8189797b8dbb203098672d90a965b27f60a8f0e4201dc21c
Sep 09 20:08:44.707434 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:44.707341    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk" event={"ID":"ec3df166-6dca-4f05-bbaf-0c5d8a8d8244","Type":"ContainerStarted","Data":"5fc32d68205bb2ce8189797b8dbb203098672d90a965b27f60a8f0e4201dc21c"}
Sep 09 20:08:44.708365 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:44.708348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq" event={"ID":"995a976e-8241-44c5-a320-ec3cc9e550f2","Type":"ContainerStarted","Data":"4b293e41b01ce94238afc3b1a841acb15f7c10f8cdfdc75a104e7dc5b40f57e8"}
Sep 09 20:08:48.733309 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:48.733273    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk" event={"ID":"ec3df166-6dca-4f05-bbaf-0c5d8a8d8244","Type":"ContainerStarted","Data":"c734536cae2165531139f899b863231f3a9b7612588c1f2ddb5b7325159bcb9e"}
Sep 09 20:08:48.733869 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:48.733344    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:08:48.734932 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:48.734906    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq" event={"ID":"995a976e-8241-44c5-a320-ec3cc9e550f2","Type":"ContainerStarted","Data":"74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2"}
Sep 09 20:08:48.735050 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:48.734956    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:08:48.751726 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:48.751686    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk" podStartSLOduration=2.326039077 podStartE2EDuration="5.75167154s" totalImagesPullingTime="3.425632463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:08:48.750210208 +0000 UTC m=+826.800355293" watchObservedRunningTime="2026-09-09 20:08:48.75167154 +0000 UTC m=+826.801816885"
Sep 09 20:08:51.307120 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:08:51.307086    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:09:19.742909 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:19.742879    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-c6wqk"
Sep 09 20:09:19.746082 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:19.746060    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:09:19.760788 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:19.760743    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq" podStartSLOduration=33.298013424 podStartE2EDuration="36.760728063s" totalImagesPullingTime="3.462714639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:08:48.765261372 +0000 UTC m=+826.815406457" watchObservedRunningTime="2026-09-09 20:09:19.760728063 +0000 UTC m=+857.810873182"
Sep 09 20:09:28.350434 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.350395    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7676c798d9-tf2pq"]
Sep 09 20:09:28.350931 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.350662    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq" podUID="995a976e-8241-44c5-a320-ec3cc9e550f2" containerName="manager" containerID="cri-o://74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2" gracePeriod=10
Sep 09 20:09:28.376917 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.376887    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7676c798d9-t2ftq"]
Sep 09 20:09:28.379331 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.379317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:09:28.388233 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.388212    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7676c798d9-t2ftq"]
Sep 09 20:09:28.486322 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.486294    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899-cert\") pod \"kserve-controller-manager-7676c798d9-t2ftq\" (UID: \"d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899\") " pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:09:28.486459 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.486336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds2dm\" (UniqueName: \"kubernetes.io/projected/d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899-kube-api-access-ds2dm\") pod \"kserve-controller-manager-7676c798d9-t2ftq\" (UID: \"d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899\") " pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:09:28.586852 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.586826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899-cert\") pod \"kserve-controller-manager-7676c798d9-t2ftq\" (UID: \"d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899\") " pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:09:28.586968 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.586859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds2dm\" (UniqueName: \"kubernetes.io/projected/d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899-kube-api-access-ds2dm\") pod \"kserve-controller-manager-7676c798d9-t2ftq\" (UID: \"d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899\") " pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:09:28.589417 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.589393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899-cert\") pod \"kserve-controller-manager-7676c798d9-t2ftq\" (UID: \"d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899\") " pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:09:28.590627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.590610    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:09:28.595653 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.595633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds2dm\" (UniqueName: \"kubernetes.io/projected/d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899-kube-api-access-ds2dm\") pod \"kserve-controller-manager-7676c798d9-t2ftq\" (UID: \"d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899\") " pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:09:28.687724 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.687643    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fz8t\" (UniqueName: \"kubernetes.io/projected/995a976e-8241-44c5-a320-ec3cc9e550f2-kube-api-access-9fz8t\") pod \"995a976e-8241-44c5-a320-ec3cc9e550f2\" (UID: \"995a976e-8241-44c5-a320-ec3cc9e550f2\") "
Sep 09 20:09:28.687865 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.687746    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/995a976e-8241-44c5-a320-ec3cc9e550f2-cert\") pod \"995a976e-8241-44c5-a320-ec3cc9e550f2\" (UID: \"995a976e-8241-44c5-a320-ec3cc9e550f2\") "
Sep 09 20:09:28.689940 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.689914    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/995a976e-8241-44c5-a320-ec3cc9e550f2-cert" (OuterVolumeSpecName: "cert") pod "995a976e-8241-44c5-a320-ec3cc9e550f2" (UID: "995a976e-8241-44c5-a320-ec3cc9e550f2"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:09:28.690048 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.689981    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995a976e-8241-44c5-a320-ec3cc9e550f2-kube-api-access-9fz8t" (OuterVolumeSpecName: "kube-api-access-9fz8t") pod "995a976e-8241-44c5-a320-ec3cc9e550f2" (UID: "995a976e-8241-44c5-a320-ec3cc9e550f2"). InnerVolumeSpecName "kube-api-access-9fz8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:09:28.726173 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.726142    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:09:28.788519 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.788493    2577 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/995a976e-8241-44c5-a320-ec3cc9e550f2-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:09:28.788519 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.788519    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fz8t\" (UniqueName: \"kubernetes.io/projected/995a976e-8241-44c5-a320-ec3cc9e550f2-kube-api-access-9fz8t\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:09:28.915561 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.915522    2577 generic.go:356] "Generic (PLEG): container finished" podID="995a976e-8241-44c5-a320-ec3cc9e550f2" containerID="74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2" exitCode=0
Sep 09 20:09:28.915736 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.915567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq" event={"ID":"995a976e-8241-44c5-a320-ec3cc9e550f2","Type":"ContainerDied","Data":"74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2"}
Sep 09 20:09:28.915736 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.915609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq" event={"ID":"995a976e-8241-44c5-a320-ec3cc9e550f2","Type":"ContainerDied","Data":"4b293e41b01ce94238afc3b1a841acb15f7c10f8cdfdc75a104e7dc5b40f57e8"}
Sep 09 20:09:28.915736 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.915632    2577 scope.go:117] "RemoveContainer" containerID="74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2"
Sep 09 20:09:28.915736 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.915571    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7676c798d9-tf2pq"
Sep 09 20:09:28.924492 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.924455    2577 scope.go:117] "RemoveContainer" containerID="74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2"
Sep 09 20:09:28.924767 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:09:28.924748    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2\": container with ID starting with 74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2 not found: ID does not exist" containerID="74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2"
Sep 09 20:09:28.924816 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.924775    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2"} err="failed to get container status \"74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2\": rpc error: code = NotFound desc = could not find container \"74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2\": container with ID starting with 74130acb6f3eaacde27d946102383e7a3b69898ffc3634313bd93058abad3da2 not found: ID does not exist"
Sep 09 20:09:28.937941 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.937885    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7676c798d9-tf2pq"]
Sep 09 20:09:28.941790 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.941770    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7676c798d9-tf2pq"]
Sep 09 20:09:28.996011 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:28.995993    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7676c798d9-t2ftq"]
Sep 09 20:09:28.998364 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:09:28.998333    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58cf3d4_9cb9_4577_8dc2_2cbb3fb4b899.slice/crio-ddabb59f89e227abfc9fad135b82151900cc8f8756d914e79fe906166c236bdc WatchSource:0}: Error finding container ddabb59f89e227abfc9fad135b82151900cc8f8756d914e79fe906166c236bdc: Status 404 returned error can't find the container with id ddabb59f89e227abfc9fad135b82151900cc8f8756d914e79fe906166c236bdc
Sep 09 20:09:29.922940 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:29.922905    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7676c798d9-t2ftq" event={"ID":"d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899","Type":"ContainerStarted","Data":"55b47867a86c0ee54b07af2158a440ea4deda0d5e66b8266d1e7476f386207b5"}
Sep 09 20:09:29.923300 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:29.922982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7676c798d9-t2ftq" event={"ID":"d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899","Type":"ContainerStarted","Data":"ddabb59f89e227abfc9fad135b82151900cc8f8756d914e79fe906166c236bdc"}
Sep 09 20:09:29.923300 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:29.923070    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:09:29.940951 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:29.940905    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7676c798d9-t2ftq" podStartSLOduration=1.507269127 podStartE2EDuration="1.940889976s" totalImagesPullingTime="433.620849ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:09:29.938748118 +0000 UTC m=+867.988893200" watchObservedRunningTime="2026-09-09 20:09:29.940889976 +0000 UTC m=+867.991035057"
Sep 09 20:09:30.446668 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:09:30.446639    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="995a976e-8241-44c5-a320-ec3cc9e550f2" path="/var/lib/kubelet/pods/995a976e-8241-44c5-a320-ec3cc9e550f2/volumes"
Sep 09 20:10:00.933793 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:00.933717    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7676c798d9-t2ftq"
Sep 09 20:10:02.414929 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:02.414896    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:10:02.416458 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:02.416431    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:10:02.534877 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:02.534844    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:10:02.596945 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:02.596905    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:10:02.697943 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:02.697864    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:10:02.798208 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:02.798164    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:10:03.218236 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:03.218199    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:10:03.943193 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:03.943158    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:10:04.096620 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:04.096586    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:10:23.270636 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:23.270596    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:10:23.370774 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:10:23.370745    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:37.756509 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:37.756401    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:39.720702 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:39.720650    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:50.335613 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.335576    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:50.538063 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.538027    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:50.655195 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.655067    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:50.687029 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.686998    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"]
Sep 09 20:11:50.687393 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.687381    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995a976e-8241-44c5-a320-ec3cc9e550f2" containerName="manager"
Sep 09 20:11:50.687439 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.687396    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="995a976e-8241-44c5-a320-ec3cc9e550f2" containerName="manager"
Sep 09 20:11:50.687511 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.687463    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="995a976e-8241-44c5-a320-ec3cc9e550f2" containerName="manager"
Sep 09 20:11:50.690731 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.690717    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.692999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.692976    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Sep 09 20:11:50.692999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.692980    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Sep 09 20:11:50.693452 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.693149    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 09 20:11:50.694001 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.693979    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Sep 09 20:11:50.694089 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.694012    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-w6n8h\""
Sep 09 20:11:50.694326 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.694306    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 09 20:11:50.694564 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.694547    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Sep 09 20:11:50.703850 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.703827    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"]
Sep 09 20:11:50.754631 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.754575    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:50.838458 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.838427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.838638 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.838508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.838638 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.838533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.838738 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.838673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.838738 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.838694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjdw7\" (UniqueName: \"kubernetes.io/projected/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-api-access-sjdw7\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.855016 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.854972    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:50.932933 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.932852    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:50.940129 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.940101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.940263 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.940143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.940263 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.940171    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.940263 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.940235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.940263 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.940257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjdw7\" (UniqueName: \"kubernetes.io/projected/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-api-access-sjdw7\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.940630 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.940604    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.940984 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.940963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.941073 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.940976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.942994 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.942975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:50.948886 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:50.948864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjdw7\" (UniqueName: \"kubernetes.io/projected/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-api-access-sjdw7\") pod \"isvc-xgboost-graph-predictor-555fc69d56-4pcvk\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:51.005728 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:51.005691    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:51.006641 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:51.006611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:11:51.107541 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:51.107457    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:51.290704 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:51.290681    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"]
Sep 09 20:11:51.292344 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:11:51.292322    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c5b3fad_6697_4574_b6fc_7ef1aacc7af5.slice/crio-5dd7f107735997c1fff20c31544edea91870e9d586390b76ca4432d1dd73de25 WatchSource:0}: Error finding container 5dd7f107735997c1fff20c31544edea91870e9d586390b76ca4432d1dd73de25: Status 404 returned error can't find the container with id 5dd7f107735997c1fff20c31544edea91870e9d586390b76ca4432d1dd73de25
Sep 09 20:11:51.294428 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:51.294408    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:11:51.573538 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:51.573436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" event={"ID":"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5","Type":"ContainerStarted","Data":"5dd7f107735997c1fff20c31544edea91870e9d586390b76ca4432d1dd73de25"}
Sep 09 20:11:51.613854 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:51.613825    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:11:55.594249 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:55.594210    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" event={"ID":"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5","Type":"ContainerStarted","Data":"dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545"}
Sep 09 20:11:58.613055 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:58.613019    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerID="dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545" exitCode=0
Sep 09 20:11:58.613526 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:11:58.613087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" event={"ID":"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5","Type":"ContainerDied","Data":"dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545"}
Sep 09 20:12:19.726244 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:19.726203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" event={"ID":"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5","Type":"ContainerStarted","Data":"1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf"}
Sep 09 20:12:21.738207 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:21.738173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" event={"ID":"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5","Type":"ContainerStarted","Data":"e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397"}
Sep 09 20:12:21.738663 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:21.738433    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:12:21.738663 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:21.738503    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:12:21.739991 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:21.739956    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 09 20:12:21.758295 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:21.758257    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podStartSLOduration=2.342913602 podStartE2EDuration="31.758245196s" totalImagesPullingTime="25.687623423s" totalInitContainerRuntime="3.727708171s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:11:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:12:21.75705365 +0000 UTC m=+1039.807198733" watchObservedRunningTime="2026-09-09 20:12:21.758245196 +0000 UTC m=+1039.808390279"
Sep 09 20:12:22.743225 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:22.743182    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 09 20:12:27.748189 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:27.748159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:12:27.748836 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:27.748811    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 09 20:12:32.452437 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:32.452407    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:12:37.749080 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:37.749039    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 09 20:12:47.749701 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:47.749662    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 09 20:12:57.749535 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:12:57.749430    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 09 20:13:07.749223 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:07.749186    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 09 20:13:10.266815 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.266784    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"]
Sep 09 20:13:10.269292 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.269276    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:10.270440 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.270412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:10.271318 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.271281    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-3b763-serving-cert\""
Sep 09 20:13:10.271426 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.271376    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-3b763-kube-rbac-proxy-sar-config\""
Sep 09 20:13:10.279321 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.279297    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"]
Sep 09 20:13:10.332422 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.332395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa306e6-d254-431c-ae55-157fbf136618-openshift-service-ca-bundle\") pod \"switch-graph-3b763-7c7b5fc4cd-6jwx9\" (UID: \"aaa306e6-d254-431c-ae55-157fbf136618\") " pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:10.332573 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.332492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaa306e6-d254-431c-ae55-157fbf136618-proxy-tls\") pod \"switch-graph-3b763-7c7b5fc4cd-6jwx9\" (UID: \"aaa306e6-d254-431c-ae55-157fbf136618\") " pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:10.433455 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.433422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaa306e6-d254-431c-ae55-157fbf136618-proxy-tls\") pod \"switch-graph-3b763-7c7b5fc4cd-6jwx9\" (UID: \"aaa306e6-d254-431c-ae55-157fbf136618\") " pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:10.433702 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.433507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa306e6-d254-431c-ae55-157fbf136618-openshift-service-ca-bundle\") pod \"switch-graph-3b763-7c7b5fc4cd-6jwx9\" (UID: \"aaa306e6-d254-431c-ae55-157fbf136618\") " pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:10.433702 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:13:10.433598    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-3b763-serving-cert: secret "switch-graph-3b763-serving-cert" not found
Sep 09 20:13:10.433702 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:13:10.433666    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaa306e6-d254-431c-ae55-157fbf136618-proxy-tls podName:aaa306e6-d254-431c-ae55-157fbf136618 nodeName:}" failed. No retries permitted until 2026-09-09 20:13:10.933647533 +0000 UTC m=+1088.983792614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/aaa306e6-d254-431c-ae55-157fbf136618-proxy-tls") pod "switch-graph-3b763-7c7b5fc4cd-6jwx9" (UID: "aaa306e6-d254-431c-ae55-157fbf136618") : secret "switch-graph-3b763-serving-cert" not found
Sep 09 20:13:10.434210 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.434183    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa306e6-d254-431c-ae55-157fbf136618-openshift-service-ca-bundle\") pod \"switch-graph-3b763-7c7b5fc4cd-6jwx9\" (UID: \"aaa306e6-d254-431c-ae55-157fbf136618\") " pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:10.684607 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.684574    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:10.937439 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.937358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaa306e6-d254-431c-ae55-157fbf136618-proxy-tls\") pod \"switch-graph-3b763-7c7b5fc4cd-6jwx9\" (UID: \"aaa306e6-d254-431c-ae55-157fbf136618\") " pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:10.939861 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:10.939842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaa306e6-d254-431c-ae55-157fbf136618-proxy-tls\") pod \"switch-graph-3b763-7c7b5fc4cd-6jwx9\" (UID: \"aaa306e6-d254-431c-ae55-157fbf136618\") " pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:11.179604 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:11.179562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:11.448646 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:11.448625    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"]
Sep 09 20:13:11.450895 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:13:11.450865    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa306e6_d254_431c_ae55_157fbf136618.slice/crio-b57da6255334b8d2776fad2063c03f2507b0d56072d304b025ff404a15f624c7 WatchSource:0}: Error finding container b57da6255334b8d2776fad2063c03f2507b0d56072d304b025ff404a15f624c7: Status 404 returned error can't find the container with id b57da6255334b8d2776fad2063c03f2507b0d56072d304b025ff404a15f624c7
Sep 09 20:13:11.973770 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:11.973732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" event={"ID":"aaa306e6-d254-431c-ae55-157fbf136618","Type":"ContainerStarted","Data":"b57da6255334b8d2776fad2063c03f2507b0d56072d304b025ff404a15f624c7"}
Sep 09 20:13:14.988868 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:14.988789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" event={"ID":"aaa306e6-d254-431c-ae55-157fbf136618","Type":"ContainerStarted","Data":"f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869"}
Sep 09 20:13:14.989206 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:14.988872    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:15.005522 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:15.005456    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" podStartSLOduration=1.9074651120000001 podStartE2EDuration="5.005441609s" totalImagesPullingTime="3.097976497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:13:15.004359189 +0000 UTC m=+1093.054504273" watchObservedRunningTime="2026-09-09 20:13:15.005441609 +0000 UTC m=+1093.055586692"
Sep 09 20:13:16.103749 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:16.103715    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:16.162536 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:16.162508    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:17.750537 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:17.750509    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:13:20.998692 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:20.998665    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:24.399367 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:24.399329    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"]
Sep 09 20:13:24.399798 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:24.399546    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763" containerID="cri-o://f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869" gracePeriod=30
Sep 09 20:13:24.426501 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:24.426460    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:24.596891 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:24.596858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:24.695143 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:24.695037    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:24.764111 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:24.764078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:24.827887 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:24.827855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:24.886658 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:24.886624    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:25.210591 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:25.210562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:13:25.997919 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:25.997885    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:13:30.997850 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:30.997813    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:13:35.997885 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:35.997847    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:13:35.998345 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:35.997950    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:40.997831 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:40.997789    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:13:45.997620 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:45.997581    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:13:50.997903 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:50.997870    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:13:55.045591 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.045567    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:55.120157 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.120129    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaa306e6-d254-431c-ae55-157fbf136618-proxy-tls\") pod \"aaa306e6-d254-431c-ae55-157fbf136618\" (UID: \"aaa306e6-d254-431c-ae55-157fbf136618\") "
Sep 09 20:13:55.120285 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.120215    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa306e6-d254-431c-ae55-157fbf136618-openshift-service-ca-bundle\") pod \"aaa306e6-d254-431c-ae55-157fbf136618\" (UID: \"aaa306e6-d254-431c-ae55-157fbf136618\") "
Sep 09 20:13:55.120596 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.120575    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaa306e6-d254-431c-ae55-157fbf136618-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "aaa306e6-d254-431c-ae55-157fbf136618" (UID: "aaa306e6-d254-431c-ae55-157fbf136618"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:13:55.122437 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.122417    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa306e6-d254-431c-ae55-157fbf136618-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "aaa306e6-d254-431c-ae55-157fbf136618" (UID: "aaa306e6-d254-431c-ae55-157fbf136618"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:13:55.178926 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.178861    2577 generic.go:356] "Generic (PLEG): container finished" podID="aaa306e6-d254-431c-ae55-157fbf136618" containerID="f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869" exitCode=0
Sep 09 20:13:55.178926 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.178905    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"
Sep 09 20:13:55.179059 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.178948    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" event={"ID":"aaa306e6-d254-431c-ae55-157fbf136618","Type":"ContainerDied","Data":"f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869"}
Sep 09 20:13:55.179059 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.178992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9" event={"ID":"aaa306e6-d254-431c-ae55-157fbf136618","Type":"ContainerDied","Data":"b57da6255334b8d2776fad2063c03f2507b0d56072d304b025ff404a15f624c7"}
Sep 09 20:13:55.179059 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.179014    2577 scope.go:117] "RemoveContainer" containerID="f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869"
Sep 09 20:13:55.187714 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.187698    2577 scope.go:117] "RemoveContainer" containerID="f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869"
Sep 09 20:13:55.187957 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:13:55.187938    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869\": container with ID starting with f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869 not found: ID does not exist" containerID="f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869"
Sep 09 20:13:55.187999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.187966    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869"} err="failed to get container status \"f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869\": rpc error: code = NotFound desc = could not find container \"f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869\": container with ID starting with f90797496b281b23ffa34f20cfb7492c588b72d984a24f15953011c357d7e869 not found: ID does not exist"
Sep 09 20:13:55.199255 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.199235    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"]
Sep 09 20:13:55.202944 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.202924    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-3b763-7c7b5fc4cd-6jwx9"]
Sep 09 20:13:55.220749 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.220728    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/aaa306e6-d254-431c-ae55-157fbf136618-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:13:55.220832 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:55.220752    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa306e6-d254-431c-ae55-157fbf136618-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:13:56.446430 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:13:56.446401    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaa306e6-d254-431c-ae55-157fbf136618" path="/var/lib/kubelet/pods/aaa306e6-d254-431c-ae55-157fbf136618/volumes"
Sep 09 20:14:00.222105 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.222068    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:00.310023 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.309988    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:00.310596 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.310577    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"]
Sep 09 20:14:00.310967 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.310955    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763"
Sep 09 20:14:00.311019 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.310996    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763"
Sep 09 20:14:00.311067 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.311060    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa306e6-d254-431c-ae55-157fbf136618" containerName="switch-graph-3b763"
Sep 09 20:14:00.314390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.314374    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:00.316190 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.316176    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Sep 09 20:14:00.316251 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.316180    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Sep 09 20:14:00.321629 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.321606    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"]
Sep 09 20:14:00.358440 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.358413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-proxy-tls\") pod \"model-chainer-55b47c64d-5br6l\" (UID: \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\") " pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:00.358584 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.358454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-openshift-service-ca-bundle\") pod \"model-chainer-55b47c64d-5br6l\" (UID: \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\") " pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:00.365673 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.365651    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:00.459486 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.459436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-proxy-tls\") pod \"model-chainer-55b47c64d-5br6l\" (UID: \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\") " pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:00.459647 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.459502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-openshift-service-ca-bundle\") pod \"model-chainer-55b47c64d-5br6l\" (UID: \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\") " pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:00.459647 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:14:00.459585    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found
Sep 09 20:14:00.459730 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:14:00.459658    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-proxy-tls podName:9a58d574-b8e4-4ac7-9e78-63cba9ceb267 nodeName:}" failed. No retries permitted until 2026-09-09 20:14:00.959639365 +0000 UTC m=+1139.009784425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-proxy-tls") pod "model-chainer-55b47c64d-5br6l" (UID: "9a58d574-b8e4-4ac7-9e78-63cba9ceb267") : secret "model-chainer-serving-cert" not found
Sep 09 20:14:00.460077 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.460060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-openshift-service-ca-bundle\") pod \"model-chainer-55b47c64d-5br6l\" (UID: \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\") " pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:00.526665 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.526587    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:00.964055 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.964027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-proxy-tls\") pod \"model-chainer-55b47c64d-5br6l\" (UID: \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\") " pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:00.966537 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:00.966514    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-proxy-tls\") pod \"model-chainer-55b47c64d-5br6l\" (UID: \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\") " pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:01.225216 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:01.225122    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:01.496126 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:01.496101    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"]
Sep 09 20:14:01.497957 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:14:01.497932    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a58d574_b8e4_4ac7_9e78_63cba9ceb267.slice/crio-6a31cd5db98f624a9c91eb8bfd89ab7ecb6579b34b7a30221216ce403d220a7b WatchSource:0}: Error finding container 6a31cd5db98f624a9c91eb8bfd89ab7ecb6579b34b7a30221216ce403d220a7b: Status 404 returned error can't find the container with id 6a31cd5db98f624a9c91eb8bfd89ab7ecb6579b34b7a30221216ce403d220a7b
Sep 09 20:14:02.213820 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:02.213786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" event={"ID":"9a58d574-b8e4-4ac7-9e78-63cba9ceb267","Type":"ContainerStarted","Data":"73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81"}
Sep 09 20:14:02.214092 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:02.213835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" event={"ID":"9a58d574-b8e4-4ac7-9e78-63cba9ceb267","Type":"ContainerStarted","Data":"6a31cd5db98f624a9c91eb8bfd89ab7ecb6579b34b7a30221216ce403d220a7b"}
Sep 09 20:14:02.214092 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:02.213903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:02.231267 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:02.231217    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" podStartSLOduration=2.231201677 podStartE2EDuration="2.231201677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:14:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:14:02.229829387 +0000 UTC m=+1140.279974470" watchObservedRunningTime="2026-09-09 20:14:02.231201677 +0000 UTC m=+1140.281346761"
Sep 09 20:14:08.223708 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:08.223679    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:10.416773 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.416729    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"]
Sep 09 20:14:10.417242 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.416985    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer" containerID="cri-o://73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81" gracePeriod=30
Sep 09 20:14:10.436042 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.436010    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:10.546849 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.546811    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:10.596751 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.596720    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"]
Sep 09 20:14:10.597104 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.597073    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container" containerID="cri-o://1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf" gracePeriod=30
Sep 09 20:14:10.597239 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.597138    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kube-rbac-proxy" containerID="cri-o://e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397" gracePeriod=30
Sep 09 20:14:10.622311 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.622284    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:10.682168 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.682087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:10.780352 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.780323    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:10.903032 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:10.902996    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:11.161254 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:11.161218    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:11.257943 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:11.257913    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerID="e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397" exitCode=2
Sep 09 20:14:11.258121 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:11.257990    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" event={"ID":"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5","Type":"ContainerDied","Data":"e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397"}
Sep 09 20:14:12.743789 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:12.743746    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused"
Sep 09 20:14:13.222199 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:13.222162    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:14:14.243280 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.243257    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:14:14.276329 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.276297    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerID="1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf" exitCode=0
Sep 09 20:14:14.276510 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.276351    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"
Sep 09 20:14:14.276510 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.276386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" event={"ID":"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5","Type":"ContainerDied","Data":"1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf"}
Sep 09 20:14:14.276510 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.276448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk" event={"ID":"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5","Type":"ContainerDied","Data":"5dd7f107735997c1fff20c31544edea91870e9d586390b76ca4432d1dd73de25"}
Sep 09 20:14:14.276510 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.276510    2577 scope.go:117] "RemoveContainer" containerID="e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397"
Sep 09 20:14:14.278706 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.278685    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjdw7\" (UniqueName: \"kubernetes.io/projected/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-api-access-sjdw7\") pod \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") "
Sep 09 20:14:14.278825 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.278730    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-rbac-proxy-sar-config\") pod \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") "
Sep 09 20:14:14.278825 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.278764    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-proxy-tls\") pod \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") "
Sep 09 20:14:14.278825 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.278803    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kserve-provision-location\") pod \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") "
Sep 09 20:14:14.278983 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.278830    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-cabundle-cert\") pod \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\" (UID: \"6c5b3fad-6697-4574-b6fc-7ef1aacc7af5\") "
Sep 09 20:14:14.279189 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.279161    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" (UID: "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:14:14.279257 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.279226    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" (UID: "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:14:14.279594 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.279569    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" (UID: "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 20:14:14.281522 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.281495    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" (UID: "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:14:14.281522 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.281505    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-api-access-sjdw7" (OuterVolumeSpecName: "kube-api-access-sjdw7") pod "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" (UID: "6c5b3fad-6697-4574-b6fc-7ef1aacc7af5"). InnerVolumeSpecName "kube-api-access-sjdw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 20:14:14.285441 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.285425    2577 scope.go:117] "RemoveContainer" containerID="1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf"
Sep 09 20:14:14.296789 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.296767    2577 scope.go:117] "RemoveContainer" containerID="dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545"
Sep 09 20:14:14.304622 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.304602    2577 scope.go:117] "RemoveContainer" containerID="e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397"
Sep 09 20:14:14.304946 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:14:14.304926    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397\": container with ID starting with e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397 not found: ID does not exist" containerID="e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397"
Sep 09 20:14:14.304998 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.304955    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397"} err="failed to get container status \"e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397\": rpc error: code = NotFound desc = could not find container \"e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397\": container with ID starting with e02731d89985515c6974f46df31620f460054560ccdcba1e5697016413925397 not found: ID does not exist"
Sep 09 20:14:14.304998 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.304973    2577 scope.go:117] "RemoveContainer" containerID="1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf"
Sep 09 20:14:14.305265 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:14:14.305249    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf\": container with ID starting with 1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf not found: ID does not exist" containerID="1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf"
Sep 09 20:14:14.305308 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.305275    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf"} err="failed to get container status \"1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf\": rpc error: code = NotFound desc = could not find container \"1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf\": container with ID starting with 1592e5ee78133cf025e9bd88920201b43f6c70fbddfceb4936270a4bc71640bf not found: ID does not exist"
Sep 09 20:14:14.305308 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.305290    2577 scope.go:117] "RemoveContainer" containerID="dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545"
Sep 09 20:14:14.305586 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:14:14.305568    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545\": container with ID starting with dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545 not found: ID does not exist" containerID="dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545"
Sep 09 20:14:14.305667 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.305592    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545"} err="failed to get container status \"dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545\": rpc error: code = NotFound desc = could not find container \"dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545\": container with ID starting with dcca6d7966c8acb6508a81e8f42d0e7fb448d801176efb7bac89e19235339545 not found: ID does not exist"
Sep 09 20:14:14.380390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.380314    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjdw7\" (UniqueName: \"kubernetes.io/projected/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-api-access-sjdw7\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:14:14.380390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.380344    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kube-rbac-proxy-sar-config\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:14:14.380390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.380355    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:14:14.380390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.380363    2577 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-kserve-provision-location\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:14:14.380390 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.380371    2577 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5-cabundle-cert\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:14:14.593373 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.593335    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"]
Sep 09 20:14:14.597660 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:14.597634    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-4pcvk"]
Sep 09 20:14:16.446873 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:16.446841    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" path="/var/lib/kubelet/pods/6c5b3fad-6697-4574-b6fc-7ef1aacc7af5/volumes"
Sep 09 20:14:18.222445 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:18.222406    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:14:23.222644 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:23.222607    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:14:23.223045 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:23.222706    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:24.622050 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.622017    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"]
Sep 09 20:14:24.622401 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.622361    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container"
Sep 09 20:14:24.622401 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.622371    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container"
Sep 09 20:14:24.622401 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.622387    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="storage-initializer"
Sep 09 20:14:24.622401 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.622392    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="storage-initializer"
Sep 09 20:14:24.622401 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.622403    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kube-rbac-proxy"
Sep 09 20:14:24.622586 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.622409    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kube-rbac-proxy"
Sep 09 20:14:24.622586 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.622490    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kserve-container"
Sep 09 20:14:24.622586 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.622503    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c5b3fad-6697-4574-b6fc-7ef1aacc7af5" containerName="kube-rbac-proxy"
Sep 09 20:14:24.627103 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.627081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:24.629083 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.629065    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-d2727-serving-cert\""
Sep 09 20:14:24.629145 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.629101    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-d2727-kube-rbac-proxy-sar-config\""
Sep 09 20:14:24.635414 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.635387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:24.636035 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.636018    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"]
Sep 09 20:14:24.774728 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.774695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2621a172-058f-462e-b09b-8d3979246515-openshift-service-ca-bundle\") pod \"switch-graph-d2727-58876698f6-whzzh\" (UID: \"2621a172-058f-462e-b09b-8d3979246515\") " pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:24.774728 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.774737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2621a172-058f-462e-b09b-8d3979246515-proxy-tls\") pod \"switch-graph-d2727-58876698f6-whzzh\" (UID: \"2621a172-058f-462e-b09b-8d3979246515\") " pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:24.875457 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.875364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2621a172-058f-462e-b09b-8d3979246515-proxy-tls\") pod \"switch-graph-d2727-58876698f6-whzzh\" (UID: \"2621a172-058f-462e-b09b-8d3979246515\") " pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:24.875627 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:14:24.875544    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-d2727-serving-cert: secret "switch-graph-d2727-serving-cert" not found
Sep 09 20:14:24.875627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.875557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2621a172-058f-462e-b09b-8d3979246515-openshift-service-ca-bundle\") pod \"switch-graph-d2727-58876698f6-whzzh\" (UID: \"2621a172-058f-462e-b09b-8d3979246515\") " pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:24.875627 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:14:24.875625    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2621a172-058f-462e-b09b-8d3979246515-proxy-tls podName:2621a172-058f-462e-b09b-8d3979246515 nodeName:}" failed. No retries permitted until 2026-09-09 20:14:25.375603291 +0000 UTC m=+1163.425748370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2621a172-058f-462e-b09b-8d3979246515-proxy-tls") pod "switch-graph-d2727-58876698f6-whzzh" (UID: "2621a172-058f-462e-b09b-8d3979246515") : secret "switch-graph-d2727-serving-cert" not found
Sep 09 20:14:24.876188 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.876169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2621a172-058f-462e-b09b-8d3979246515-openshift-service-ca-bundle\") pod \"switch-graph-d2727-58876698f6-whzzh\" (UID: \"2621a172-058f-462e-b09b-8d3979246515\") " pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:24.933638 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:24.933613    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:14:25.379740 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:25.379709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2621a172-058f-462e-b09b-8d3979246515-proxy-tls\") pod \"switch-graph-d2727-58876698f6-whzzh\" (UID: \"2621a172-058f-462e-b09b-8d3979246515\") " pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:25.382262 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:25.382240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2621a172-058f-462e-b09b-8d3979246515-proxy-tls\") pod \"switch-graph-d2727-58876698f6-whzzh\" (UID: \"2621a172-058f-462e-b09b-8d3979246515\") " pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:25.537710 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:25.537678    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:25.809348 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:25.809326    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"]
Sep 09 20:14:25.811453 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:14:25.811424    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2621a172_058f_462e_b09b_8d3979246515.slice/crio-a0d9f90571a13bc6ef4f5e98d9c5c6ec9102764fc8a8cdd1a7061de474ceefb5 WatchSource:0}: Error finding container a0d9f90571a13bc6ef4f5e98d9c5c6ec9102764fc8a8cdd1a7061de474ceefb5: Status 404 returned error can't find the container with id a0d9f90571a13bc6ef4f5e98d9c5c6ec9102764fc8a8cdd1a7061de474ceefb5
Sep 09 20:14:26.332178 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:26.332142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" event={"ID":"2621a172-058f-462e-b09b-8d3979246515","Type":"ContainerStarted","Data":"29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612"}
Sep 09 20:14:26.332373 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:26.332200    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" event={"ID":"2621a172-058f-462e-b09b-8d3979246515","Type":"ContainerStarted","Data":"a0d9f90571a13bc6ef4f5e98d9c5c6ec9102764fc8a8cdd1a7061de474ceefb5"}
Sep 09 20:14:26.332373 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:26.332226    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:26.348339 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:26.348290    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" podStartSLOduration=2.348276274 podStartE2EDuration="2.348276274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:14:26.346805949 +0000 UTC m=+1164.396951032" watchObservedRunningTime="2026-09-09 20:14:26.348276274 +0000 UTC m=+1164.398421357"
Sep 09 20:14:28.222702 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:28.222667    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:14:32.342775 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:32.342747    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:14:33.222163 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:33.222120    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:14:38.221862 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:38.221818    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:14:40.562961 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:40.562936    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:40.710232 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:40.710154    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-proxy-tls\") pod \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\" (UID: \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\") "
Sep 09 20:14:40.710383 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:40.710248    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-openshift-service-ca-bundle\") pod \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\" (UID: \"9a58d574-b8e4-4ac7-9e78-63cba9ceb267\") "
Sep 09 20:14:40.710585 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:40.710550    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9a58d574-b8e4-4ac7-9e78-63cba9ceb267" (UID: "9a58d574-b8e4-4ac7-9e78-63cba9ceb267"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:14:40.712285 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:40.712264    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9a58d574-b8e4-4ac7-9e78-63cba9ceb267" (UID: "9a58d574-b8e4-4ac7-9e78-63cba9ceb267"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:14:40.811713 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:40.811684    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:14:40.811713 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:40.811706    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a58d574-b8e4-4ac7-9e78-63cba9ceb267-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:14:41.403642 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:41.403605    2577 generic.go:356] "Generic (PLEG): container finished" podID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerID="73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81" exitCode=0
Sep 09 20:14:41.403831 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:41.403650    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"
Sep 09 20:14:41.403831 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:41.403684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" event={"ID":"9a58d574-b8e4-4ac7-9e78-63cba9ceb267","Type":"ContainerDied","Data":"73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81"}
Sep 09 20:14:41.403831 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:41.403741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l" event={"ID":"9a58d574-b8e4-4ac7-9e78-63cba9ceb267","Type":"ContainerDied","Data":"6a31cd5db98f624a9c91eb8bfd89ab7ecb6579b34b7a30221216ce403d220a7b"}
Sep 09 20:14:41.403831 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:41.403764    2577 scope.go:117] "RemoveContainer" containerID="73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81"
Sep 09 20:14:41.412720 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:41.412705    2577 scope.go:117] "RemoveContainer" containerID="73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81"
Sep 09 20:14:41.412960 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:14:41.412944    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81\": container with ID starting with 73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81 not found: ID does not exist" containerID="73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81"
Sep 09 20:14:41.413005 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:41.412968    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81"} err="failed to get container status \"73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81\": rpc error: code = NotFound desc = could not find container \"73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81\": container with ID starting with 73c7082caedab70fd62b55faead711adfe70d2457bdf5fcde9a7365893433c81 not found: ID does not exist"
Sep 09 20:14:41.424698 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:41.424676    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"]
Sep 09 20:14:41.431220 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:41.431187    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-55b47c64d-5br6l"]
Sep 09 20:14:42.446071 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:14:42.446040    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" path="/var/lib/kubelet/pods/9a58d574-b8e4-4ac7-9e78-63cba9ceb267/volumes"
Sep 09 20:15:02.447968 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:02.447939    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:15:02.451366 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:02.451338    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:15:10.645706 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.645665    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"]
Sep 09 20:15:10.646251 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.646205    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer"
Sep 09 20:15:10.646251 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.646224    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer"
Sep 09 20:15:10.646373 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.646319    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a58d574-b8e4-4ac7-9e78-63cba9ceb267" containerName="model-chainer"
Sep 09 20:15:10.650276 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.650227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:15:10.650806 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.650790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:10.652889 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.652874    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-2e942-kube-rbac-proxy-sar-config\""
Sep 09 20:15:10.652968 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.652879    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-2e942-serving-cert\""
Sep 09 20:15:10.658369 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.658347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"]
Sep 09 20:15:10.762401 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.762365    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:15:10.762742 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.762725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-openshift-service-ca-bundle\") pod \"sequence-graph-2e942-79888d85c-7dbmh\" (UID: \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\") " pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:10.762802 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.762751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-proxy-tls\") pod \"sequence-graph-2e942-79888d85c-7dbmh\" (UID: \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\") " pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:10.863842 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.863803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-openshift-service-ca-bundle\") pod \"sequence-graph-2e942-79888d85c-7dbmh\" (UID: \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\") " pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:10.863842 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.863839    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-proxy-tls\") pod \"sequence-graph-2e942-79888d85c-7dbmh\" (UID: \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\") " pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:10.864443 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.864424    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-openshift-service-ca-bundle\") pod \"sequence-graph-2e942-79888d85c-7dbmh\" (UID: \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\") " pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:10.866314 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.866294    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-proxy-tls\") pod \"sequence-graph-2e942-79888d85c-7dbmh\" (UID: \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\") " pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:10.962062 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:10.961977    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:11.230670 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:11.230648    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"]
Sep 09 20:15:11.232903 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:15:11.232869    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89bf329d_d8fc_4bb2_a3ea_11e7f36fe4e5.slice/crio-a6172e494703755cea647b7ca39c7d25963571e42ee12c7a42c31cc46c0f34b5 WatchSource:0}: Error finding container a6172e494703755cea647b7ca39c7d25963571e42ee12c7a42c31cc46c0f34b5: Status 404 returned error can't find the container with id a6172e494703755cea647b7ca39c7d25963571e42ee12c7a42c31cc46c0f34b5
Sep 09 20:15:11.542700 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:11.542667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" event={"ID":"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5","Type":"ContainerStarted","Data":"a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933"}
Sep 09 20:15:11.542898 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:11.542721    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" event={"ID":"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5","Type":"ContainerStarted","Data":"a6172e494703755cea647b7ca39c7d25963571e42ee12c7a42c31cc46c0f34b5"}
Sep 09 20:15:11.542898 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:11.542744    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:11.559029 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:11.558982    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" podStartSLOduration=1.558968953 podStartE2EDuration="1.558968953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:15:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:15:11.558047508 +0000 UTC m=+1209.608192591" watchObservedRunningTime="2026-09-09 20:15:11.558968953 +0000 UTC m=+1209.609114035"
Sep 09 20:15:17.556059 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:17.556029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:15:46.588216 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:46.588185    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:15:46.689252 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:15:46.689219    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:16:41.684081 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:16:41.684045    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:18:23.907718 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:18:23.907686    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:19:10.204797 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:19:10.204725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:19:10.305799 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:19:10.305771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:20:02.485810 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:20:02.485781    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:20:02.490980 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:20:02.490951    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:21:04.138169 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:21:04.138132    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:22:39.220356 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:22:39.220320    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"]
Sep 09 20:22:39.221020 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:22:39.220557    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727" containerID="cri-o://29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612" gracePeriod=30
Sep 09 20:22:39.267163 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:22:39.267134    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:22:41.341911 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:22:41.341880    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:22:42.341064 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:22:42.341033    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:22:47.340847 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:22:47.340802    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:22:52.340531 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:22:52.340462    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:22:52.340995 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:22:52.340632    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:22:57.340625 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:22:57.340580    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:02.341032 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:02.340993    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:07.340709 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:07.340664    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:09.367299 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.367275    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:23:09.450650 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.450610    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2621a172-058f-462e-b09b-8d3979246515-openshift-service-ca-bundle\") pod \"2621a172-058f-462e-b09b-8d3979246515\" (UID: \"2621a172-058f-462e-b09b-8d3979246515\") "
Sep 09 20:23:09.450820 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.450671    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2621a172-058f-462e-b09b-8d3979246515-proxy-tls\") pod \"2621a172-058f-462e-b09b-8d3979246515\" (UID: \"2621a172-058f-462e-b09b-8d3979246515\") "
Sep 09 20:23:09.451035 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.451009    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2621a172-058f-462e-b09b-8d3979246515-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "2621a172-058f-462e-b09b-8d3979246515" (UID: "2621a172-058f-462e-b09b-8d3979246515"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:23:09.452824 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.452804    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2621a172-058f-462e-b09b-8d3979246515-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2621a172-058f-462e-b09b-8d3979246515" (UID: "2621a172-058f-462e-b09b-8d3979246515"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:23:09.552244 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.552216    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2621a172-058f-462e-b09b-8d3979246515-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:23:09.552244 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.552247    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2621a172-058f-462e-b09b-8d3979246515-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:23:09.716989 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.716948    2577 generic.go:356] "Generic (PLEG): container finished" podID="2621a172-058f-462e-b09b-8d3979246515" containerID="29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612" exitCode=0
Sep 09 20:23:09.717156 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.716996    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"
Sep 09 20:23:09.717156 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.717036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" event={"ID":"2621a172-058f-462e-b09b-8d3979246515","Type":"ContainerDied","Data":"29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612"}
Sep 09 20:23:09.717156 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.717091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh" event={"ID":"2621a172-058f-462e-b09b-8d3979246515","Type":"ContainerDied","Data":"a0d9f90571a13bc6ef4f5e98d9c5c6ec9102764fc8a8cdd1a7061de474ceefb5"}
Sep 09 20:23:09.717156 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.717113    2577 scope.go:117] "RemoveContainer" containerID="29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612"
Sep 09 20:23:09.726062 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.726045    2577 scope.go:117] "RemoveContainer" containerID="29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612"
Sep 09 20:23:09.726299 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:23:09.726274    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612\": container with ID starting with 29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612 not found: ID does not exist" containerID="29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612"
Sep 09 20:23:09.726362 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.726306    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612"} err="failed to get container status \"29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612\": rpc error: code = NotFound desc = could not find container \"29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612\": container with ID starting with 29dd68800d432a614c270f7f9fb1ef37207df75c39ee62fc3c55b33c517dd612 not found: ID does not exist"
Sep 09 20:23:09.736606 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.736585    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"]
Sep 09 20:23:09.740854 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:09.740836    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-d2727-58876698f6-whzzh"]
Sep 09 20:23:10.446823 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:10.446791    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2621a172-058f-462e-b09b-8d3979246515" path="/var/lib/kubelet/pods/2621a172-058f-462e-b09b-8d3979246515/volumes"
Sep 09 20:23:25.135608 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:25.135522    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"]
Sep 09 20:23:25.136094 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:25.135725    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942" containerID="cri-o://a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933" gracePeriod=30
Sep 09 20:23:25.153866 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:25.153826    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:25.267605 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:25.267576    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:25.363548 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:25.363513    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:25.439612 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:25.439513    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:25.534666 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:25.534626    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:25.703998 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:25.703900    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:27.554113 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:27.554071    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:32.554625 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:32.554587    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:37.554450 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:37.554410    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:37.554903 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:37.554546    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:23:39.451289 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.451257    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"]
Sep 09 20:23:39.451714 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.451632    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727"
Sep 09 20:23:39.451714 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.451648    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727"
Sep 09 20:23:39.451797 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.451738    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2621a172-058f-462e-b09b-8d3979246515" containerName="switch-graph-d2727"
Sep 09 20:23:39.454690 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.454670    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:39.456851 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.456825    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-e029b-kube-rbac-proxy-sar-config\""
Sep 09 20:23:39.456949 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.456829    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-e029b-serving-cert\""
Sep 09 20:23:39.462264 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.462244    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"]
Sep 09 20:23:39.465654 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.465633    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:39.501706 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.501684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a919057a-febe-419d-959f-7cfbd3cf3300-proxy-tls\") pod \"ensemble-graph-e029b-9b5f5b85c-wng4z\" (UID: \"a919057a-febe-419d-959f-7cfbd3cf3300\") " pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:39.501821 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.501794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a919057a-febe-419d-959f-7cfbd3cf3300-openshift-service-ca-bundle\") pod \"ensemble-graph-e029b-9b5f5b85c-wng4z\" (UID: \"a919057a-febe-419d-959f-7cfbd3cf3300\") " pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:39.602800 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.602770    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a919057a-febe-419d-959f-7cfbd3cf3300-proxy-tls\") pod \"ensemble-graph-e029b-9b5f5b85c-wng4z\" (UID: \"a919057a-febe-419d-959f-7cfbd3cf3300\") " pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:39.602961 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.602838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a919057a-febe-419d-959f-7cfbd3cf3300-openshift-service-ca-bundle\") pod \"ensemble-graph-e029b-9b5f5b85c-wng4z\" (UID: \"a919057a-febe-419d-959f-7cfbd3cf3300\") " pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:39.602961 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:23:39.602909    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-e029b-serving-cert: secret "ensemble-graph-e029b-serving-cert" not found
Sep 09 20:23:39.603085 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:23:39.602980    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a919057a-febe-419d-959f-7cfbd3cf3300-proxy-tls podName:a919057a-febe-419d-959f-7cfbd3cf3300 nodeName:}" failed. No retries permitted until 2026-09-09 20:23:40.102964371 +0000 UTC m=+1718.153109432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a919057a-febe-419d-959f-7cfbd3cf3300-proxy-tls") pod "ensemble-graph-e029b-9b5f5b85c-wng4z" (UID: "a919057a-febe-419d-959f-7cfbd3cf3300") : secret "ensemble-graph-e029b-serving-cert" not found
Sep 09 20:23:39.603458 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.603435    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a919057a-febe-419d-959f-7cfbd3cf3300-openshift-service-ca-bundle\") pod \"ensemble-graph-e029b-9b5f5b85c-wng4z\" (UID: \"a919057a-febe-419d-959f-7cfbd3cf3300\") " pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:39.873635 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:39.873595    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:40.105398 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:40.105366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a919057a-febe-419d-959f-7cfbd3cf3300-proxy-tls\") pod \"ensemble-graph-e029b-9b5f5b85c-wng4z\" (UID: \"a919057a-febe-419d-959f-7cfbd3cf3300\") " pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:40.107875 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:40.107854    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a919057a-febe-419d-959f-7cfbd3cf3300-proxy-tls\") pod \"ensemble-graph-e029b-9b5f5b85c-wng4z\" (UID: \"a919057a-febe-419d-959f-7cfbd3cf3300\") " pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:40.365864 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:40.365825    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:40.636643 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:40.636622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"]
Sep 09 20:23:40.639224 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:23:40.639199    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda919057a_febe_419d_959f_7cfbd3cf3300.slice/crio-5d11291a7aca6b5082e51b18b8c8160899f495a577cbbaf99f3769e076a3cb39 WatchSource:0}: Error finding container 5d11291a7aca6b5082e51b18b8c8160899f495a577cbbaf99f3769e076a3cb39: Status 404 returned error can't find the container with id 5d11291a7aca6b5082e51b18b8c8160899f495a577cbbaf99f3769e076a3cb39
Sep 09 20:23:40.864440 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:40.864407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" event={"ID":"a919057a-febe-419d-959f-7cfbd3cf3300","Type":"ContainerStarted","Data":"55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86"}
Sep 09 20:23:40.864629 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:40.864460    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" event={"ID":"a919057a-febe-419d-959f-7cfbd3cf3300","Type":"ContainerStarted","Data":"5d11291a7aca6b5082e51b18b8c8160899f495a577cbbaf99f3769e076a3cb39"}
Sep 09 20:23:40.864629 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:40.864519    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:40.880559 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:40.880491    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" podStartSLOduration=1.880456706 podStartE2EDuration="1.880456706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:23:40.879442061 +0000 UTC m=+1718.929587146" watchObservedRunningTime="2026-09-09 20:23:40.880456706 +0000 UTC m=+1718.930601788"
Sep 09 20:23:42.553558 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:42.553522    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:46.875973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:46.875941    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:23:47.554565 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:47.554532    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:49.519189 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:49.519096    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"]
Sep 09 20:23:49.519586 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:49.519312    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b" containerID="cri-o://55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86" gracePeriod=30
Sep 09 20:23:49.538056 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:49.538016    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:49.636936 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:49.636906    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:49.703004 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:49.702977    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:49.775676 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:49.775593    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:49.836712 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:49.836672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:49.935859 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:49.935818    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:50.357356 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:50.357324    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:23:51.874635 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:51.874602    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:52.553700 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:52.553658    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:23:55.294999 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.294973    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:23:55.344779 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.344746    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-openshift-service-ca-bundle\") pod \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\" (UID: \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\") "
Sep 09 20:23:55.344935 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.344791    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-proxy-tls\") pod \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\" (UID: \"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5\") "
Sep 09 20:23:55.345096 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.345074    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" (UID: "89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:23:55.347090 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.347068    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" (UID: "89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:23:55.445705 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.445635    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:23:55.445705 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.445660    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:23:55.936886 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.936856    2577 generic.go:356] "Generic (PLEG): container finished" podID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerID="a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933" exitCode=0
Sep 09 20:23:55.937054 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.936901    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" event={"ID":"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5","Type":"ContainerDied","Data":"a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933"}
Sep 09 20:23:55.937054 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.936903    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"
Sep 09 20:23:55.937054 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.936942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh" event={"ID":"89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5","Type":"ContainerDied","Data":"a6172e494703755cea647b7ca39c7d25963571e42ee12c7a42c31cc46c0f34b5"}
Sep 09 20:23:55.937054 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.936965    2577 scope.go:117] "RemoveContainer" containerID="a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933"
Sep 09 20:23:55.946220 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.946205    2577 scope.go:117] "RemoveContainer" containerID="a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933"
Sep 09 20:23:55.946483 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:23:55.946452    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933\": container with ID starting with a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933 not found: ID does not exist" containerID="a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933"
Sep 09 20:23:55.946536 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.946498    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933"} err="failed to get container status \"a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933\": rpc error: code = NotFound desc = could not find container \"a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933\": container with ID starting with a5fdb8517295e9852eb183418d922f8accefccaa2492f1ffe9231942edcb4933 not found: ID does not exist"
Sep 09 20:23:55.956615 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.956591    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"]
Sep 09 20:23:55.959179 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:55.959159    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2e942-79888d85c-7dbmh"]
Sep 09 20:23:56.446451 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:56.446418    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" path="/var/lib/kubelet/pods/89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5/volumes"
Sep 09 20:23:56.874012 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:23:56.873978    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:24:01.874763 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:01.874727    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:24:01.875169 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:01.874836    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:24:06.874190 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:06.874154    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:24:11.873973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:11.873930    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:24:16.874440 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:16.874404    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:24:19.666396 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:19.666367    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:24:19.752048 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:19.752021    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a919057a-febe-419d-959f-7cfbd3cf3300-proxy-tls\") pod \"a919057a-febe-419d-959f-7cfbd3cf3300\" (UID: \"a919057a-febe-419d-959f-7cfbd3cf3300\") "
Sep 09 20:24:19.752199 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:19.752067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a919057a-febe-419d-959f-7cfbd3cf3300-openshift-service-ca-bundle\") pod \"a919057a-febe-419d-959f-7cfbd3cf3300\" (UID: \"a919057a-febe-419d-959f-7cfbd3cf3300\") "
Sep 09 20:24:19.752445 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:19.752425    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a919057a-febe-419d-959f-7cfbd3cf3300-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a919057a-febe-419d-959f-7cfbd3cf3300" (UID: "a919057a-febe-419d-959f-7cfbd3cf3300"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:24:19.754245 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:19.754223    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a919057a-febe-419d-959f-7cfbd3cf3300-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a919057a-febe-419d-959f-7cfbd3cf3300" (UID: "a919057a-febe-419d-959f-7cfbd3cf3300"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:24:19.853142 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:19.853113    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a919057a-febe-419d-959f-7cfbd3cf3300-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:24:19.853142 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:19.853138    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a919057a-febe-419d-959f-7cfbd3cf3300-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:24:20.047215 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.047181    2577 generic.go:356] "Generic (PLEG): container finished" podID="a919057a-febe-419d-959f-7cfbd3cf3300" containerID="55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86" exitCode=0
Sep 09 20:24:20.047389 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.047229    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"
Sep 09 20:24:20.047389 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.047267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" event={"ID":"a919057a-febe-419d-959f-7cfbd3cf3300","Type":"ContainerDied","Data":"55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86"}
Sep 09 20:24:20.047389 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.047320    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z" event={"ID":"a919057a-febe-419d-959f-7cfbd3cf3300","Type":"ContainerDied","Data":"5d11291a7aca6b5082e51b18b8c8160899f495a577cbbaf99f3769e076a3cb39"}
Sep 09 20:24:20.047389 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.047341    2577 scope.go:117] "RemoveContainer" containerID="55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86"
Sep 09 20:24:20.056200 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.056184    2577 scope.go:117] "RemoveContainer" containerID="55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86"
Sep 09 20:24:20.056533 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:24:20.056455    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86\": container with ID starting with 55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86 not found: ID does not exist" containerID="55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86"
Sep 09 20:24:20.056601 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.056559    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86"} err="failed to get container status \"55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86\": rpc error: code = NotFound desc = could not find container \"55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86\": container with ID starting with 55679a9fdf425cdc9560326ad259b8e9bdff4aa102b2730818ad005e7ebe7c86 not found: ID does not exist"
Sep 09 20:24:20.068352 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.068326    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"]
Sep 09 20:24:20.071796 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.071777    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-e029b-9b5f5b85c-wng4z"]
Sep 09 20:24:20.447433 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:20.447399    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" path="/var/lib/kubelet/pods/a919057a-febe-419d-959f-7cfbd3cf3300/volumes"
Sep 09 20:24:35.366997 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.366964    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"]
Sep 09 20:24:35.367516 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.367498    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942"
Sep 09 20:24:35.367607 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.367518    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942"
Sep 09 20:24:35.367607 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.367545    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b"
Sep 09 20:24:35.367607 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.367554    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b"
Sep 09 20:24:35.367764 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.367667    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a919057a-febe-419d-959f-7cfbd3cf3300" containerName="ensemble-graph-e029b"
Sep 09 20:24:35.367764 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.367681    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="89bf329d-d8fc-4bb2-a3ea-11e7f36fe4e5" containerName="sequence-graph-2e942"
Sep 09 20:24:35.370708 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.370689    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:35.372845 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.372789    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-bf2e8-serving-cert\""
Sep 09 20:24:35.372845 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.372809    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-w6n8h\""
Sep 09 20:24:35.373346 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.373329    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 09 20:24:35.373346 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.373339    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-bf2e8-kube-rbac-proxy-sar-config\""
Sep 09 20:24:35.379891 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.379870    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"]
Sep 09 20:24:35.389378 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.389359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/684209fa-f5ff-47ee-a7a8-179627d5270f-proxy-tls\") pod \"sequence-graph-bf2e8-8fd9dd46d-kxhdn\" (UID: \"684209fa-f5ff-47ee-a7a8-179627d5270f\") " pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:35.389495 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.389406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684209fa-f5ff-47ee-a7a8-179627d5270f-openshift-service-ca-bundle\") pod \"sequence-graph-bf2e8-8fd9dd46d-kxhdn\" (UID: \"684209fa-f5ff-47ee-a7a8-179627d5270f\") " pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:35.398002 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.397976    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:35.489838 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.489797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684209fa-f5ff-47ee-a7a8-179627d5270f-openshift-service-ca-bundle\") pod \"sequence-graph-bf2e8-8fd9dd46d-kxhdn\" (UID: \"684209fa-f5ff-47ee-a7a8-179627d5270f\") " pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:35.490004 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.489883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/684209fa-f5ff-47ee-a7a8-179627d5270f-proxy-tls\") pod \"sequence-graph-bf2e8-8fd9dd46d-kxhdn\" (UID: \"684209fa-f5ff-47ee-a7a8-179627d5270f\") " pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:35.490004 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:24:35.489991    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-bf2e8-serving-cert: secret "sequence-graph-bf2e8-serving-cert" not found
Sep 09 20:24:35.490083 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:24:35.490056    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/684209fa-f5ff-47ee-a7a8-179627d5270f-proxy-tls podName:684209fa-f5ff-47ee-a7a8-179627d5270f nodeName:}" failed. No retries permitted until 2026-09-09 20:24:35.990041355 +0000 UTC m=+1774.040186416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/684209fa-f5ff-47ee-a7a8-179627d5270f-proxy-tls") pod "sequence-graph-bf2e8-8fd9dd46d-kxhdn" (UID: "684209fa-f5ff-47ee-a7a8-179627d5270f") : secret "sequence-graph-bf2e8-serving-cert" not found
Sep 09 20:24:35.490516 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.490462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684209fa-f5ff-47ee-a7a8-179627d5270f-openshift-service-ca-bundle\") pod \"sequence-graph-bf2e8-8fd9dd46d-kxhdn\" (UID: \"684209fa-f5ff-47ee-a7a8-179627d5270f\") " pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:35.605440 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.605374    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:35.994056 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.994007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/684209fa-f5ff-47ee-a7a8-179627d5270f-proxy-tls\") pod \"sequence-graph-bf2e8-8fd9dd46d-kxhdn\" (UID: \"684209fa-f5ff-47ee-a7a8-179627d5270f\") " pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:35.996700 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:35.996669    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/684209fa-f5ff-47ee-a7a8-179627d5270f-proxy-tls\") pod \"sequence-graph-bf2e8-8fd9dd46d-kxhdn\" (UID: \"684209fa-f5ff-47ee-a7a8-179627d5270f\") " pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:36.281854 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:36.281760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:36.557924 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:36.557901    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"]
Sep 09 20:24:37.125934 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:37.125897    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" event={"ID":"684209fa-f5ff-47ee-a7a8-179627d5270f","Type":"ContainerStarted","Data":"143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2"}
Sep 09 20:24:37.126148 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:37.126002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:37.126148 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:37.126027    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" event={"ID":"684209fa-f5ff-47ee-a7a8-179627d5270f","Type":"ContainerStarted","Data":"1bb890fd7e9cdf0359ab738652bcec2482a62474862e1d0f17cb0a53c8afbd06"}
Sep 09 20:24:37.143023 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:37.142979    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" podStartSLOduration=2.142965412 podStartE2EDuration="2.142965412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:24:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:24:37.141359959 +0000 UTC m=+1775.191505045" watchObservedRunningTime="2026-09-09 20:24:37.142965412 +0000 UTC m=+1775.193110505"
Sep 09 20:24:43.136324 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:43.136297    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:24:45.421443 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:45.421407    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"]
Sep 09 20:24:45.421900 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:45.421676    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8" containerID="cri-o://143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2" gracePeriod=30
Sep 09 20:24:45.444838 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:45.444808    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:45.551717 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:45.551680    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:45.614058 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:45.614025    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:45.686680 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:45.686602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:45.750561 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:45.750524    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:45.809722 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:45.809692    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:45.872024 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:45.871993    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:48.134661 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:48.134626    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:24:49.729097 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.729062    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"]
Sep 09 20:24:49.732643 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.732590    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:49.732859 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.732842    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:49.734967 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.734944    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-3c295-kube-rbac-proxy-sar-config\""
Sep 09 20:24:49.735087 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.734951    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-3c295-serving-cert\""
Sep 09 20:24:49.742122 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.742095    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"]
Sep 09 20:24:49.805434 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.805401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44e1e169-dfc2-490f-acb5-e37909e1b08f-proxy-tls\") pod \"ensemble-graph-3c295-5b8f7d666d-97k6q\" (UID: \"44e1e169-dfc2-490f-acb5-e37909e1b08f\") " pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:49.805632 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.805613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e1e169-dfc2-490f-acb5-e37909e1b08f-openshift-service-ca-bundle\") pod \"ensemble-graph-3c295-5b8f7d666d-97k6q\" (UID: \"44e1e169-dfc2-490f-acb5-e37909e1b08f\") " pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:49.878908 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.878878    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:24:49.906622 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.906596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e1e169-dfc2-490f-acb5-e37909e1b08f-openshift-service-ca-bundle\") pod \"ensemble-graph-3c295-5b8f7d666d-97k6q\" (UID: \"44e1e169-dfc2-490f-acb5-e37909e1b08f\") " pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:49.906757 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.906630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44e1e169-dfc2-490f-acb5-e37909e1b08f-proxy-tls\") pod \"ensemble-graph-3c295-5b8f7d666d-97k6q\" (UID: \"44e1e169-dfc2-490f-acb5-e37909e1b08f\") " pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:49.907226 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.907196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e1e169-dfc2-490f-acb5-e37909e1b08f-openshift-service-ca-bundle\") pod \"ensemble-graph-3c295-5b8f7d666d-97k6q\" (UID: \"44e1e169-dfc2-490f-acb5-e37909e1b08f\") " pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:49.909357 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:49.909329    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44e1e169-dfc2-490f-acb5-e37909e1b08f-proxy-tls\") pod \"ensemble-graph-3c295-5b8f7d666d-97k6q\" (UID: \"44e1e169-dfc2-490f-acb5-e37909e1b08f\") " pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:50.044077 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:50.044050    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:50.314113 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:50.314041    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"]
Sep 09 20:24:50.317249 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:24:50.317219    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e1e169_dfc2_490f_acb5_e37909e1b08f.slice/crio-fa38dee57ff737d12430ea253fa3a450f62ba95e65192bad87e8ef7752d2875f WatchSource:0}: Error finding container fa38dee57ff737d12430ea253fa3a450f62ba95e65192bad87e8ef7752d2875f: Status 404 returned error can't find the container with id fa38dee57ff737d12430ea253fa3a450f62ba95e65192bad87e8ef7752d2875f
Sep 09 20:24:51.191873 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:51.191835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" event={"ID":"44e1e169-dfc2-490f-acb5-e37909e1b08f","Type":"ContainerStarted","Data":"abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b"}
Sep 09 20:24:51.192288 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:51.191917    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" event={"ID":"44e1e169-dfc2-490f-acb5-e37909e1b08f","Type":"ContainerStarted","Data":"fa38dee57ff737d12430ea253fa3a450f62ba95e65192bad87e8ef7752d2875f"}
Sep 09 20:24:51.192288 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:51.192028    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:51.208065 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:51.208024    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" podStartSLOduration=2.208012868 podStartE2EDuration="2.208012868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:24:51.2074393 +0000 UTC m=+1789.257584385" watchObservedRunningTime="2026-09-09 20:24:51.208012868 +0000 UTC m=+1789.258157951"
Sep 09 20:24:53.134703 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:53.134669    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:24:57.203023 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:57.202996    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:24:58.134935 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:58.134891    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:24:58.135129 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:24:58.134993    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:25:02.521662 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:02.521632    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:25:02.526369 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:02.526346    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:25:03.135233 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:03.135195    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:25:08.134566 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:08.134526    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:25:13.134989 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:13.134945    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:25:15.582451 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:15.582428    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:25:15.738126 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:15.738031    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684209fa-f5ff-47ee-a7a8-179627d5270f-openshift-service-ca-bundle\") pod \"684209fa-f5ff-47ee-a7a8-179627d5270f\" (UID: \"684209fa-f5ff-47ee-a7a8-179627d5270f\") "
Sep 09 20:25:15.738126 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:15.738092    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/684209fa-f5ff-47ee-a7a8-179627d5270f-proxy-tls\") pod \"684209fa-f5ff-47ee-a7a8-179627d5270f\" (UID: \"684209fa-f5ff-47ee-a7a8-179627d5270f\") "
Sep 09 20:25:15.738492 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:15.738447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/684209fa-f5ff-47ee-a7a8-179627d5270f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "684209fa-f5ff-47ee-a7a8-179627d5270f" (UID: "684209fa-f5ff-47ee-a7a8-179627d5270f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:25:15.740310 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:15.740292    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/684209fa-f5ff-47ee-a7a8-179627d5270f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "684209fa-f5ff-47ee-a7a8-179627d5270f" (UID: "684209fa-f5ff-47ee-a7a8-179627d5270f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:25:15.839211 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:15.839163    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684209fa-f5ff-47ee-a7a8-179627d5270f-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:25:15.839211 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:15.839206    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/684209fa-f5ff-47ee-a7a8-179627d5270f-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:25:16.318772 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.318733    2577 generic.go:356] "Generic (PLEG): container finished" podID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerID="143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2" exitCode=0
Sep 09 20:25:16.318772 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.318771    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"
Sep 09 20:25:16.318980 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.318775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" event={"ID":"684209fa-f5ff-47ee-a7a8-179627d5270f","Type":"ContainerDied","Data":"143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2"}
Sep 09 20:25:16.318980 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.318902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn" event={"ID":"684209fa-f5ff-47ee-a7a8-179627d5270f","Type":"ContainerDied","Data":"1bb890fd7e9cdf0359ab738652bcec2482a62474862e1d0f17cb0a53c8afbd06"}
Sep 09 20:25:16.318980 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.318930    2577 scope.go:117] "RemoveContainer" containerID="143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2"
Sep 09 20:25:16.327641 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.327623    2577 scope.go:117] "RemoveContainer" containerID="143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2"
Sep 09 20:25:16.327919 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:25:16.327900    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2\": container with ID starting with 143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2 not found: ID does not exist" containerID="143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2"
Sep 09 20:25:16.327965 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.327928    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2"} err="failed to get container status \"143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2\": rpc error: code = NotFound desc = could not find container \"143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2\": container with ID starting with 143e913fe93ca85a69efa8a983910a084ff551b7e756f11e79e66723232080d2 not found: ID does not exist"
Sep 09 20:25:16.340484 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.340447    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"]
Sep 09 20:25:16.344224 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.344203    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-bf2e8-8fd9dd46d-kxhdn"]
Sep 09 20:25:16.447163 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:16.447122    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" path="/var/lib/kubelet/pods/684209fa-f5ff-47ee-a7a8-179627d5270f/volumes"
Sep 09 20:25:45.684573 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.684542    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"]
Sep 09 20:25:45.684963 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.684927    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8"
Sep 09 20:25:45.684963 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.684939    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8"
Sep 09 20:25:45.685036 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.685015    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="684209fa-f5ff-47ee-a7a8-179627d5270f" containerName="sequence-graph-bf2e8"
Sep 09 20:25:45.688044 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.688029    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:45.690689 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.690655    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-3a010-serving-cert\""
Sep 09 20:25:45.690845 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.690709    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-3a010-kube-rbac-proxy-sar-config\""
Sep 09 20:25:45.691405 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.691384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:25:45.701423 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.701401    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"]
Sep 09 20:25:45.783283 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.783248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-proxy-tls\") pod \"sequence-graph-3a010-6655d97697-qtltd\" (UID: \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\") " pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:45.783447 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.783301    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-openshift-service-ca-bundle\") pod \"sequence-graph-3a010-6655d97697-qtltd\" (UID: \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\") " pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:45.884534 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.884498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-proxy-tls\") pod \"sequence-graph-3a010-6655d97697-qtltd\" (UID: \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\") " pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:45.884706 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.884559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-openshift-service-ca-bundle\") pod \"sequence-graph-3a010-6655d97697-qtltd\" (UID: \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\") " pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:45.884706 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:25:45.884641    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-3a010-serving-cert: secret "sequence-graph-3a010-serving-cert" not found
Sep 09 20:25:45.884706 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:25:45.884701    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-proxy-tls podName:7467bb4f-cc6c-46cf-aba6-ce41cfe86614 nodeName:}" failed. No retries permitted until 2026-09-09 20:25:46.384685938 +0000 UTC m=+1844.434830999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-proxy-tls") pod "sequence-graph-3a010-6655d97697-qtltd" (UID: "7467bb4f-cc6c-46cf-aba6-ce41cfe86614") : secret "sequence-graph-3a010-serving-cert" not found
Sep 09 20:25:45.885183 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:45.885163    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-openshift-service-ca-bundle\") pod \"sequence-graph-3a010-6655d97697-qtltd\" (UID: \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\") " pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:46.139001 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:46.138964    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:25:46.393203 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:46.393122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-proxy-tls\") pod \"sequence-graph-3a010-6655d97697-qtltd\" (UID: \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\") " pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:46.395741 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:46.395719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-proxy-tls\") pod \"sequence-graph-3a010-6655d97697-qtltd\" (UID: \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\") " pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:46.598732 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:46.598698    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:46.873345 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:46.873315    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"]
Sep 09 20:25:46.876712 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:25:46.876686    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7467bb4f_cc6c_46cf_aba6_ce41cfe86614.slice/crio-36df5b3dfea5f69963853db1d4befefe6a47065b0d615f7100af33ef760fe0fd WatchSource:0}: Error finding container 36df5b3dfea5f69963853db1d4befefe6a47065b0d615f7100af33ef760fe0fd: Status 404 returned error can't find the container with id 36df5b3dfea5f69963853db1d4befefe6a47065b0d615f7100af33ef760fe0fd
Sep 09 20:25:47.463671 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:47.463635    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" event={"ID":"7467bb4f-cc6c-46cf-aba6-ce41cfe86614","Type":"ContainerStarted","Data":"b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad"}
Sep 09 20:25:47.463872 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:47.463694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" event={"ID":"7467bb4f-cc6c-46cf-aba6-ce41cfe86614","Type":"ContainerStarted","Data":"36df5b3dfea5f69963853db1d4befefe6a47065b0d615f7100af33ef760fe0fd"}
Sep 09 20:25:47.463872 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:47.463723    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:53.473795 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:53.473762    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:25:53.494690 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:25:53.494627    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" podStartSLOduration=8.494607099 podStartE2EDuration="8.494607099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:25:47.486715345 +0000 UTC m=+1845.536860551" watchObservedRunningTime="2026-09-09 20:25:53.494607099 +0000 UTC m=+1851.544752179"
Sep 09 20:26:36.317748 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:26:36.317620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:27:06.049719 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:27:06.049636    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:28:09.091550 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:28:09.091247    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:28:20.734276 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:28:20.734242    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:29:43.528934 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:29:43.528862    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:29:43.586168 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:29:43.586133    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:30:02.552247 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:30:02.552218    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:30:02.558296 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:30:02.558277    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:31:09.189773 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:31:09.189697    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:33:04.356509 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:04.356454    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"]
Sep 09 20:33:04.358969 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:04.356701    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295" containerID="cri-o://abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b" gracePeriod=30
Sep 09 20:33:04.399324 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:04.399285    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:33:04.509345 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:04.509309    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:33:04.618718 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:04.618621    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:33:04.688690 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:04.688654    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:33:04.756593 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:04.756556    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:33:04.816050 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:04.816018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:33:07.201437 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:07.201393    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:33:12.201089 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:12.201047    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:33:17.200687 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:17.200643    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:33:17.201130 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:17.200744    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:33:22.200745 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:22.200707    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:33:27.201207 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:27.201164    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:33:32.200262 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:32.200228    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:33:34.500315 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.500285    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:33:34.569139 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.569111    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e1e169-dfc2-490f-acb5-e37909e1b08f-openshift-service-ca-bundle\") pod \"44e1e169-dfc2-490f-acb5-e37909e1b08f\" (UID: \"44e1e169-dfc2-490f-acb5-e37909e1b08f\") "
Sep 09 20:33:34.569300 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.569162    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44e1e169-dfc2-490f-acb5-e37909e1b08f-proxy-tls\") pod \"44e1e169-dfc2-490f-acb5-e37909e1b08f\" (UID: \"44e1e169-dfc2-490f-acb5-e37909e1b08f\") "
Sep 09 20:33:34.569527 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.569498    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44e1e169-dfc2-490f-acb5-e37909e1b08f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "44e1e169-dfc2-490f-acb5-e37909e1b08f" (UID: "44e1e169-dfc2-490f-acb5-e37909e1b08f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:33:34.571353 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.571332    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44e1e169-dfc2-490f-acb5-e37909e1b08f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "44e1e169-dfc2-490f-acb5-e37909e1b08f" (UID: "44e1e169-dfc2-490f-acb5-e37909e1b08f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:33:34.632445 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.632355    2577 generic.go:356] "Generic (PLEG): container finished" podID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerID="abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b" exitCode=0
Sep 09 20:33:34.632445 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.632399    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"
Sep 09 20:33:34.632699 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.632440    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" event={"ID":"44e1e169-dfc2-490f-acb5-e37909e1b08f","Type":"ContainerDied","Data":"abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b"}
Sep 09 20:33:34.632699 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.632516    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q" event={"ID":"44e1e169-dfc2-490f-acb5-e37909e1b08f","Type":"ContainerDied","Data":"fa38dee57ff737d12430ea253fa3a450f62ba95e65192bad87e8ef7752d2875f"}
Sep 09 20:33:34.632699 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.632546    2577 scope.go:117] "RemoveContainer" containerID="abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b"
Sep 09 20:33:34.641551 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.641535    2577 scope.go:117] "RemoveContainer" containerID="abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b"
Sep 09 20:33:34.641822 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:33:34.641803    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b\": container with ID starting with abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b not found: ID does not exist" containerID="abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b"
Sep 09 20:33:34.641862 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.641832    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b"} err="failed to get container status \"abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b\": rpc error: code = NotFound desc = could not find container \"abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b\": container with ID starting with abdf7f2d5f826e4aea84a5399196371a58dce3dbd3d3aa36717c3207efb0b29b not found: ID does not exist"
Sep 09 20:33:34.651094 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.651073    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"]
Sep 09 20:33:34.654627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.654609    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-3c295-5b8f7d666d-97k6q"]
Sep 09 20:33:34.670255 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.670235    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e1e169-dfc2-490f-acb5-e37909e1b08f-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:33:34.670313 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:34.670254    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44e1e169-dfc2-490f-acb5-e37909e1b08f-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:33:36.446539 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:33:36.446503    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" path="/var/lib/kubelet/pods/44e1e169-dfc2-490f-acb5-e37909e1b08f/volumes"
Sep 09 20:34:00.291184 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:00.291110    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"]
Sep 09 20:34:00.291572 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:00.291317    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010" containerID="cri-o://b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad" gracePeriod=30
Sep 09 20:34:00.314232 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:00.314206    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:02.436927 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:02.436880    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:03.471491 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:03.471434    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:04.603820 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.603786    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"]
Sep 09 20:34:04.604204 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.604138    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295"
Sep 09 20:34:04.604204 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.604149    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295"
Sep 09 20:34:04.604281 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.604225    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="44e1e169-dfc2-490f-acb5-e37909e1b08f" containerName="ensemble-graph-3c295"
Sep 09 20:34:04.608084 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.608064    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:04.609835 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.609811    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-97f7b-kube-rbac-proxy-sar-config\""
Sep 09 20:34:04.609945 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.609852    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-97f7b-serving-cert\""
Sep 09 20:34:04.617283 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.617260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"]
Sep 09 20:34:04.642588 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.642561    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:04.730985 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.730946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-openshift-service-ca-bundle\") pod \"splitter-graph-97f7b-77f98465f9-tzcgp\" (UID: \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\") " pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:04.731159 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.731027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-proxy-tls\") pod \"splitter-graph-97f7b-77f98465f9-tzcgp\" (UID: \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\") " pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:04.832516 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.832488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-proxy-tls\") pod \"splitter-graph-97f7b-77f98465f9-tzcgp\" (UID: \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\") " pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:04.832699 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.832564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-openshift-service-ca-bundle\") pod \"splitter-graph-97f7b-77f98465f9-tzcgp\" (UID: \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\") " pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:04.833192 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.833173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-openshift-service-ca-bundle\") pod \"splitter-graph-97f7b-77f98465f9-tzcgp\" (UID: \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\") " pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:04.835050 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.835032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-proxy-tls\") pod \"splitter-graph-97f7b-77f98465f9-tzcgp\" (UID: \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\") " pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:04.855994 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.855917    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:04.919450 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:04.919422    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:05.194790 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:05.192296    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"]
Sep 09 20:34:05.196599 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:34:05.196568    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eabfcaf_1d1c_49b5_ae38_fa1e78e216fe.slice/crio-1f011ec9d9b2ff54f9a3d053db9a265d80e183d90339d819f9b985bb8498a55c WatchSource:0}: Error finding container 1f011ec9d9b2ff54f9a3d053db9a265d80e183d90339d819f9b985bb8498a55c: Status 404 returned error can't find the container with id 1f011ec9d9b2ff54f9a3d053db9a265d80e183d90339d819f9b985bb8498a55c
Sep 09 20:34:05.779087 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:05.779051    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" event={"ID":"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe","Type":"ContainerStarted","Data":"ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85"}
Sep 09 20:34:05.779456 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:05.779102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" event={"ID":"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe","Type":"ContainerStarted","Data":"1f011ec9d9b2ff54f9a3d053db9a265d80e183d90339d819f9b985bb8498a55c"}
Sep 09 20:34:05.779456 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:05.779155    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:05.795517 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:05.795447    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" podStartSLOduration=1.795433451 podStartE2EDuration="1.795433451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:34:05.794204842 +0000 UTC m=+2343.844349924" watchObservedRunningTime="2026-09-09 20:34:05.795433451 +0000 UTC m=+2343.845578566"
Sep 09 20:34:08.471804 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:08.471762    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:11.789432 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:11.789401    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:13.471883 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:13.471844    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:13.472261 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:13.471941    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:34:14.687062 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:14.686986    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"]
Sep 09 20:34:14.687457 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:14.687235    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b" containerID="cri-o://ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85" gracePeriod=30
Sep 09 20:34:14.709700 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:14.709666    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:14.832986 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:14.832947    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:14.929582 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:14.929545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:15.030526 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:15.030444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:15.129588 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:15.129552    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:15.229487 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:15.229433    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:15.414615 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:15.414583    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:16.788308 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:16.788272    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:18.471709 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:18.471666    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:21.787670 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:21.787633    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:23.471817 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:23.471771    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:26.788229 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:26.788184    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:26.788653 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:26.788305    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:28.472357 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:28.472320    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:30.441812 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.441787    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:34:30.537201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.537167    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-proxy-tls\") pod \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\" (UID: \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\") "
Sep 09 20:34:30.537364 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.537245    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-openshift-service-ca-bundle\") pod \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\" (UID: \"7467bb4f-cc6c-46cf-aba6-ce41cfe86614\") "
Sep 09 20:34:30.537683 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.537652    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "7467bb4f-cc6c-46cf-aba6-ce41cfe86614" (UID: "7467bb4f-cc6c-46cf-aba6-ce41cfe86614"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:34:30.539540 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.539522    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7467bb4f-cc6c-46cf-aba6-ce41cfe86614" (UID: "7467bb4f-cc6c-46cf-aba6-ce41cfe86614"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:34:30.638914 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.638845    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:34:30.638914 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.638869    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7467bb4f-cc6c-46cf-aba6-ce41cfe86614-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:34:30.892579 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.892489    2577 generic.go:356] "Generic (PLEG): container finished" podID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerID="b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad" exitCode=0
Sep 09 20:34:30.892579 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.892504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" event={"ID":"7467bb4f-cc6c-46cf-aba6-ce41cfe86614","Type":"ContainerDied","Data":"b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad"}
Sep 09 20:34:30.892579 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.892566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd" event={"ID":"7467bb4f-cc6c-46cf-aba6-ce41cfe86614","Type":"ContainerDied","Data":"36df5b3dfea5f69963853db1d4befefe6a47065b0d615f7100af33ef760fe0fd"}
Sep 09 20:34:30.892822 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.892589    2577 scope.go:117] "RemoveContainer" containerID="b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad"
Sep 09 20:34:30.892822 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.892519    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"
Sep 09 20:34:30.901847 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.901833    2577 scope.go:117] "RemoveContainer" containerID="b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad"
Sep 09 20:34:30.902130 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:34:30.902110    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad\": container with ID starting with b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad not found: ID does not exist" containerID="b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad"
Sep 09 20:34:30.902182 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.902139    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad"} err="failed to get container status \"b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad\": rpc error: code = NotFound desc = could not find container \"b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad\": container with ID starting with b2e91913078d43b207f893c42f7a8d81016aabd1efb31d611adcf35703ce4cad not found: ID does not exist"
Sep 09 20:34:30.913091 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.913063    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"]
Sep 09 20:34:30.916525 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:30.916507    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-3a010-6655d97697-qtltd"]
Sep 09 20:34:31.788549 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:31.788508    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:32.446130 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:32.446094    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" path="/var/lib/kubelet/pods/7467bb4f-cc6c-46cf-aba6-ce41cfe86614/volumes"
Sep 09 20:34:36.787623 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:36.787581    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:41.788422 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:41.788377    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:34:43.504193 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:43.504157    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:34:44.840645 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.840617    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:44.952402 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.952327    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-proxy-tls\") pod \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\" (UID: \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\") "
Sep 09 20:34:44.952402 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.952363    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-openshift-service-ca-bundle\") pod \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\" (UID: \"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe\") "
Sep 09 20:34:44.952767 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.952738    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" (UID: "8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:34:44.954628 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.954598    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" (UID: "8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:34:44.956436 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.956414    2577 generic.go:356] "Generic (PLEG): container finished" podID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerID="ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85" exitCode=0
Sep 09 20:34:44.956540 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.956445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" event={"ID":"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe","Type":"ContainerDied","Data":"ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85"}
Sep 09 20:34:44.956540 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.956512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp" event={"ID":"8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe","Type":"ContainerDied","Data":"1f011ec9d9b2ff54f9a3d053db9a265d80e183d90339d819f9b985bb8498a55c"}
Sep 09 20:34:44.956540 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.956534    2577 scope.go:117] "RemoveContainer" containerID="ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85"
Sep 09 20:34:44.956658 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.956537    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"
Sep 09 20:34:44.966201 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.966175    2577 scope.go:117] "RemoveContainer" containerID="ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85"
Sep 09 20:34:44.966506 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:34:44.966486    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85\": container with ID starting with ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85 not found: ID does not exist" containerID="ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85"
Sep 09 20:34:44.966565 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.966514    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85"} err="failed to get container status \"ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85\": rpc error: code = NotFound desc = could not find container \"ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85\": container with ID starting with ab21f8b0269b6e0ac69323d2b9a1d2a615cbc77b0d690a520048aa35b6812d85 not found: ID does not exist"
Sep 09 20:34:44.975901 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.975871    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"]
Sep 09 20:34:44.977650 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:44.977628    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-97f7b-77f98465f9-tzcgp"]
Sep 09 20:34:45.053593 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:45.053566    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:34:45.053593 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:45.053595    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:34:46.446627 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:34:46.446593    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" path="/var/lib/kubelet/pods/8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe/volumes"
Sep 09 20:35:02.586154 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:02.586118    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:35:02.594485 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:02.594445    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:35:10.556677 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.556643    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"]
Sep 09 20:35:10.557175 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.557153    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b"
Sep 09 20:35:10.557291 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.557180    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b"
Sep 09 20:35:10.557291 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.557218    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010"
Sep 09 20:35:10.557291 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.557229    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010"
Sep 09 20:35:10.557453 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.557322    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eabfcaf-1d1c-49b5-ae38-fa1e78e216fe" containerName="splitter-graph-97f7b"
Sep 09 20:35:10.557453 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.557338    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7467bb4f-cc6c-46cf-aba6-ce41cfe86614" containerName="sequence-graph-3a010"
Sep 09 20:35:10.560243 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.560222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:10.560515 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.560484    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:35:10.562622 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.562600    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 09 20:35:10.562622 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.562611    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-54686-serving-cert\""
Sep 09 20:35:10.562792 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.562662    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-54686-kube-rbac-proxy-sar-config\""
Sep 09 20:35:10.562792 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.562673    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-w6n8h\""
Sep 09 20:35:10.570485 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.570452    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"]
Sep 09 20:35:10.672308 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.672273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-openshift-service-ca-bundle\") pod \"switch-graph-54686-7694d64fcc-shqw2\" (UID: \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\") " pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:10.672497 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.672326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-proxy-tls\") pod \"switch-graph-54686-7694d64fcc-shqw2\" (UID: \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\") " pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:10.772863 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.772827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-openshift-service-ca-bundle\") pod \"switch-graph-54686-7694d64fcc-shqw2\" (UID: \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\") " pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:10.773025 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.772871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-proxy-tls\") pod \"switch-graph-54686-7694d64fcc-shqw2\" (UID: \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\") " pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:10.773067 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:35:10.773036    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-54686-serving-cert: secret "switch-graph-54686-serving-cert" not found
Sep 09 20:35:10.773103 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:35:10.773094    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-proxy-tls podName:0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f nodeName:}" failed. No retries permitted until 2026-09-09 20:35:11.273078253 +0000 UTC m=+2409.323223379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-proxy-tls") pod "switch-graph-54686-7694d64fcc-shqw2" (UID: "0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f") : secret "switch-graph-54686-serving-cert" not found
Sep 09 20:35:10.773435 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.773417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-openshift-service-ca-bundle\") pod \"switch-graph-54686-7694d64fcc-shqw2\" (UID: \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\") " pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:10.963609 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:10.963515    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:35:11.278207 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:11.278122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-proxy-tls\") pod \"switch-graph-54686-7694d64fcc-shqw2\" (UID: \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\") " pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:11.280677 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:11.280652    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-proxy-tls\") pod \"switch-graph-54686-7694d64fcc-shqw2\" (UID: \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\") " pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:11.471124 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:11.471081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:11.743717 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:11.743678    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"]
Sep 09 20:35:11.749144 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:35:11.749117    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa1113e_d6f2_45ae_8f69_4fefe0e5c09f.slice/crio-31d31fe96fcb540e8aa9a8327dac4dd670ba81a9d7c63f47ffb04ecb4042c99a WatchSource:0}: Error finding container 31d31fe96fcb540e8aa9a8327dac4dd670ba81a9d7c63f47ffb04ecb4042c99a: Status 404 returned error can't find the container with id 31d31fe96fcb540e8aa9a8327dac4dd670ba81a9d7c63f47ffb04ecb4042c99a
Sep 09 20:35:12.085234 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:12.085194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" event={"ID":"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f","Type":"ContainerStarted","Data":"ffcff63847001a8565d4355aaa8be37ff7608a340dd1454ebcd9a99999aebed4"}
Sep 09 20:35:12.085432 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:12.085256    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" event={"ID":"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f","Type":"ContainerStarted","Data":"31d31fe96fcb540e8aa9a8327dac4dd670ba81a9d7c63f47ffb04ecb4042c99a"}
Sep 09 20:35:12.085432 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:12.085325    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:12.102626 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:12.102578    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" podStartSLOduration=2.102562685 podStartE2EDuration="2.102562685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:35:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:35:12.100859658 +0000 UTC m=+2410.151004769" watchObservedRunningTime="2026-09-09 20:35:12.102562685 +0000 UTC m=+2410.152707768"
Sep 09 20:35:18.095458 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:18.095427    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:35:24.910898 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:24.910807    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"]
Sep 09 20:35:24.916216 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:24.916185    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:24.918095 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:24.918067    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-b9ccb-serving-cert\""
Sep 09 20:35:24.918095 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:24.918086    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-b9ccb-kube-rbac-proxy-sar-config\""
Sep 09 20:35:24.921961 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:24.921924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:35:24.922499 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:24.922448    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"]
Sep 09 20:35:24.990687 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:24.990652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a253f913-ce35-48f8-b081-0f5efb64c821-openshift-service-ca-bundle\") pod \"splitter-graph-b9ccb-766d4cf7d6-rd6m7\" (UID: \"a253f913-ce35-48f8-b081-0f5efb64c821\") " pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:24.990687 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:24.990684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a253f913-ce35-48f8-b081-0f5efb64c821-proxy-tls\") pod \"splitter-graph-b9ccb-766d4cf7d6-rd6m7\" (UID: \"a253f913-ce35-48f8-b081-0f5efb64c821\") " pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:25.091554 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:25.091517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a253f913-ce35-48f8-b081-0f5efb64c821-openshift-service-ca-bundle\") pod \"splitter-graph-b9ccb-766d4cf7d6-rd6m7\" (UID: \"a253f913-ce35-48f8-b081-0f5efb64c821\") " pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:25.091554 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:25.091554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a253f913-ce35-48f8-b081-0f5efb64c821-proxy-tls\") pod \"splitter-graph-b9ccb-766d4cf7d6-rd6m7\" (UID: \"a253f913-ce35-48f8-b081-0f5efb64c821\") " pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:25.091756 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:35:25.091735    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-b9ccb-serving-cert: secret "splitter-graph-b9ccb-serving-cert" not found
Sep 09 20:35:25.091828 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:35:25.091818    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a253f913-ce35-48f8-b081-0f5efb64c821-proxy-tls podName:a253f913-ce35-48f8-b081-0f5efb64c821 nodeName:}" failed. No retries permitted until 2026-09-09 20:35:25.591798825 +0000 UTC m=+2423.641943902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a253f913-ce35-48f8-b081-0f5efb64c821-proxy-tls") pod "splitter-graph-b9ccb-766d4cf7d6-rd6m7" (UID: "a253f913-ce35-48f8-b081-0f5efb64c821") : secret "splitter-graph-b9ccb-serving-cert" not found
Sep 09 20:35:25.092176 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:25.092158    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a253f913-ce35-48f8-b081-0f5efb64c821-openshift-service-ca-bundle\") pod \"splitter-graph-b9ccb-766d4cf7d6-rd6m7\" (UID: \"a253f913-ce35-48f8-b081-0f5efb64c821\") " pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:25.247010 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:25.246910    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:35:25.595998 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:25.595964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a253f913-ce35-48f8-b081-0f5efb64c821-proxy-tls\") pod \"splitter-graph-b9ccb-766d4cf7d6-rd6m7\" (UID: \"a253f913-ce35-48f8-b081-0f5efb64c821\") " pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:25.598540 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:25.598521    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a253f913-ce35-48f8-b081-0f5efb64c821-proxy-tls\") pod \"splitter-graph-b9ccb-766d4cf7d6-rd6m7\" (UID: \"a253f913-ce35-48f8-b081-0f5efb64c821\") " pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:25.827767 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:25.827733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:26.097605 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:26.097580    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"]
Sep 09 20:35:26.100079 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:35:26.100050    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda253f913_ce35_48f8_b081_0f5efb64c821.slice/crio-6fc4acac04a51cef937d289e592ab885de01a04c755968e6c51cb68fcf216cf8 WatchSource:0}: Error finding container 6fc4acac04a51cef937d289e592ab885de01a04c755968e6c51cb68fcf216cf8: Status 404 returned error can't find the container with id 6fc4acac04a51cef937d289e592ab885de01a04c755968e6c51cb68fcf216cf8
Sep 09 20:35:26.153658 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:26.153630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" event={"ID":"a253f913-ce35-48f8-b081-0f5efb64c821","Type":"ContainerStarted","Data":"6fc4acac04a51cef937d289e592ab885de01a04c755968e6c51cb68fcf216cf8"}
Sep 09 20:35:27.159613 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:27.159579    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" event={"ID":"a253f913-ce35-48f8-b081-0f5efb64c821","Type":"ContainerStarted","Data":"665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796"}
Sep 09 20:35:27.160011 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:27.159681    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:35:27.178441 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:27.178394    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" podStartSLOduration=3.178381677 podStartE2EDuration="3.178381677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:35:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:35:27.177290944 +0000 UTC m=+2425.227436052" watchObservedRunningTime="2026-09-09 20:35:27.178381677 +0000 UTC m=+2425.228526760"
Sep 09 20:35:33.171030 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:35:33.171002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:40:01.477252 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:40:01.477177    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:40:02.617790 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:40:02.617760    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:40:02.626087 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:40:02.626062    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:42:44.741790 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:42:44.741756    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:43:39.572910 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:39.572876    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"]
Sep 09 20:43:39.573527 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:39.573174    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb" containerID="cri-o://665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796" gracePeriod=30
Sep 09 20:43:39.596991 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:39.596959    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:43:39.712289 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:39.712259    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:43:39.768101 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:39.768058    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:43:43.168697 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:43.168655    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:43:48.168484 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:48.168422    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:43:53.168517 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:53.168459    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:43:53.168995 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:53.168629    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:43:58.168687 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:43:58.168644    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:44:03.168812 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:03.168772    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:44:08.168902 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:08.168861    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:44:09.721179 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:09.721149    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:44:09.775092 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:09.775067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a253f913-ce35-48f8-b081-0f5efb64c821-proxy-tls\") pod \"a253f913-ce35-48f8-b081-0f5efb64c821\" (UID: \"a253f913-ce35-48f8-b081-0f5efb64c821\") "
Sep 09 20:44:09.775235 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:09.775142    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a253f913-ce35-48f8-b081-0f5efb64c821-openshift-service-ca-bundle\") pod \"a253f913-ce35-48f8-b081-0f5efb64c821\" (UID: \"a253f913-ce35-48f8-b081-0f5efb64c821\") "
Sep 09 20:44:09.775517 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:09.775494    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a253f913-ce35-48f8-b081-0f5efb64c821-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a253f913-ce35-48f8-b081-0f5efb64c821" (UID: "a253f913-ce35-48f8-b081-0f5efb64c821"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:44:09.777118 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:09.777094    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a253f913-ce35-48f8-b081-0f5efb64c821-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a253f913-ce35-48f8-b081-0f5efb64c821" (UID: "a253f913-ce35-48f8-b081-0f5efb64c821"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:44:09.876772 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:09.876682    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a253f913-ce35-48f8-b081-0f5efb64c821-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:44:09.876772 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:09.876717    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a253f913-ce35-48f8-b081-0f5efb64c821-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:44:10.544455 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:10.544424    2577 generic.go:356] "Generic (PLEG): container finished" podID="a253f913-ce35-48f8-b081-0f5efb64c821" containerID="665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796" exitCode=0
Sep 09 20:44:10.544666 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:10.544492    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"
Sep 09 20:44:10.544666 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:10.544512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" event={"ID":"a253f913-ce35-48f8-b081-0f5efb64c821","Type":"ContainerDied","Data":"665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796"}
Sep 09 20:44:10.544666 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:10.544564    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7" event={"ID":"a253f913-ce35-48f8-b081-0f5efb64c821","Type":"ContainerDied","Data":"6fc4acac04a51cef937d289e592ab885de01a04c755968e6c51cb68fcf216cf8"}
Sep 09 20:44:10.545675 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:10.544585    2577 scope.go:117] "RemoveContainer" containerID="665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796"
Sep 09 20:44:10.554408 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:10.554385    2577 scope.go:117] "RemoveContainer" containerID="665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796"
Sep 09 20:44:10.554740 ip-10-0-128-182 kubenswrapper[2577]: E0909 20:44:10.554717    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796\": container with ID starting with 665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796 not found: ID does not exist" containerID="665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796"
Sep 09 20:44:10.554812 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:10.554750    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796"} err="failed to get container status \"665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796\": rpc error: code = NotFound desc = could not find container \"665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796\": container with ID starting with 665d4bc1c953b4b1e83947677e142e8ccc48fcc9ea795dd9aed779b1f6f22796 not found: ID does not exist"
Sep 09 20:44:10.560080 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:10.560052    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"]
Sep 09 20:44:10.563556 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:10.563536    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-b9ccb-766d4cf7d6-rd6m7"]
Sep 09 20:44:12.447036 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:44:12.447004    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" path="/var/lib/kubelet/pods/a253f913-ce35-48f8-b081-0f5efb64c821/volumes"
Sep 09 20:45:02.650605 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:45:02.650577    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:45:02.659346 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:45:02.659328    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:48:32.026090 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:48:32.026058    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:50:02.679836 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:50:02.679800    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:50:02.689603 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:50:02.689584    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:51:29.666224 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:29.666188    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"]
Sep 09 20:51:29.666790 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:29.666435    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686" containerID="cri-o://ffcff63847001a8565d4355aaa8be37ff7608a340dd1454ebcd9a99999aebed4" gracePeriod=30
Sep 09 20:51:30.651614 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:30.651576    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:51:30.741852 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:30.741818    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:51:30.997175 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:30.997085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:51:31.096984 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:31.096947    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:51:33.093376 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:33.093337    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:51:38.093271 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:38.093220    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:51:43.093765 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:43.093731    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:51:43.094180 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:43.093856    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:51:45.986772 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:45.986734    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:51:46.322300 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:46.322271    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:47.126444 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:47.126408    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:47.979706 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:47.979680    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:48.093567 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:48.093529    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:51:48.730646 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:48.730609    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:49.492424 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:49.492392    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:50.265481 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:50.265439    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:51.029152 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:51.029125    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:51.796635 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:51.796606    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:52.620929 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:52.620894    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:53.094079 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:53.094038    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:51:53.476062 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:53.475956    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:54.294546 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:54.294522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:55.182765 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:55.182739    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:56.005181 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:56.005151    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:56.773850 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:56.773818    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-54686-7694d64fcc-shqw2_0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/switch-graph-54686/0.log"
Sep 09 20:51:58.094046 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:58.094008    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 20:51:58.911560 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:58.911528    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:51:59.095898 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.095865    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qzq9p/must-gather-v4dzf"]
Sep 09 20:51:59.096253 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.096240    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb"
Sep 09 20:51:59.096253 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.096251    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb"
Sep 09 20:51:59.096324 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.096310    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a253f913-ce35-48f8-b081-0f5efb64c821" containerName="splitter-graph-b9ccb"
Sep 09 20:51:59.099598 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.099578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qzq9p/must-gather-v4dzf"
Sep 09 20:51:59.103594 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.103575    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qzq9p\"/\"kube-root-ca.crt\""
Sep 09 20:51:59.104830 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.104808    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qzq9p\"/\"openshift-service-ca.crt\""
Sep 09 20:51:59.104926 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.104819    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qzq9p\"/\"default-dockercfg-7lvqh\""
Sep 09 20:51:59.109690 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.109670    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qzq9p/must-gather-v4dzf"]
Sep 09 20:51:59.111882 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.111860    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:51:59.169725 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.169657    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:51:59.239336 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.239312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs42h\" (UniqueName: \"kubernetes.io/projected/b3db017f-ea6b-4d6f-9bed-9ea1260788d2-kube-api-access-xs42h\") pod \"must-gather-v4dzf\" (UID: \"b3db017f-ea6b-4d6f-9bed-9ea1260788d2\") " pod="openshift-must-gather-qzq9p/must-gather-v4dzf"
Sep 09 20:51:59.239426 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.239357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b3db017f-ea6b-4d6f-9bed-9ea1260788d2-must-gather-output\") pod \"must-gather-v4dzf\" (UID: \"b3db017f-ea6b-4d6f-9bed-9ea1260788d2\") " pod="openshift-must-gather-qzq9p/must-gather-v4dzf"
Sep 09 20:51:59.340550 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.340521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs42h\" (UniqueName: \"kubernetes.io/projected/b3db017f-ea6b-4d6f-9bed-9ea1260788d2-kube-api-access-xs42h\") pod \"must-gather-v4dzf\" (UID: \"b3db017f-ea6b-4d6f-9bed-9ea1260788d2\") " pod="openshift-must-gather-qzq9p/must-gather-v4dzf"
Sep 09 20:51:59.340658 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.340558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b3db017f-ea6b-4d6f-9bed-9ea1260788d2-must-gather-output\") pod \"must-gather-v4dzf\" (UID: \"b3db017f-ea6b-4d6f-9bed-9ea1260788d2\") " pod="openshift-must-gather-qzq9p/must-gather-v4dzf"
Sep 09 20:51:59.340940 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.340922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b3db017f-ea6b-4d6f-9bed-9ea1260788d2-must-gather-output\") pod \"must-gather-v4dzf\" (UID: \"b3db017f-ea6b-4d6f-9bed-9ea1260788d2\") " pod="openshift-must-gather-qzq9p/must-gather-v4dzf"
Sep 09 20:51:59.355295 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.355274    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs42h\" (UniqueName: \"kubernetes.io/projected/b3db017f-ea6b-4d6f-9bed-9ea1260788d2-kube-api-access-xs42h\") pod \"must-gather-v4dzf\" (UID: \"b3db017f-ea6b-4d6f-9bed-9ea1260788d2\") " pod="openshift-must-gather-qzq9p/must-gather-v4dzf"
Sep 09 20:51:59.417014 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.416982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qzq9p/must-gather-v4dzf"
Sep 09 20:51:59.687096 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.687071    2577 generic.go:356] "Generic (PLEG): container finished" podID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerID="ffcff63847001a8565d4355aaa8be37ff7608a340dd1454ebcd9a99999aebed4" exitCode=0
Sep 09 20:51:59.687191 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.687150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" event={"ID":"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f","Type":"ContainerDied","Data":"ffcff63847001a8565d4355aaa8be37ff7608a340dd1454ebcd9a99999aebed4"}
Sep 09 20:51:59.692140 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.692117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qzq9p/must-gather-v4dzf"]
Sep 09 20:51:59.733805 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:51:59.733755    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3db017f_ea6b_4d6f_9bed_9ea1260788d2.slice/crio-4c14a142f75afc6dac830241f6f28d97090dc00438ba38c09f6e625915fc8b33 WatchSource:0}: Error finding container 4c14a142f75afc6dac830241f6f28d97090dc00438ba38c09f6e625915fc8b33: Status 404 returned error can't find the container with id 4c14a142f75afc6dac830241f6f28d97090dc00438ba38c09f6e625915fc8b33
Sep 09 20:51:59.736311 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.736292    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 20:51:59.796242 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.796215    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:51:59.946602 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.946516    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-proxy-tls\") pod \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\" (UID: \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\") "
Sep 09 20:51:59.946602 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.946600    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-openshift-service-ca-bundle\") pod \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\" (UID: \"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f\") "
Sep 09 20:51:59.946942 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.946913    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" (UID: "0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 20:51:59.948698 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:51:59.948680    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" (UID: "0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 20:52:00.047186 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:00.047161    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-proxy-tls\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:52:00.047186 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:00.047184    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f-openshift-service-ca-bundle\") on node \"ip-10-0-128-182.ec2.internal\" DevicePath \"\""
Sep 09 20:52:00.695043 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:00.695009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qzq9p/must-gather-v4dzf" event={"ID":"b3db017f-ea6b-4d6f-9bed-9ea1260788d2","Type":"ContainerStarted","Data":"26e684a3c691fcc81e5a1d488cc4118997d24a725456b725687636ff767536ea"}
Sep 09 20:52:00.695364 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:00.695064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qzq9p/must-gather-v4dzf" event={"ID":"b3db017f-ea6b-4d6f-9bed-9ea1260788d2","Type":"ContainerStarted","Data":"4c14a142f75afc6dac830241f6f28d97090dc00438ba38c09f6e625915fc8b33"}
Sep 09 20:52:00.696250 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:00.696233    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"
Sep 09 20:52:00.696355 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:00.696231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2" event={"ID":"0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f","Type":"ContainerDied","Data":"31d31fe96fcb540e8aa9a8327dac4dd670ba81a9d7c63f47ffb04ecb4042c99a"}
Sep 09 20:52:00.696396 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:00.696363    2577 scope.go:117] "RemoveContainer" containerID="ffcff63847001a8565d4355aaa8be37ff7608a340dd1454ebcd9a99999aebed4"
Sep 09 20:52:00.714854 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:00.714804    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"]
Sep 09 20:52:00.721857 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:00.721831    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-54686-7694d64fcc-shqw2"]
Sep 09 20:52:01.705214 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:01.705175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qzq9p/must-gather-v4dzf" event={"ID":"b3db017f-ea6b-4d6f-9bed-9ea1260788d2","Type":"ContainerStarted","Data":"7e6545edeb69c69ede4d9d145492ba0fa50a7cc97b84d1610628b8ecb96c527e"}
Sep 09 20:52:01.722945 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:01.722900    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qzq9p/must-gather-v4dzf" podStartSLOduration=1.978060095 podStartE2EDuration="2.722885358s" totalImagesPullingTime="744.825263ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 20:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:01.722292885 +0000 UTC m=+3419.772437969" watchObservedRunningTime="2026-09-09 20:52:01.722885358 +0000 UTC m=+3419.773030441"
Sep 09 20:52:01.888399 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:01.888367    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4q5g4_44c947ed-7f54-435e-a325-bc76db2aa6e2/global-pull-secret-syncer/0.log"
Sep 09 20:52:02.044094 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:02.044057    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log"
Sep 09 20:52:02.143877 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:02.143828    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-182.ec2.internal_904bc9f88e13bb5338c5d8bd66a5e7ec/haproxy/0.log"
Sep 09 20:52:02.449453 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:02.449365    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" path="/var/lib/kubelet/pods/0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f/volumes"
Sep 09 20:52:04.835002 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:04.834952    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:52:04.891510 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:04.891412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gttr6_72906567-38dc-4a1e-b887-c6d2da4d3917/konnectivity-agent/0.log" limit=1024
Sep 09 20:52:06.480788 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.480735    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01768fca-c185-4ece-8d98-af8ef4ab17b7/alertmanager/0.log"
Sep 09 20:52:06.504148 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.504091    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01768fca-c185-4ece-8d98-af8ef4ab17b7/config-reloader/0.log"
Sep 09 20:52:06.532866 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.532821    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01768fca-c185-4ece-8d98-af8ef4ab17b7/kube-rbac-proxy-web/0.log"
Sep 09 20:52:06.562213 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.562166    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01768fca-c185-4ece-8d98-af8ef4ab17b7/kube-rbac-proxy/0.log"
Sep 09 20:52:06.586836 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.586781    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01768fca-c185-4ece-8d98-af8ef4ab17b7/kube-rbac-proxy-metric/0.log"
Sep 09 20:52:06.609485 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.609427    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01768fca-c185-4ece-8d98-af8ef4ab17b7/prom-label-proxy/0.log"
Sep 09 20:52:06.642702 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.642670    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01768fca-c185-4ece-8d98-af8ef4ab17b7/init-config-reloader/0.log"
Sep 09 20:52:06.689550 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.689522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-6jmnv_64129677-2c7c-4b80-8551-67556a7e947f/cluster-monitoring-operator/0.log"
Sep 09 20:52:06.720846 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.720819    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-lq9h4_af1466ed-7285-4327-8623-ed01e7ddc2cc/kube-state-metrics/0.log"
Sep 09 20:52:06.743343 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.743259    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-lq9h4_af1466ed-7285-4327-8623-ed01e7ddc2cc/kube-rbac-proxy-main/0.log"
Sep 09 20:52:06.767861 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.767825    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-lq9h4_af1466ed-7285-4327-8623-ed01e7ddc2cc/kube-rbac-proxy-self/0.log"
Sep 09 20:52:06.807724 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.807695    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d5c855f46-xnvfs_9e622d1c-2f11-4075-a17d-6892ffed5201/metrics-server/0.log"
Sep 09 20:52:06.832917 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:06.832869    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-2pq7g_7200ec65-bb90-4cf4-ab84-b67d13355f6d/monitoring-plugin/0.log"
Sep 09 20:52:07.038991 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:07.038963    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ppvvn_7afc4be2-d292-4493-a936-33967a45f9ce/node-exporter/0.log"
Sep 09 20:52:07.062984 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:07.062955    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ppvvn_7afc4be2-d292-4493-a936-33967a45f9ce/kube-rbac-proxy/0.log"
Sep 09 20:52:07.091955 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:07.091926    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ppvvn_7afc4be2-d292-4493-a936-33967a45f9ce/init-textfile/0.log"
Sep 09 20:52:07.396376 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:07.396293    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-vgfsc_0ef9241b-8c34-42b9-8677-ef4c561a4ed4/prometheus-operator/0.log"
Sep 09 20:52:07.421099 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:07.421076    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-vgfsc_0ef9241b-8c34-42b9-8677-ef4c561a4ed4/kube-rbac-proxy/0.log"
Sep 09 20:52:07.455701 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:07.455644    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-w9f5x_8fd5eb11-8cac-4a1f-9075-a93d0e1b141c/prometheus-operator-admission-webhook/0.log"
Sep 09 20:52:07.504313 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:07.504277    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c89c46b95-lxwp4_d21ee206-2394-41f8-9506-2ccd29f9fe26/telemeter-client/0.log"
Sep 09 20:52:07.546777 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:07.546753    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c89c46b95-lxwp4_d21ee206-2394-41f8-9506-2ccd29f9fe26/reload/0.log"
Sep 09 20:52:07.590903 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:07.590860    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c89c46b95-lxwp4_d21ee206-2394-41f8-9506-2ccd29f9fe26/kube-rbac-proxy/0.log"
Sep 09 20:52:08.916679 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:08.916650    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-2cpgt_9bb964a1-a5d5-4d9c-99f7-5ad5427250f8/networking-console-plugin/0.log"
Sep 09 20:52:09.871885 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:09.871854    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b89c6958f-w9dg9_4dcf5c25-e15a-4593-b701-ad1bf2e4f3ed/console/0.log"
Sep 09 20:52:09.913107 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:09.913082    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-942ng_462ca00c-a3af-41f4-adaf-da453d446497/download-server/0.log"
Sep 09 20:52:09.931533 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:09.931501    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"]
Sep 09 20:52:09.932030 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:09.932011    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686"
Sep 09 20:52:09.932106 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:09.932033    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686"
Sep 09 20:52:09.932163 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:09.932154    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa1113e-d6f2-45ae-8f69-4fefe0e5c09f" containerName="switch-graph-54686"
Sep 09 20:52:09.935549 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:09.935527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:09.944420 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:09.944398    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"]
Sep 09 20:52:10.044864 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.044827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-sys\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.044864 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.044870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-podres\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.045230 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.044897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-lib-modules\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.045230 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.044921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xql7h\" (UniqueName: \"kubernetes.io/projected/b87eaed0-f6e0-4b70-9348-a425a156ccd2-kube-api-access-xql7h\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.045230 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.045030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-proc\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.146526 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.146409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-proc\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.146693 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.146552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-sys\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.146693 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.146586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-podres\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.146693 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.146587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-sys\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.146693 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.146554    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-proc\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.146693 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.146614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-lib-modules\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.146693 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.146677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-podres\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.146930 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.146703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xql7h\" (UniqueName: \"kubernetes.io/projected/b87eaed0-f6e0-4b70-9348-a425a156ccd2-kube-api-access-xql7h\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.146930 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.146727    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b87eaed0-f6e0-4b70-9348-a425a156ccd2-lib-modules\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.155805 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.155752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xql7h\" (UniqueName: \"kubernetes.io/projected/b87eaed0-f6e0-4b70-9348-a425a156ccd2-kube-api-access-xql7h\") pod \"perf-node-gather-daemonset-49rd4\" (UID: \"b87eaed0-f6e0-4b70-9348-a425a156ccd2\") " pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.251894 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.251857    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.483853 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.483780    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-m2ptt_114bc528-9793-4d97-ad10-b466541bd7b2/volume-data-source-validator/0.log"
Sep 09 20:52:10.553806 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.552587    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"]
Sep 09 20:52:10.556123 ip-10-0-128-182 kubenswrapper[2577]: W0909 20:52:10.556085    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb87eaed0_f6e0_4b70_9348_a425a156ccd2.slice/crio-0aa7be4c58fac6b20b403274dc6028a72c3714f587bb91c61c1c1b31f378fcb1 WatchSource:0}: Error finding container 0aa7be4c58fac6b20b403274dc6028a72c3714f587bb91c61c1c1b31f378fcb1: Status 404 returned error can't find the container with id 0aa7be4c58fac6b20b403274dc6028a72c3714f587bb91c61c1c1b31f378fcb1
Sep 09 20:52:10.765924 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.765846    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4" event={"ID":"b87eaed0-f6e0-4b70-9348-a425a156ccd2","Type":"ContainerStarted","Data":"8ef36975be21524fa11f8760044a0b1f920ec25a4c9d05839635726a4dbc0987"}
Sep 09 20:52:10.765924 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.765907    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4" event={"ID":"b87eaed0-f6e0-4b70-9348-a425a156ccd2","Type":"ContainerStarted","Data":"0aa7be4c58fac6b20b403274dc6028a72c3714f587bb91c61c1c1b31f378fcb1"}
Sep 09 20:52:10.766166 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.766018    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:10.782234 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:10.782172    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4" podStartSLOduration=1.782150503 podStartE2EDuration="1.782150503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 20:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 20:52:10.781146469 +0000 UTC m=+3428.831291554" watchObservedRunningTime="2026-09-09 20:52:10.782150503 +0000 UTC m=+3428.832295591"
Sep 09 20:52:11.383860 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:11.383832    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6dthr_722fc986-cfd8-49ad-abe7-c1ce42b9f52f/dns/0.log"
Sep 09 20:52:11.406962 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:11.406935    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6dthr_722fc986-cfd8-49ad-abe7-c1ce42b9f52f/kube-rbac-proxy/0.log"
Sep 09 20:52:11.551879 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:11.551855    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qdtq8_c9077078-4773-47ab-8080-cdcc7b94f4e9/dns-node-resolver/0.log"
Sep 09 20:52:12.054260 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:12.054227    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hqxw8_c951ba96-23fb-403a-b91d-e894f18cfc8f/node-ca/0.log"
Sep 09 20:52:13.192412 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:13.192379    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-brct6_11e116db-c6b1-495b-8c10-c251e9a9b2e3/serve-healthcheck-canary/0.log"
Sep 09 20:52:13.620735 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:13.620706    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5l75p_f5690bb0-8552-40a9-8f0d-84bc8bd8f459/kube-rbac-proxy/0.log"
Sep 09 20:52:13.644636 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:13.644599    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5l75p_f5690bb0-8552-40a9-8f0d-84bc8bd8f459/exporter/0.log"
Sep 09 20:52:13.669287 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:13.669251    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5l75p_f5690bb0-8552-40a9-8f0d-84bc8bd8f459/extractor/0.log"
Sep 09 20:52:16.062359 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:16.062309    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-7676c798d9-t2ftq_d58cf3d4-9cb9-4577-8dc2-2cbb3fb4b899/manager/0.log"
Sep 09 20:52:16.090366 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:16.090341    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-c6wqk_ec3df166-6dca-4f05-bbaf-0c5d8a8d8244/manager/0.log"
Sep 09 20:52:16.782463 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:16.782437    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qzq9p/perf-node-gather-daemonset-49rd4"
Sep 09 20:52:20.613776 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:20.613747    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-8gdlk_e79a23fb-cd3d-4423-9b4e-d3d7836e5838/migrator/0.log"
Sep 09 20:52:20.646429 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:20.646406    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-8gdlk_e79a23fb-cd3d-4423-9b4e-d3d7836e5838/graceful-termination/0.log"
Sep 09 20:52:21.013309 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:21.013284    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-lwpq4_1f342115-6774-487f-b9f0-32e8ddda3db7/kube-storage-version-migrator-operator/1.log"
Sep 09 20:52:21.014587 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:21.014563    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-lwpq4_1f342115-6774-487f-b9f0-32e8ddda3db7/kube-storage-version-migrator-operator/0.log"
Sep 09 20:52:21.891382 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:21.891356    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkxfj_6c19fb1b-fe26-4be2-ab6a-aab24665d904/kube-multus-additional-cni-plugins/0.log"
Sep 09 20:52:21.914942 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:21.914921    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkxfj_6c19fb1b-fe26-4be2-ab6a-aab24665d904/egress-router-binary-copy/0.log"
Sep 09 20:52:21.937556 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:21.937536    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkxfj_6c19fb1b-fe26-4be2-ab6a-aab24665d904/cni-plugins/0.log"
Sep 09 20:52:21.960487 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:21.960416    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkxfj_6c19fb1b-fe26-4be2-ab6a-aab24665d904/bond-cni-plugin/0.log"
Sep 09 20:52:21.980158 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:21.980137    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkxfj_6c19fb1b-fe26-4be2-ab6a-aab24665d904/routeoverride-cni/0.log"
Sep 09 20:52:22.000973 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:22.000957    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkxfj_6c19fb1b-fe26-4be2-ab6a-aab24665d904/whereabouts-cni-bincopy/0.log"
Sep 09 20:52:22.024288 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:22.024272    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fkxfj_6c19fb1b-fe26-4be2-ab6a-aab24665d904/whereabouts-cni/0.log"
Sep 09 20:52:22.366325 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:22.366290    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cdk2z_b18b5d0f-ca1d-4e49-895f-d7f2b42761fc/kube-multus/0.log"
Sep 09 20:52:22.486267 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:22.486239    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dbvkj_b0ea2929-722b-472c-ab75-2bd456540d9a/network-metrics-daemon/0.log"
Sep 09 20:52:22.505246 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:22.505217    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dbvkj_b0ea2929-722b-472c-ab75-2bd456540d9a/kube-rbac-proxy/0.log"
Sep 09 20:52:23.704491 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:23.704447    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-controller/0.log"
Sep 09 20:52:23.721541 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:23.721513    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/1.log"
Sep 09 20:52:23.721686 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:23.721553    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovn-acl-logging/0.log"
Sep 09 20:52:23.742329 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:23.742305    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/kube-rbac-proxy-node/0.log"
Sep 09 20:52:23.766379 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:23.766354    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/kube-rbac-proxy-ovn-metrics/0.log"
Sep 09 20:52:23.782775 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:23.782760    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/northd/0.log"
Sep 09 20:52:23.803926 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:23.803909    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/nbdb/0.log"
Sep 09 20:52:23.825955 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:23.825940    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/sbdb/0.log"
Sep 09 20:52:23.874605 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:23.874581    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h8j2_b6fafc35-09fa-4a2b-8a00-511938ca5f48/ovnkube-controller/0.log"
Sep 09 20:52:24.838747 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:24.838719    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-kf5w5_c12f26b2-704f-4274-83ad-12f379929591/check-endpoints/0.log"
Sep 09 20:52:24.885343 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:24.885316    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-f4k29_a50f3dbf-6489-4d45-bca7-9630d61b593f/network-check-target-container/0.log"
Sep 09 20:52:25.915436 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:25.915408    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lbk66_4372d0b8-fe33-401f-957a-ce20f16ef750/iptables-alerter/0.log"
Sep 09 20:52:26.636509 ip-10-0-128-182 kubenswrapper[2577]: I0909 20:52:26.636407    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-wt7sp_96493eca-d587-406b-9d39-a5e0dd8594dc/tuned/0.log"