Sep 18 20:20:22.982666 ip-10-0-136-235 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 20:20:23.349158 ip-10-0-136-235 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 20:20:23.349158 ip-10-0-136-235 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 20:20:23.349158 ip-10-0-136-235 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 20:20:23.349792 ip-10-0-136-235 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 20:20:23.349792 ip-10-0-136-235 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 20:20:23.350948 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.350862    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 20:20:23.356469 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356402    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 20:20:23.356572 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356560    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 20:20:23.356572 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356566    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 20:20:23.356572 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356569    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 20:20:23.356572 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356573    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 20:20:23.356572 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356576    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356581    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356584    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356587    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356590    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356594    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356596    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356600    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356602    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356605    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356608    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356611    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356614    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356617    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356619    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356622    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356627    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356631    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356634    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 20:20:23.356702 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356637    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356640    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356643    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356645    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356648    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356653    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356655    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356659    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356661    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356668    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356670    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356673    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356676    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356680    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356684    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356688    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356691    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356694    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356697    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356700    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 20:20:23.357171 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356702    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356705    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356708    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356711    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356713    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356716    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356719    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356722    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356725    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356727    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356729    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356732    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356735    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356737    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356740    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356742    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356745    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356748    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356751    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356753    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 20:20:23.357692 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356756    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356759    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356762    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356764    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356767    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356769    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356772    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356776    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356779    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356781    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356784    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356787    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356791    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356793    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356796    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356799    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356801    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356804    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356806    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356810    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 20:20:23.358163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356812    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356816    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356819    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356822    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356825    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356827    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356830    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356833    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356835    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356838    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356841    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356843    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356846    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356848    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.356851    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358394    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358402    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358406    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358408    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358411    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 20:20:23.358675 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358414    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358418    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358421    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358424    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358427    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358430    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358433    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358436    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358438    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358443    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358446    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358451    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358456    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358460    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358464    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358467    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358470    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358473    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358476    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 20:20:23.359195 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358478    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358481    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358484    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358486    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358489    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358491    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358494    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358497    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358500    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358503    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358506    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358508    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358511    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358514    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358517    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358519    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358522    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358524    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358527    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358529    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 20:20:23.359708 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358532    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358535    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358537    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358540    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358545    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358548    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358551    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358554    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358557    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358560    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358563    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358565    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358568    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358571    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358574    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358576    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358579    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358582    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358585    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358588    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 20:20:23.360198 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358590    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358593    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358595    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358598    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358600    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358603    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358606    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358608    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358611    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358613    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358617    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358619    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358622    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358625    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358627    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358630    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358634    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358636    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358639    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 20:20:23.360697 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358642    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358645    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358648    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358651    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358653    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358656    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358659    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358661    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358664    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358666    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358669    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358671    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358674    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358677    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358680    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.358684    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359067    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359072    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359075    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 20:20:23.361163 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359078    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359082    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359086    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359089    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359093    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359096    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359099    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359101    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359104    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359107    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359111    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359114    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359116    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359120    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359122    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359125    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359127    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359130    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359133    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359136    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 20:20:23.361641 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359138    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359141    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359143    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359146    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359149    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359152    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359155    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359157    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359160    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359162    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359165    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359168    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359170    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359173    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359175    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359178    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359181    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359183    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359186    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359189    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 20:20:23.362119 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359191    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359194    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359197    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359200    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359203    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359206    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359209    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359212    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359215    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359218    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359220    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359223    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359226    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359228    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359232    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359235    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359237    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359240    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359242    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 20:20:23.362640 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359245    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359249    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359252    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359255    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359258    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359260    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359263    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359266    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359270    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359273    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359275    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359278    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359281    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359283    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359286    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359289    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359291    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359294    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359296    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 20:20:23.363105 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359299    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359302    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359304    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359307    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359309    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359312    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359330    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359333    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359336    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359338    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359341    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359343    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359346    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359349    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359351    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359354    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359356    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.359359    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359435    2561 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359469    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 20:20:23.363609 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359478    2561 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359483    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359489    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359492    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359497    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359501    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359505    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359508    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359511    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359515    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359519    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359522    2561 flags.go:64] FLAG: --cgroup-root=""
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359525    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359528    2561 flags.go:64] FLAG: --client-ca-file=""
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359532    2561 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359535    2561 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359539    2561 flags.go:64] FLAG: --cluster-domain=""
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359542    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359545    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359548    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359552    2561 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359560    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359563    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 20:20:23.364127 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359566    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359569    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359572    2561 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359575    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359578    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359581    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359584    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359588    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359591    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359594    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359597    2561 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359601    2561 flags.go:64] FLAG: --enable-server="true"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359605    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359609    2561 flags.go:64] FLAG: --event-burst="100"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359613    2561 flags.go:64] FLAG: --event-qps="50"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359616    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359618    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359621    2561 flags.go:64] FLAG: --eviction-hard=""
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359625    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359628    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359631    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359643    2561 flags.go:64] FLAG: --eviction-soft=""
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359646    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359649    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359653    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 20:20:23.364720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359656    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359659    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359662    2561 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359665    2561 flags.go:64] FLAG: --feature-gates=""
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359668    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359671    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359675    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359678    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359681    2561 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359683    2561 flags.go:64] FLAG: --help="false"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359686    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359689    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359692    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359695    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359699    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359702    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359705    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359707    2561 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359712    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359715    2561 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359717    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359721    2561 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359724    2561 flags.go:64] FLAG: --kube-reserved=""
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359727    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 20:20:23.365369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359730    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359733    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359736    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359739    2561 flags.go:64] FLAG: --lock-file=""
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359742    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359744    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359747    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359753    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359756    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359758    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359761    2561 flags.go:64] FLAG: --logging-format="text"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359764    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359767    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359770    2561 flags.go:64] FLAG: --manifest-url=""
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359773    2561 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359777    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359780    2561 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359784    2561 flags.go:64] FLAG: --max-pods="110"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359787    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359790    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359793    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359796    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359799    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359801    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359804    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 20:20:23.365982 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359811    2561 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359815    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359818    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359821    2561 flags.go:64] FLAG: --pod-cidr=""
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359825    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359831    2561 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359834    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359837    2561 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359840    2561 flags.go:64] FLAG: --port="10250"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359843    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359846    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03e2443918e7e4f32"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359849    2561 flags.go:64] FLAG: --qos-reserved=""
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359853    2561 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359856    2561 flags.go:64] FLAG: --register-node="true"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359859    2561 flags.go:64] FLAG: --register-with-taints=""
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359863    2561 flags.go:64] FLAG: --registry-burst="10"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359867    2561 flags.go:64] FLAG: --registry-qps="5"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359870    2561 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359873    2561 flags.go:64] FLAG: --reserved-memory=""
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359876    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359879    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359883    2561 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359886    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359888    2561 flags.go:64] FLAG: --runonce="false"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359891    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 20:20:23.366654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359894    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359898    2561 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359900    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359903    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359906    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359909    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359912    2561 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359915    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359920    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359923    2561 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359926    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359929    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359936    2561 flags.go:64] FLAG: --system-cgroups=""
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359939    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359944    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359947    2561 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359950    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359954    2561 flags.go:64] FLAG: --tls-min-version=""
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359957    2561 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359960    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359964    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359967    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359970    2561 flags.go:64] FLAG: --v="2"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359974    2561 flags.go:64] FLAG: --version="false"
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359979    2561 flags.go:64] FLAG: --vmodule=""
Sep 18 20:20:23.367266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359983    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.359986    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360106    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360110    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360113    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360116    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360119    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360122    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360125    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360127    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360130    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360133    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360136    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360139    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360142    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360145    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360148    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360151    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360154    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360158    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 20:20:23.367996 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360161    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360163    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360166    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360169    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360171    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360174    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360177    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360180    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360186    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360191    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360194    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360199    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360203    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360207    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360210    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360213    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360216    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360218    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360222    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 20:20:23.368495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360224    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360227    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360230    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360232    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360235    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360238    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360240    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360243    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360247    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360249    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360252    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360255    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360259    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360262    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360264    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360267    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360270    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360272    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360275    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360278    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 20:20:23.368974 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360280    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360283    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360285    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360288    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360291    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360293    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360300    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360303    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360306    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360309    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360311    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360327    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360330    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360333    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360335    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360338    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360341    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360344    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360346    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360349    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 20:20:23.369487 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360352    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360355    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360358    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360360    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360366    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360369    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360373    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360376    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360379    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360381    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360384    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360387    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360389    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360392    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360395    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360398    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360401    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360404    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360407    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360410    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 20:20:23.370050 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360413    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.360416    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.360984    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.367961    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.367977    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.368841    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.368848    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368910    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368915    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368919    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368922    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368925    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368928    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368930    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 20:20:23.370577 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368933    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368936    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368938    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368941    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368944    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368947    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368949    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368952    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368954    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368957    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368960    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368963    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368967    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368969    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368973    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368976    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368978    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368990    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368994    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.368997    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 20:20:23.370938 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369001    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369003    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369006    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369009    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369012    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369015    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369018    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369022    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369026    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369030    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369033    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369036    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369040    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369043    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369046    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369049    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369052    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369055    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369058    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 20:20:23.371532 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369061    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369064    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369067    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369071    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369074    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369077    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369079    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369082    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369085    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369088    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369091    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369099    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369101    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369104    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369107    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369110    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369113    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369116    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369119    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 20:20:23.372016 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369122    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369124    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369127    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369130    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369132    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369135    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369137    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369140    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369142    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369145    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369148    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369151    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369153    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369156    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369159    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369162    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369164    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369167    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369169    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369172    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 20:20:23.372511 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369174    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369177    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369179    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369182    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369185    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369193    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369196    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369198    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369201    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369204    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369207    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369209    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369212    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369214    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.369220    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 20:20:23.373013 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369378    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369383    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369386    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369389    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369392    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369395    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369398    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369401    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369404    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369409    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369412    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369415    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369418    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369421    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369424    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369426    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369429    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369432    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369435    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369438    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 20:20:23.373394 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369440    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369443    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369445    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369453    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369456    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369459    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369462    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369464    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369467    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369469    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369472    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369474    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369477    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369480    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369482    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369485    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369488    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369491    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369494    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369496    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 20:20:23.373894 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369499    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369502    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369505    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369507    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369510    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369513    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369517    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369520    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369523    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369525    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369528    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369531    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369533    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369536    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369538    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369541    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369549    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369558    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369560    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 20:20:23.374415 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369563    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369565    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369568    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369571    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369573    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369576    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369579    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369581    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369584    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369586    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369589    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369592    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369594    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369597    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369600    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369602    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369605    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369607    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369610    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369613    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 20:20:23.374886 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369615    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369618    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369621    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369624    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369628    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369631    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369633    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369636    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369638    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369641    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369650    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369652    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369655    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369657    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369660    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369663    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369665    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369668    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369670    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 20:20:23.375410 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:23.369673    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 20:20:23.375914 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.369678    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 20:20:23.375914 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.369830    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 20:20:23.375914 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.371934    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 20:20:23.375914 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.372906    2561 server.go:1019] "Starting client certificate rotation"
Sep 18 20:20:23.375914 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.373007    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 20:20:23.375914 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.373070    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 20:20:23.375914 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.375717    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 20:20:23.377153 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.377113    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 20:20:23.388196 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.388174    2561 log.go:25] "Validated CRI v1 runtime API"
Sep 18 20:20:23.390037 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.390024    2561 log.go:25] "Validated CRI v1 image API"
Sep 18 20:20:23.390913 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.390898    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 20:20:23.394075 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.394053    2561 fs.go:135] Filesystem UUIDs: map[0009174e-8853-4303-9ccf-22c3b7076608:/dev/nvme0n1p3 5b6ae51f-6853-476e-84b7-03b55d6a7962:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 18 20:20:23.394150 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.394075    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 20:20:23.400341 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.400194    2561 manager.go:216] Machine: {Timestamp:2026-09-18 20:20:23.399044021 +0000 UTC m=+0.304896502 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097657 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21cce49b202b8d3b6885ac607a4f62 SystemUUID:ec21cce4-9b20-2b8d-3b68-85ac607a4f62 BootID:9546ecc7-2e58-4af2-b54d-39d3d7c3bbec Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c0:26:2b:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c0:26:2b:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:b4:8a:86:83:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 20:20:23.400341 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.400330    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 20:20:23.400520 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.400454    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 20:20:23.400570 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.400550    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 20:20:23.402748 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.402724    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 20:20:23.402925 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.402752    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 20:20:23.404005 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.403992    2561 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 20:20:23.404061 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.404010    2561 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 20:20:23.404061 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.404022    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 20:20:23.404675 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.404664    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 20:20:23.404768 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.404758    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 20:20:23.408703 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.408689    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 20:20:23.408833 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.408822    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 20:20:23.408947 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.408863    2561 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 20:20:23.408947 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.408878    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 20:20:23.408947 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.408899    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 20:20:23.408947 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.408913    2561 kubelet.go:398] "Adding apiserver pod source"
Sep 18 20:20:23.408947 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.408926    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 20:20:23.409420 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.409368    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 20:20:23.409420 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.409398    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 20:20:23.413083 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.413058    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 20:20:23.415448 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.415433    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 20:20:23.415499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.415464    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 20:20:23.416469 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416458    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 20:20:23.416526 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416474    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 20:20:23.416526 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416481    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 20:20:23.416526 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416486    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 20:20:23.416526 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416495    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 20:20:23.416526 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416500    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 20:20:23.416526 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416513    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 20:20:23.416526 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416518    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 20:20:23.416719 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416533    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 20:20:23.416719 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416538    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 20:20:23.416719 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416547    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 20:20:23.416719 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.416552    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 20:20:23.417397 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.417374    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 20:20:23.417397 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.417376    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 20:20:23.417894 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.417877    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 20:20:23.417894 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.417892    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 20:20:23.420624 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.420608    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 20:20:23.421747 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.421726    2561 server.go:1268] "Started kubelet"
Sep 18 20:20:23.421839 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.421804    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 20:20:23.421943 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.421888    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 20:20:23.422021 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.421977    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 20:20:23.422649 ip-10-0-136-235 systemd[1]: Started Kubernetes Kubelet.
Sep 18 20:20:23.423615 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.423594    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 20:20:23.427706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.427693    2561 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 20:20:23.428942 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.428920    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-77bwl"
Sep 18 20:20:23.429897 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.429869    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 20:20:23.432011 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.431990    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 20:20:23.432496 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.432478    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 20:20:23.432656 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.432634    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:23.433177 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433152    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 20:20:23.433177 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433178    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 20:20:23.433303 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433151    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 20:20:23.433303 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433287    2561 factory.go:55] Registering systemd factory
Sep 18 20:20:23.433463 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433304    2561 factory.go:223] Registration of the systemd container factory successfully
Sep 18 20:20:23.433463 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433336    2561 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 20:20:23.433463 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433433    2561 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 20:20:23.433589 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433528    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-77bwl"
Sep 18 20:20:23.433646 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433615    2561 factory.go:153] Registering CRI-O factory
Sep 18 20:20:23.433686 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433651    2561 factory.go:223] Registration of the crio container factory successfully
Sep 18 20:20:23.433718 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433694    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 20:20:23.433718 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433715    2561 factory.go:103] Registering Raw factory
Sep 18 20:20:23.433775 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.433733    2561 manager.go:1196] Started watching for new ooms in manager
Sep 18 20:20:23.434034 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.434022    2561 manager.go:349] Starting recovery of all containers
Sep 18 20:20:23.442221 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.442201    2561 manager.go:354] Recovery completed
Sep 18 20:20:23.444008 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.443976    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 20:20:23.444117 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.444060    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 20:20:23.446070 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.443975    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-235.ec2.internal.18d683ce2a3fe78c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-235.ec2.internal,UID:ip-10-0-136-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-235.ec2.internal,},FirstTimestamp:2026-09-18 20:20:23.421683596 +0000 UTC m=+0.327536076,LastTimestamp:2026-09-18 20:20:23.421683596 +0000 UTC m=+0.327536076,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-235.ec2.internal,}"
Sep 18 20:20:23.446764 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.446750    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 20:20:23.448758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.448739    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 20:20:23.448833 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.448777    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 20:20:23.448833 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.448792    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID"
Sep 18 20:20:23.449433 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.449419    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 20:20:23.449433 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.449429    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 20:20:23.449551 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.449432    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 20:20:23.449551 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.449485    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 20:20:23.450271 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.450255    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 20:20:23.450365 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.450280    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 20:20:23.450365 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.450290    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID"
Sep 18 20:20:23.530158 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.530119    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 20:20:23.594758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.531287    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 20:20:23.594758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.531348    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 20:20:23.594758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.531374    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 20:20:23.594758 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.531465    2561 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 18 20:20:23.594758 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.532706    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:23.594758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.534070    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 20:20:23.594758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.593907    2561 policy_none.go:49] "None policy: Start"
Sep 18 20:20:23.594758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.593941    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 20:20:23.594758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.593954    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 20:20:23.596219 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.596205    2561 policy_none.go:47] "Start"
Sep 18 20:20:23.624034 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.624012    2561 manager.go:337] "Starting Device Plugin manager"
Sep 18 20:20:23.624156 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.624059    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 20:20:23.624156 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.624070    2561 server.go:87] "Starting device plugin registration server"
Sep 18 20:20:23.624434 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.624424    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 20:20:23.624491 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.624439    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 20:20:23.624576 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.624557    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 20:20:23.624677 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.624659    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 20:20:23.624677 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.624674    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 20:20:23.627270 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.627247    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 20:20:23.627415 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.627302    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:23.632528 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.632505    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal"]
Sep 18 20:20:23.632630 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.632575    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 20:20:23.633967 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.633945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6736d619582edd8e67630758fafe1005-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"6736d619582edd8e67630758fafe1005\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.634059 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.633976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6736d619582edd8e67630758fafe1005-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"6736d619582edd8e67630758fafe1005\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.634059 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.634031    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 20:20:23.634162 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.634065    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 20:20:23.634162 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.634080    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID"
Sep 18 20:20:23.636436 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.636420    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 20:20:23.636569 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.636551    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.636619 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.636590    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 20:20:23.637203 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.637189    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 20:20:23.637277 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.637217    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 20:20:23.637277 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.637227    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID"
Sep 18 20:20:23.637277 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.637192    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 20:20:23.637407 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.637296    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 20:20:23.637407 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.637310    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID"
Sep 18 20:20:23.639420 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.639404    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.639500 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.639430    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 20:20:23.640144 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.640127    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 20:20:23.640236 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.640155    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 20:20:23.640236 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.640169    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID"
Sep 18 20:20:23.650588 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.650569    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-235.ec2.internal\" not found" node="ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.663097 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.663071    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-235.ec2.internal\" not found" node="ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.667567 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.667550    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-235.ec2.internal\" not found" node="ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.724630 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.724602    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 20:20:23.725685 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.725659    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 20:20:23.725802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.725696    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 20:20:23.725802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.725708    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeHasSufficientPID"
Sep 18 20:20:23.725802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.725735    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.734195 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.734176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6736d619582edd8e67630758fafe1005-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"6736d619582edd8e67630758fafe1005\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.734292 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.734207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6736d619582edd8e67630758fafe1005-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"6736d619582edd8e67630758fafe1005\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.734377 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.734289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6736d619582edd8e67630758fafe1005-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"6736d619582edd8e67630758fafe1005\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.734377 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.734289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6736d619582edd8e67630758fafe1005-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal\" (UID: \"6736d619582edd8e67630758fafe1005\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.739298 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.739283    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.739357 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.739309    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-235.ec2.internal\": node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:23.761259 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.761224    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:23.834636 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.834582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44f943e00746b4df90253a3c1d6c9471-config\") pod \"kube-apiserver-proxy-ip-10-0-136-235.ec2.internal\" (UID: \"44f943e00746b4df90253a3c1d6c9471\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.861812 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.861740    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:23.935431 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.935398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44f943e00746b4df90253a3c1d6c9471-config\") pod \"kube-apiserver-proxy-ip-10-0-136-235.ec2.internal\" (UID: \"44f943e00746b4df90253a3c1d6c9471\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.935567 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.935473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44f943e00746b4df90253a3c1d6c9471-config\") pod \"kube-apiserver-proxy-ip-10-0-136-235.ec2.internal\" (UID: \"44f943e00746b4df90253a3c1d6c9471\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.962569 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:23.962532    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:23.966709 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.966690    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:23.970847 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:23.970823    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:25.365254 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:25.365211    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:25.465790 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:25.465702    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:25.566278 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:25.566241    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:25.666786 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:25.666751    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:25.674931 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:25.674906    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 20:20:25.675086 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:25.675069    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 20:20:25.740687 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:25.740645    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 20:15:24 +0000 UTC" deadline="2028-03-04 11:04:22.927146683 +0000 UTC"
Sep 18 20:20:25.740687 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:25.740681    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12782h43m57.186468434s"
Sep 18 20:20:25.767673 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:25.767646    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:25.855623 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:25.855581    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f943e00746b4df90253a3c1d6c9471.slice/crio-2758dafc67069fd87a4e2f642717abffe272b51db232b75116b486c04c8ca4a0 WatchSource:0}: Error finding container 2758dafc67069fd87a4e2f642717abffe272b51db232b75116b486c04c8ca4a0: Status 404 returned error can't find the container with id 2758dafc67069fd87a4e2f642717abffe272b51db232b75116b486c04c8ca4a0
Sep 18 20:20:25.855885 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:25.855864    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6736d619582edd8e67630758fafe1005.slice/crio-8d6495f39467414bfddc91eafa73ac8bf5d33f3115663beeceacb5d39e54b8ac WatchSource:0}: Error finding container 8d6495f39467414bfddc91eafa73ac8bf5d33f3115663beeceacb5d39e54b8ac: Status 404 returned error can't find the container with id 8d6495f39467414bfddc91eafa73ac8bf5d33f3115663beeceacb5d39e54b8ac
Sep 18 20:20:25.863512 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:25.863494    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 20:20:25.868190 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:25.868173    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:25.969151 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:25.969109    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:26.069692 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.069611    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-235.ec2.internal\" not found"
Sep 18 20:20:26.138781 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.138751    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 20:20:26.234390 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.234361    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:26.238364 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.238334    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 20:20:26.245725 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.245703    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 20:20:26.246770 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.246748    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal"
Sep 18 20:20:26.257191 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.257158    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 20:20:26.326406 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.326319    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 20:20:26.711692 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.711616    2561 apiserver.go:52] "Watching apiserver"
Sep 18 20:20:26.722374 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.722346    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 20:20:26.722731 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.722698    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-5878l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal","openshift-multus/multus-additional-cni-plugins-t9qjz","openshift-multus/multus-jpmmv","openshift-ovn-kubernetes/ovnkube-node-bfsh2","kube-system/global-pull-secret-syncer-4l4bl","kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp","openshift-dns/node-resolver-q24cm","openshift-image-registry/node-ca-z94b2","openshift-multus/network-metrics-daemon-84j95","openshift-network-diagnostics/network-check-target-5b59g","openshift-network-operator/iptables-alerter-fq2ll","kube-system/konnectivity-agent-ffdj8"]
Sep 18 20:20:26.725204 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.725182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.727353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.727333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.727946 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.727924    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 20:20:26.728069 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.727956    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 20:20:26.728069 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.727963    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mmwjw\""
Sep 18 20:20:26.728225 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.728206    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 20:20:26.729275 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.729256    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 20:20:26.729544 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.729404    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 20:20:26.729544 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.729475    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 20:20:26.729681 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.729575    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cph4m\""
Sep 18 20:20:26.729736 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.729717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.731426 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.731408    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 20:20:26.731564 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.731543    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dskct\""
Sep 18 20:20:26.731895 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.731875    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 20:20:26.731895 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.731891    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 20:20:26.732141 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.732128    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 20:20:26.732212 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.732129    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 20:20:26.732558 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.732540    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.733838 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.733818    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 20:20:26.734378 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.734282    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 20:20:26.734531 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.734517    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l49cp\""
Sep 18 20:20:26.734889 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.734872    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.736723 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.736703    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vcv59\""
Sep 18 20:20:26.736806 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.736707    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 20:20:26.736865 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.736812    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 20:20:26.737124 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.737097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 20:20:26.737297 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.737184    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 20:20:26.737377 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.737341    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 20:20:26.737427 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.737417    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 20:20:26.737577 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.737557    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:26.737668 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.737635    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:26.739909 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.739888    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.741800 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.741780    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 20:20:26.741800 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.741780    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sfhnx\""
Sep 18 20:20:26.742336 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.742082    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 20:20:26.742514 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.742377    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:26.744206 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.744188    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 20:20:26.744343 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.744317    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sm4r4\""
Sep 18 20:20:26.744588 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.744431    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 20:20:26.745027 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.744986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.745358 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.745336    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 20:20:26.746612 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746578    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-cni-netd\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.746719 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a99f3975-9435-41dc-b6ba-ba6368dabf2e-ovn-node-metrics-cert\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.746719 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4abd2472-d1ce-46a6-9a61-10c40afc1839-serviceca\") pod \"node-ca-z94b2\" (UID: \"4abd2472-d1ce-46a6-9a61-10c40afc1839\") " pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.746719 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746687    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 20:20:26.746719 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746712    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55add1d8-b559-4fdd-a1b0-826dce56a516-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.747041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746726    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 20:20:26.747041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-hostroot\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.747041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746781    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 20:20:26.747041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcd4n\" (UniqueName: \"kubernetes.io/projected/dbffc223-931d-49e0-963a-6f8e3da5e44d-kube-api-access-jcd4n\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.747041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-kubelet\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.747041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a99f3975-9435-41dc-b6ba-ba6368dabf2e-ovnkube-config\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.747041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a99f3975-9435-41dc-b6ba-ba6368dabf2e-ovnkube-script-lib\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.747041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.747001    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n98ss\""
Sep 18 20:20:26.747404 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.746984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wvh7\" (UniqueName: \"kubernetes.io/projected/4abd2472-d1ce-46a6-9a61-10c40afc1839-kube-api-access-9wvh7\") pod \"node-ca-z94b2\" (UID: \"4abd2472-d1ce-46a6-9a61-10c40afc1839\") " pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.747404 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.747083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55add1d8-b559-4fdd-a1b0-826dce56a516-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.747404 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.747106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-cni-dir\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.747404 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.747131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-var-lib-cni-multus\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.747404 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.747153    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-run-systemd\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.747404 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.747188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9glw9\" (UniqueName: \"kubernetes.io/projected/a99f3975-9435-41dc-b6ba-ba6368dabf2e-kube-api-access-9glw9\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.747404 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.747211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20943fec-278e-4c96-8729-0309298862e5-dbus\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:26.748607 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.748045    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.748840 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.748796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-system-cni-dir\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.748920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.748873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbffc223-931d-49e0-963a-6f8e3da5e44d-cni-binary-copy\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.748920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.748913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-run-openvswitch\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.749065 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.748944    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20943fec-278e-4c96-8729-0309298862e5-kubelet-config\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:26.749065 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4abd2472-d1ce-46a6-9a61-10c40afc1839-host\") pod \"node-ca-z94b2\" (UID: \"4abd2472-d1ce-46a6-9a61-10c40afc1839\") " pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.749065 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749049    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ebc4418-54be-4583-8d56-2cad39923c56-host-slash\") pod \"iptables-alerter-fq2ll\" (UID: \"4ebc4418-54be-4583-8d56-2cad39923c56\") " pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.749262 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749089    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55add1d8-b559-4fdd-a1b0-826dce56a516-system-cni-dir\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.749262 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55add1d8-b559-4fdd-a1b0-826dce56a516-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.749262 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-socket-dir-parent\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.749262 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-var-lib-cni-bin\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.749262 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-slash\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.749502 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fpb8\" (UniqueName: \"kubernetes.io/projected/55add1d8-b559-4fdd-a1b0-826dce56a516-kube-api-access-4fpb8\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.749502 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749298    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-run-netns\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.749502 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-systemd-units\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.749502 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-run-netns\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.749502 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-var-lib-openvswitch\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.749502 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-etc-openvswitch\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.749786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-node-log\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.749786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:26.749786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvh5d\" (UniqueName: \"kubernetes.io/projected/4ebc4418-54be-4583-8d56-2cad39923c56-kube-api-access-nvh5d\") pod \"iptables-alerter-fq2ll\" (UID: \"4ebc4418-54be-4583-8d56-2cad39923c56\") " pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.749786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-cnibin\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.749786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-var-lib-kubelet\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.749786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-conf-dir\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.749786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-daemon-config\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.749786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-run-multus-certs\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.749786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749784    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ebc4418-54be-4583-8d56-2cad39923c56-iptables-alerter-script\") pod \"iptables-alerter-fq2ll\" (UID: \"4ebc4418-54be-4583-8d56-2cad39923c56\") " pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55add1d8-b559-4fdd-a1b0-826dce56a516-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-run-k8s-cni-cncf-io\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-cni-bin\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.749946    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.750018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a99f3975-9435-41dc-b6ba-ba6368dabf2e-env-overrides\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.750059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55add1d8-b559-4fdd-a1b0-826dce56a516-cnibin\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.750093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-etc-kubernetes\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.750123    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-run-ovn\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.750211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.750158    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-log-socket\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.751353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.751276    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 20:20:26.751636 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.751617    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 20:20:26.751867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.751848    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tb9f9\""
Sep 18 20:20:26.752850 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.752167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:26.752850 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.752240    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:26.754418 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.754377    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:26.754510 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.754444    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:26.764414 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.764389    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sjv4p"
Sep 18 20:20:26.771093 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.771067    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sjv4p"
Sep 18 20:20:26.836032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.836003    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 20:20:26.838184 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.838134    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" event={"ID":"6736d619582edd8e67630758fafe1005","Type":"ContainerStarted","Data":"8d6495f39467414bfddc91eafa73ac8bf5d33f3115663beeceacb5d39e54b8ac"}
Sep 18 20:20:26.839285 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.839251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" event={"ID":"44f943e00746b4df90253a3c1d6c9471","Type":"ContainerStarted","Data":"2758dafc67069fd87a4e2f642717abffe272b51db232b75116b486c04c8ca4a0"}
Sep 18 20:20:26.850633 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-kubernetes\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.850782 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-tmp\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.850782 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4abd2472-d1ce-46a6-9a61-10c40afc1839-host\") pod \"node-ca-z94b2\" (UID: \"4abd2472-d1ce-46a6-9a61-10c40afc1839\") " pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.850782 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850736    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4abd2472-d1ce-46a6-9a61-10c40afc1839-host\") pod \"node-ca-z94b2\" (UID: \"4abd2472-d1ce-46a6-9a61-10c40afc1839\") " pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.850782 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55add1d8-b559-4fdd-a1b0-826dce56a516-system-cni-dir\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850789    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55add1d8-b559-4fdd-a1b0-826dce56a516-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-socket-dir-parent\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850827    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55add1d8-b559-4fdd-a1b0-826dce56a516-system-cni-dir\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-slash\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850877    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-slash\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-run-netns\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850908    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-run-netns\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-sysconfig\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850919    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-socket-dir-parent\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-run-netns\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850975    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-log-socket\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.850979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-run-netns\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-systemd\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851046    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-lib-modules\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851050    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-log-socket\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a99f3975-9435-41dc-b6ba-ba6368dabf2e-ovnkube-script-lib\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvh5d\" (UniqueName: \"kubernetes.io/projected/4ebc4418-54be-4583-8d56-2cad39923c56-kube-api-access-nvh5d\") pod \"iptables-alerter-fq2ll\" (UID: \"4ebc4418-54be-4583-8d56-2cad39923c56\") " pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-cnibin\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851162    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-var-lib-kubelet\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-conf-dir\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-run-multus-certs\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-cni-bin\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851288    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-cni-bin\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-cnibin\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ebc4418-54be-4583-8d56-2cad39923c56-iptables-alerter-script\") pod \"iptables-alerter-fq2ll\" (UID: \"4ebc4418-54be-4583-8d56-2cad39923c56\") " pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851355    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-run-multus-certs\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851369    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-var-lib-kubelet\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-device-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.851613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851416    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-sys-fs\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/55add1d8-b559-4fdd-a1b0-826dce56a516-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-host\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-etc-kubernetes\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-run-ovn\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-etc-kubernetes\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851617    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-run-ovn\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a99f3975-9435-41dc-b6ba-ba6368dabf2e-ovn-node-metrics-cert\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-run\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4abd2472-d1ce-46a6-9a61-10c40afc1839-serviceca\") pod \"node-ca-z94b2\" (UID: \"4abd2472-d1ce-46a6-9a61-10c40afc1839\") " pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55add1d8-b559-4fdd-a1b0-826dce56a516-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-hostroot\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-kubelet\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a99f3975-9435-41dc-b6ba-ba6368dabf2e-ovnkube-config\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-sysctl-d\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:26.852367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wvh7\" (UniqueName: \"kubernetes.io/projected/4abd2472-d1ce-46a6-9a61-10c40afc1839-kube-api-access-9wvh7\") pod \"node-ca-z94b2\" (UID: \"4abd2472-d1ce-46a6-9a61-10c40afc1839\") " pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55add1d8-b559-4fdd-a1b0-826dce56a516-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851950    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ebc4418-54be-4583-8d56-2cad39923c56-iptables-alerter-script\") pod \"iptables-alerter-fq2ll\" (UID: \"4ebc4418-54be-4583-8d56-2cad39923c56\") " pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-run-systemd\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20943fec-278e-4c96-8729-0309298862e5-dbus\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbffc223-931d-49e0-963a-6f8e3da5e44d-cni-binary-copy\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852077    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-run-openvswitch\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc-konnectivity-ca\") pod \"konnectivity-agent-ffdj8\" (UID: \"b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc\") " pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-sys\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20943fec-278e-4c96-8729-0309298862e5-kubelet-config\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852164    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a99f3975-9435-41dc-b6ba-ba6368dabf2e-ovnkube-script-lib\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852198    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ebc4418-54be-4583-8d56-2cad39923c56-host-slash\") pod \"iptables-alerter-fq2ll\" (UID: \"4ebc4418-54be-4583-8d56-2cad39923c56\") " pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.851741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-conf-dir\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852224    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-hostroot\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852228    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4abd2472-d1ce-46a6-9a61-10c40afc1839-serviceca\") pod \"node-ca-z94b2\" (UID: \"4abd2472-d1ce-46a6-9a61-10c40afc1839\") " pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-var-lib-cni-bin\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852249    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852262    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-var-lib-cni-bin\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.853174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-etc-openvswitch\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8de51077-e633-44cc-a1da-94c9e2c0139c-tmp-dir\") pod \"node-resolver-q24cm\" (UID: \"8de51077-e633-44cc-a1da-94c9e2c0139c\") " pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-socket-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852332    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-etc-openvswitch\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852342    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-registration-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852330    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55add1d8-b559-4fdd-a1b0-826dce56a516-cni-binary-copy\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20943fec-278e-4c96-8729-0309298862e5-dbus\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852316    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-run-systemd\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-kubelet\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852376    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fpb8\" (UniqueName: \"kubernetes.io/projected/55add1d8-b559-4fdd-a1b0-826dce56a516-kube-api-access-4fpb8\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-systemd-units\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a99f3975-9435-41dc-b6ba-ba6368dabf2e-ovnkube-config\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55add1d8-b559-4fdd-a1b0-826dce56a516-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852543    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ebc4418-54be-4583-8d56-2cad39923c56-host-slash\") pod \"iptables-alerter-fq2ll\" (UID: \"4ebc4418-54be-4583-8d56-2cad39923c56\") " pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852558    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-systemd-units\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-run-openvswitch\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20943fec-278e-4c96-8729-0309298862e5-kubelet-config\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:26.854025 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852632    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-var-lib-openvswitch\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852658    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-node-log\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzplg\" (UniqueName: \"kubernetes.io/projected/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-kube-api-access-fzplg\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-var-lib-openvswitch\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852714    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-node-log\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-daemon-config\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-etc-selinux\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852785    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbffc223-931d-49e0-963a-6f8e3da5e44d-cni-binary-copy\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.852795    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-sysctl-conf\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.852891    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret podName:20943fec-278e-4c96-8729-0309298862e5 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:27.352852049 +0000 UTC m=+2.957030374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret") pod "global-pull-secret-syncer-4l4bl" (UID: "20943fec-278e-4c96-8729-0309298862e5") : object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-tuned\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59tg4\" (UniqueName: \"kubernetes.io/projected/018cb5c7-0ac8-4eea-9866-5611fe0b7644-kube-api-access-59tg4\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:26.854867 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.852973    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55add1d8-b559-4fdd-a1b0-826dce56a516-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-run-k8s-cni-cncf-io\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a99f3975-9435-41dc-b6ba-ba6368dabf2e-env-overrides\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853065    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-modprobe-d\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-run-k8s-cni-cncf-io\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853090    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-var-lib-kubelet\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55add1d8-b559-4fdd-a1b0-826dce56a516-cnibin\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-cni-netd\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853192    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcd4n\" (UniqueName: \"kubernetes.io/projected/dbffc223-931d-49e0-963a-6f8e3da5e44d-kube-api-access-jcd4n\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc-agent-certs\") pod \"konnectivity-agent-ffdj8\" (UID: \"b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc\") " pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-daemon-config\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgtkk\" (UniqueName: \"kubernetes.io/projected/b7301a41-9314-4033-98b1-a75fecb0032f-kube-api-access-mgtkk\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853233    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a99f3975-9435-41dc-b6ba-ba6368dabf2e-host-cni-netd\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55add1d8-b559-4fdd-a1b0-826dce56a516-cnibin\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-cni-dir\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-var-lib-cni-multus\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.855637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-host-var-lib-cni-multus\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-multus-cni-dir\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9glw9\" (UniqueName: \"kubernetes.io/projected/a99f3975-9435-41dc-b6ba-ba6368dabf2e-kube-api-access-9glw9\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-system-cni-dir\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853427    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a99f3975-9435-41dc-b6ba-ba6368dabf2e-env-overrides\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853438    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853442    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/55add1d8-b559-4fdd-a1b0-826dce56a516-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8de51077-e633-44cc-a1da-94c9e2c0139c-hosts-file\") pod \"node-resolver-q24cm\" (UID: \"8de51077-e633-44cc-a1da-94c9e2c0139c\") " pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tlkd\" (UniqueName: \"kubernetes.io/projected/8de51077-e633-44cc-a1da-94c9e2c0139c-kube-api-access-4tlkd\") pod \"node-resolver-q24cm\" (UID: \"8de51077-e633-44cc-a1da-94c9e2c0139c\") " pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.853599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbffc223-931d-49e0-963a-6f8e3da5e44d-system-cni-dir\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.856499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.856479    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a99f3975-9435-41dc-b6ba-ba6368dabf2e-ovn-node-metrics-cert\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.860957 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.860923    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvh5d\" (UniqueName: \"kubernetes.io/projected/4ebc4418-54be-4583-8d56-2cad39923c56-kube-api-access-nvh5d\") pod \"iptables-alerter-fq2ll\" (UID: \"4ebc4418-54be-4583-8d56-2cad39923c56\") " pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:26.861525 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.861504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wvh7\" (UniqueName: \"kubernetes.io/projected/4abd2472-d1ce-46a6-9a61-10c40afc1839-kube-api-access-9wvh7\") pod \"node-ca-z94b2\" (UID: \"4abd2472-d1ce-46a6-9a61-10c40afc1839\") " pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:26.861747 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.861682    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9glw9\" (UniqueName: \"kubernetes.io/projected/a99f3975-9435-41dc-b6ba-ba6368dabf2e-kube-api-access-9glw9\") pod \"ovnkube-node-bfsh2\" (UID: \"a99f3975-9435-41dc-b6ba-ba6368dabf2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:26.862049 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.862033    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcd4n\" (UniqueName: \"kubernetes.io/projected/dbffc223-931d-49e0-963a-6f8e3da5e44d-kube-api-access-jcd4n\") pod \"multus-jpmmv\" (UID: \"dbffc223-931d-49e0-963a-6f8e3da5e44d\") " pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:26.862163 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.862144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fpb8\" (UniqueName: \"kubernetes.io/projected/55add1d8-b559-4fdd-a1b0-826dce56a516-kube-api-access-4fpb8\") pod \"multus-additional-cni-plugins-t9qjz\" (UID: \"55add1d8-b559-4fdd-a1b0-826dce56a516\") " pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:26.954106 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-device-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954106 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-sys-fs\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954128    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-host\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-run\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-sysctl-d\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954200    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc-konnectivity-ca\") pod \"konnectivity-agent-ffdj8\" (UID: \"b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc\") " pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954225    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-sys-fs\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-sys\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954225    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-device-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-run\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-sys\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954306    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-host\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954346 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.954330    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.954409    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs podName:018cb5c7-0ac8-4eea-9866-5611fe0b7644 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:27.454386646 +0000 UTC m=+3.058564986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs") pod "network-metrics-daemon-84j95" (UID: "018cb5c7-0ac8-4eea-9866-5611fe0b7644") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954410    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-sysctl-d\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8de51077-e633-44cc-a1da-94c9e2c0139c-tmp-dir\") pod \"node-resolver-q24cm\" (UID: \"8de51077-e633-44cc-a1da-94c9e2c0139c\") " pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-socket-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-registration-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzplg\" (UniqueName: \"kubernetes.io/projected/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-kube-api-access-fzplg\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954580    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-registration-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954635    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-etc-selinux\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-socket-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-sysctl-conf\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-tuned\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8de51077-e633-44cc-a1da-94c9e2c0139c-tmp-dir\") pod \"node-resolver-q24cm\" (UID: \"8de51077-e633-44cc-a1da-94c9e2c0139c\") " pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59tg4\" (UniqueName: \"kubernetes.io/projected/018cb5c7-0ac8-4eea-9866-5611fe0b7644-kube-api-access-59tg4\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-etc-selinux\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-modprobe-d\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.954920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954765    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-sysctl-conf\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-var-lib-kubelet\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954823    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-modprobe-d\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc-agent-certs\") pod \"konnectivity-agent-ffdj8\" (UID: \"b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc\") " pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b7301a41-9314-4033-98b1-a75fecb0032f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgtkk\" (UniqueName: \"kubernetes.io/projected/b7301a41-9314-4033-98b1-a75fecb0032f-kube-api-access-mgtkk\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc-konnectivity-ca\") pod \"konnectivity-agent-ffdj8\" (UID: \"b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc\") " pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954875    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-var-lib-kubelet\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8de51077-e633-44cc-a1da-94c9e2c0139c-hosts-file\") pod \"node-resolver-q24cm\" (UID: \"8de51077-e633-44cc-a1da-94c9e2c0139c\") " pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tlkd\" (UniqueName: \"kubernetes.io/projected/8de51077-e633-44cc-a1da-94c9e2c0139c-kube-api-access-4tlkd\") pod \"node-resolver-q24cm\" (UID: \"8de51077-e633-44cc-a1da-94c9e2c0139c\") " pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.954979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-kubernetes\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.955004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8de51077-e633-44cc-a1da-94c9e2c0139c-hosts-file\") pod \"node-resolver-q24cm\" (UID: \"8de51077-e633-44cc-a1da-94c9e2c0139c\") " pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.955039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-tmp\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.955055    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-kubernetes\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.955070    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-sysconfig\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.955706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.955097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-systemd\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.956298 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.955142    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-systemd\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.956298 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.955159    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-sysconfig\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.956298 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.955194    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-lib-modules\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.956298 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.955307    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-lib-modules\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.957265 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.957244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-etc-tuned\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.957359 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.957272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-tmp\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.957541 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.957521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc-agent-certs\") pod \"konnectivity-agent-ffdj8\" (UID: \"b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc\") " pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:26.962851 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.962538    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 20:20:26.962851 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.962566    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 20:20:26.962851 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.962579    2561 projected.go:196] Error preparing data for projected volume kube-api-access-6nkj8 for pod openshift-network-diagnostics/network-check-target-5b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:26.962851 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:26.962652    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8 podName:3fafbef2-fe0c-4220-a499-d703aa74bb7c nodeName:}" failed. No retries permitted until 2026-09-18 20:20:27.462632741 +0000 UTC m=+3.066811084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkj8" (UniqueName: "kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8") pod "network-check-target-5b59g" (UID: "3fafbef2-fe0c-4220-a499-d703aa74bb7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:26.964762 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.964735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzplg\" (UniqueName: \"kubernetes.io/projected/bc26bf29-f99a-4f12-976f-a0bbbbf432ca-kube-api-access-fzplg\") pod \"tuned-5878l\" (UID: \"bc26bf29-f99a-4f12-976f-a0bbbbf432ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:26.964986 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.964959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tlkd\" (UniqueName: \"kubernetes.io/projected/8de51077-e633-44cc-a1da-94c9e2c0139c-kube-api-access-4tlkd\") pod \"node-resolver-q24cm\" (UID: \"8de51077-e633-44cc-a1da-94c9e2c0139c\") " pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:26.965191 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.965169    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgtkk\" (UniqueName: \"kubernetes.io/projected/b7301a41-9314-4033-98b1-a75fecb0032f-kube-api-access-mgtkk\") pod \"aws-ebs-csi-driver-node-t26xp\" (UID: \"b7301a41-9314-4033-98b1-a75fecb0032f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:26.965566 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:26.965545    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59tg4\" (UniqueName: \"kubernetes.io/projected/018cb5c7-0ac8-4eea-9866-5611fe0b7644-kube-api-access-59tg4\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:27.038004 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.037958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z94b2"
Sep 18 20:20:27.048811 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.048787    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fq2ll"
Sep 18 20:20:27.055793 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.055762    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t9qjz"
Sep 18 20:20:27.061737 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.061718    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jpmmv"
Sep 18 20:20:27.067814 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.067792    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:27.074785 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.074766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q24cm"
Sep 18 20:20:27.080822 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.080801    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:27.086936 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.086910    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp"
Sep 18 20:20:27.092748 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.092724    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5878l"
Sep 18 20:20:27.099795 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.099775    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 20:20:27.357935 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.357855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:27.358074 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:27.357977    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:27.358074 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:27.358045    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret podName:20943fec-278e-4c96-8729-0309298862e5 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:28.358032333 +0000 UTC m=+3.962210661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret") pod "global-pull-secret-syncer-4l4bl" (UID: "20943fec-278e-4c96-8729-0309298862e5") : object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:27.458550 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.458511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:27.458740 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:27.458678    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:27.458798 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:27.458745    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs podName:018cb5c7-0ac8-4eea-9866-5611fe0b7644 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:28.458731069 +0000 UTC m=+4.062909392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs") pod "network-metrics-daemon-84j95" (UID: "018cb5c7-0ac8-4eea-9866-5611fe0b7644") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:27.559421 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.559385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:27.559612 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:27.559590    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 20:20:27.559685 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:27.559625    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 20:20:27.559685 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:27.559639    2561 projected.go:196] Error preparing data for projected volume kube-api-access-6nkj8 for pod openshift-network-diagnostics/network-check-target-5b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:27.559765 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:27.559701    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8 podName:3fafbef2-fe0c-4220-a499-d703aa74bb7c nodeName:}" failed. No retries permitted until 2026-09-18 20:20:28.559681869 +0000 UTC m=+4.163860196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkj8" (UniqueName: "kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8") pod "network-check-target-5b59g" (UID: "3fafbef2-fe0c-4220-a499-d703aa74bb7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:27.703649 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:27.703421    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de51077_e633_44cc_a1da_94c9e2c0139c.slice/crio-dc6850826c19f4a651747952e925ae0e3c205846673bf318c70c475d5818172f WatchSource:0}: Error finding container dc6850826c19f4a651747952e925ae0e3c205846673bf318c70c475d5818172f: Status 404 returned error can't find the container with id dc6850826c19f4a651747952e925ae0e3c205846673bf318c70c475d5818172f
Sep 18 20:20:27.704773 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:27.704719    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abd2472_d1ce_46a6_9a61_10c40afc1839.slice/crio-56ba44864024228c84c97cee8b41c80ecec08c51c637fd4369c8450f912aa707 WatchSource:0}: Error finding container 56ba44864024228c84c97cee8b41c80ecec08c51c637fd4369c8450f912aa707: Status 404 returned error can't find the container with id 56ba44864024228c84c97cee8b41c80ecec08c51c637fd4369c8450f912aa707
Sep 18 20:20:27.705929 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:27.705881    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7301a41_9314_4033_98b1_a75fecb0032f.slice/crio-ffe0e867f4c65a254133b7f2793c751d80efe4aa50001f6fbee0da0202f3c694 WatchSource:0}: Error finding container ffe0e867f4c65a254133b7f2793c751d80efe4aa50001f6fbee0da0202f3c694: Status 404 returned error can't find the container with id ffe0e867f4c65a254133b7f2793c751d80efe4aa50001f6fbee0da0202f3c694
Sep 18 20:20:27.706815 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:27.706681    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc26bf29_f99a_4f12_976f_a0bbbbf432ca.slice/crio-5ec869d06949681e6ed88e483c1ffeb214e07962d018ebeaa91840b6c1c37643 WatchSource:0}: Error finding container 5ec869d06949681e6ed88e483c1ffeb214e07962d018ebeaa91840b6c1c37643: Status 404 returned error can't find the container with id 5ec869d06949681e6ed88e483c1ffeb214e07962d018ebeaa91840b6c1c37643
Sep 18 20:20:27.708059 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:27.707665    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55add1d8_b559_4fdd_a1b0_826dce56a516.slice/crio-ca3c87614ddbe92c6cf2700a6b99073406e50c3e1233c10267a87ab1000a6c35 WatchSource:0}: Error finding container ca3c87614ddbe92c6cf2700a6b99073406e50c3e1233c10267a87ab1000a6c35: Status 404 returned error can't find the container with id ca3c87614ddbe92c6cf2700a6b99073406e50c3e1233c10267a87ab1000a6c35
Sep 18 20:20:27.708664 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:27.708495    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbffc223_931d_49e0_963a_6f8e3da5e44d.slice/crio-1e414bfc25385ba00e164bd0c624c182c94ece7e0e4e3d4ec03e024a72c74f8c WatchSource:0}: Error finding container 1e414bfc25385ba00e164bd0c624c182c94ece7e0e4e3d4ec03e024a72c74f8c: Status 404 returned error can't find the container with id 1e414bfc25385ba00e164bd0c624c182c94ece7e0e4e3d4ec03e024a72c74f8c
Sep 18 20:20:27.710958 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:27.710171    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebc4418_54be_4583_8d56_2cad39923c56.slice/crio-dce69bd0e7fc960725341e7154c5a408d4ecfb76c1d418c87a93c30ec75859c5 WatchSource:0}: Error finding container dce69bd0e7fc960725341e7154c5a408d4ecfb76c1d418c87a93c30ec75859c5: Status 404 returned error can't find the container with id dce69bd0e7fc960725341e7154c5a408d4ecfb76c1d418c87a93c30ec75859c5
Sep 18 20:20:27.774601 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.774542    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 20:15:26 +0000 UTC" deadline="2028-04-06 13:34:56.031109119 +0000 UTC"
Sep 18 20:20:27.774601 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.774578    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13577h14m28.256538244s"
Sep 18 20:20:27.842350 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.842309    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp" event={"ID":"b7301a41-9314-4033-98b1-a75fecb0032f","Type":"ContainerStarted","Data":"ffe0e867f4c65a254133b7f2793c751d80efe4aa50001f6fbee0da0202f3c694"}
Sep 18 20:20:27.843511 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.843485    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z94b2" event={"ID":"4abd2472-d1ce-46a6-9a61-10c40afc1839","Type":"ContainerStarted","Data":"56ba44864024228c84c97cee8b41c80ecec08c51c637fd4369c8450f912aa707"}
Sep 18 20:20:27.844711 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.844672    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" event={"ID":"a99f3975-9435-41dc-b6ba-ba6368dabf2e","Type":"ContainerStarted","Data":"9fcefcc7fdc5e53fc7923c3a73135f0cc8381ac00d140d3703e134921292a3f2"}
Sep 18 20:20:27.845771 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.845746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jpmmv" event={"ID":"dbffc223-931d-49e0-963a-6f8e3da5e44d","Type":"ContainerStarted","Data":"1e414bfc25385ba00e164bd0c624c182c94ece7e0e4e3d4ec03e024a72c74f8c"}
Sep 18 20:20:27.846976 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.846914    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5878l" event={"ID":"bc26bf29-f99a-4f12-976f-a0bbbbf432ca","Type":"ContainerStarted","Data":"5ec869d06949681e6ed88e483c1ffeb214e07962d018ebeaa91840b6c1c37643"}
Sep 18 20:20:27.848252 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.848229    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q24cm" event={"ID":"8de51077-e633-44cc-a1da-94c9e2c0139c","Type":"ContainerStarted","Data":"dc6850826c19f4a651747952e925ae0e3c205846673bf318c70c475d5818172f"}
Sep 18 20:20:27.850164 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.850143    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" event={"ID":"44f943e00746b4df90253a3c1d6c9471","Type":"ContainerStarted","Data":"fd06039e6d41ce2e915de97b4fbec651d7aa34230862d6f47845b93265b1529b"}
Sep 18 20:20:27.851274 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.851249    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ffdj8" event={"ID":"b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc","Type":"ContainerStarted","Data":"874c4e3f50995b73e5c3f177e907094705737e7ef6909f8c082d02ff5b493128"}
Sep 18 20:20:27.852395 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.852373    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fq2ll" event={"ID":"4ebc4418-54be-4583-8d56-2cad39923c56","Type":"ContainerStarted","Data":"dce69bd0e7fc960725341e7154c5a408d4ecfb76c1d418c87a93c30ec75859c5"}
Sep 18 20:20:27.853428 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.853409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9qjz" event={"ID":"55add1d8-b559-4fdd-a1b0-826dce56a516","Type":"ContainerStarted","Data":"ca3c87614ddbe92c6cf2700a6b99073406e50c3e1233c10267a87ab1000a6c35"}
Sep 18 20:20:27.866432 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:27.866387    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-235.ec2.internal" podStartSLOduration=1.866371167 podStartE2EDuration="1.866371167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:27.86593602 +0000 UTC m=+3.470114369" watchObservedRunningTime="2026-09-18 20:20:27.866371167 +0000 UTC m=+3.470549515"
Sep 18 20:20:28.367422 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.367322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:28.367599 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.367480    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:28.367599 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.367550    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret podName:20943fec-278e-4c96-8729-0309298862e5 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:30.367529192 +0000 UTC m=+5.971707531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret") pod "global-pull-secret-syncer-4l4bl" (UID: "20943fec-278e-4c96-8729-0309298862e5") : object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:28.468660 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.468591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:28.468870 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.468854    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:28.468942 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.468915    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs podName:018cb5c7-0ac8-4eea-9866-5611fe0b7644 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:30.468900884 +0000 UTC m=+6.073079213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs") pod "network-metrics-daemon-84j95" (UID: "018cb5c7-0ac8-4eea-9866-5611fe0b7644") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:28.569362 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.569286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:28.569597 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.569579    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 20:20:28.569660 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.569605    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 20:20:28.569660 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.569624    2561 projected.go:196] Error preparing data for projected volume kube-api-access-6nkj8 for pod openshift-network-diagnostics/network-check-target-5b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:28.569765 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.569686    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8 podName:3fafbef2-fe0c-4220-a499-d703aa74bb7c nodeName:}" failed. No retries permitted until 2026-09-18 20:20:30.569668704 +0000 UTC m=+6.173847034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkj8" (UniqueName: "kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8") pod "network-check-target-5b59g" (UID: "3fafbef2-fe0c-4220-a499-d703aa74bb7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:28.775843 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.775681    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 20:15:26 +0000 UTC" deadline="2028-06-19 17:46:23.248690572 +0000 UTC"
Sep 18 20:20:28.775843 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.775744    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15357h25m54.472950298s"
Sep 18 20:20:28.837802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.837005    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:28.837802 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.837150    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:28.837802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.837233    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:28.837802 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.837302    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:28.837802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.837368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:28.837802 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:28.837436    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:28.879786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.879159    2561 generic.go:356] "Generic (PLEG): container finished" podID="6736d619582edd8e67630758fafe1005" containerID="7f6ee381cc7430fb35ce5b1b61b0f7f0c3437ab67267842556af4a1fcf2c1987" exitCode=0
Sep 18 20:20:28.879786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:28.879702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" event={"ID":"6736d619582edd8e67630758fafe1005","Type":"ContainerDied","Data":"7f6ee381cc7430fb35ce5b1b61b0f7f0c3437ab67267842556af4a1fcf2c1987"}
Sep 18 20:20:29.905267 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:29.904473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" event={"ID":"6736d619582edd8e67630758fafe1005","Type":"ContainerStarted","Data":"2374d9ec449e21a7a7c505c398d532df142ea10b7739baef96105e5fc5a2b4f1"}
Sep 18 20:20:29.920633 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:29.920574    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-235.ec2.internal" podStartSLOduration=3.920552041 podStartE2EDuration="3.920552041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:29.92019903 +0000 UTC m=+5.524377379" watchObservedRunningTime="2026-09-18 20:20:29.920552041 +0000 UTC m=+5.524730389"
Sep 18 20:20:30.384243 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:30.384160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:30.384402 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.384331    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:30.384402 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.384396    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret podName:20943fec-278e-4c96-8729-0309298862e5 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:34.384378151 +0000 UTC m=+9.988556478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret") pod "global-pull-secret-syncer-4l4bl" (UID: "20943fec-278e-4c96-8729-0309298862e5") : object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:30.484560 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:30.484518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:30.484754 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.484716    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:30.484816 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.484779    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs podName:018cb5c7-0ac8-4eea-9866-5611fe0b7644 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:34.484762122 +0000 UTC m=+10.088940460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs") pod "network-metrics-daemon-84j95" (UID: "018cb5c7-0ac8-4eea-9866-5611fe0b7644") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:30.585290 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:30.585247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:30.585498 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.585475    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 20:20:30.585498 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.585497    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 20:20:30.585597 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.585510    2561 projected.go:196] Error preparing data for projected volume kube-api-access-6nkj8 for pod openshift-network-diagnostics/network-check-target-5b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:30.585597 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.585570    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8 podName:3fafbef2-fe0c-4220-a499-d703aa74bb7c nodeName:}" failed. No retries permitted until 2026-09-18 20:20:34.585550031 +0000 UTC m=+10.189728361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkj8" (UniqueName: "kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8") pod "network-check-target-5b59g" (UID: "3fafbef2-fe0c-4220-a499-d703aa74bb7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:30.833805 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:30.833725    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:30.833982 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.833858    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:30.835211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:30.833700    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:30.835211 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.835168    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:30.835382 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:30.835241    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:30.835382 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:30.835361    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:32.833477 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:32.833440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:32.833935 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:32.833492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:32.833935 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:32.833445    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:32.833935 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:32.833691    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:32.833935 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:32.833798    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:32.833935 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:32.833884    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:34.418955 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:34.418905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:34.419387 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.419088    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:34.419387 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.419168    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret podName:20943fec-278e-4c96-8729-0309298862e5 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:42.419145142 +0000 UTC m=+18.023323471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret") pod "global-pull-secret-syncer-4l4bl" (UID: "20943fec-278e-4c96-8729-0309298862e5") : object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:34.519755 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:34.519713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:34.519955 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.519867    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:34.519955 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.519938    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs podName:018cb5c7-0ac8-4eea-9866-5611fe0b7644 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:42.519919177 +0000 UTC m=+18.124097504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs") pod "network-metrics-daemon-84j95" (UID: "018cb5c7-0ac8-4eea-9866-5611fe0b7644") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:34.620403 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:34.620367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:34.620562 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.620534    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 20:20:34.620562 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.620557    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 20:20:34.620646 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.620569    2561 projected.go:196] Error preparing data for projected volume kube-api-access-6nkj8 for pod openshift-network-diagnostics/network-check-target-5b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:34.620646 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.620634    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8 podName:3fafbef2-fe0c-4220-a499-d703aa74bb7c nodeName:}" failed. No retries permitted until 2026-09-18 20:20:42.620614106 +0000 UTC m=+18.224792453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkj8" (UniqueName: "kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8") pod "network-check-target-5b59g" (UID: "3fafbef2-fe0c-4220-a499-d703aa74bb7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:34.837828 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:34.837755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:34.837979 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.837872    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:34.838119 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:34.838098    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:34.838190 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:34.838172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:34.838306 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.838283    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:34.838408 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:34.838380    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:36.834237 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:36.834195    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:36.834685 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:36.834329    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:36.834685 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:36.834368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:36.834685 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:36.834487    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:36.834685 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:36.834621    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:36.834895 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:36.834692    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:38.833426 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:38.833388    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:38.833913 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:38.833388    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:38.833913 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:38.833527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:38.833913 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:38.833523    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:38.833913 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:38.833639    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:38.833913 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:38.833716    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:40.834004 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:40.833810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:40.834455 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:40.833810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:40.834455 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:40.834113    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:40.834455 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:40.834215    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:40.834455 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:40.833838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:40.834455 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:40.834322    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:42.479552 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:42.479510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:42.480146 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.479652    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:42.480146 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.479730    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret podName:20943fec-278e-4c96-8729-0309298862e5 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:58.479708601 +0000 UTC m=+34.083886941 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret") pod "global-pull-secret-syncer-4l4bl" (UID: "20943fec-278e-4c96-8729-0309298862e5") : object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:42.580546 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:42.580508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:42.580730 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.580668    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:42.580790 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.580736    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs podName:018cb5c7-0ac8-4eea-9866-5611fe0b7644 nodeName:}" failed. No retries permitted until 2026-09-18 20:20:58.580719917 +0000 UTC m=+34.184898244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs") pod "network-metrics-daemon-84j95" (UID: "018cb5c7-0ac8-4eea-9866-5611fe0b7644") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:42.681691 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:42.681653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:42.681871 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.681789    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 20:20:42.681871 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.681806    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 20:20:42.681871 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.681816    2561 projected.go:196] Error preparing data for projected volume kube-api-access-6nkj8 for pod openshift-network-diagnostics/network-check-target-5b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:42.681871 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.681872    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8 podName:3fafbef2-fe0c-4220-a499-d703aa74bb7c nodeName:}" failed. No retries permitted until 2026-09-18 20:20:58.681859589 +0000 UTC m=+34.286037914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkj8" (UniqueName: "kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8") pod "network-check-target-5b59g" (UID: "3fafbef2-fe0c-4220-a499-d703aa74bb7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:42.834264 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:42.834231    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:42.834459 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:42.834231    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:42.834459 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:42.834390    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:42.834459 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.834381    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:42.834615 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.834599    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:42.834666 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:42.834499    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:44.834175 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:44.834141    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:44.834655 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:44.834182    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:44.834655 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:44.834251    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:44.834655 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:44.834292    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:44.834655 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:44.834370    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:44.834655 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:44.834447    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:45.943949 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.943712    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ffdj8" event={"ID":"b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc","Type":"ContainerStarted","Data":"b448ef21772792c6026a5afdc416d5337239899e37035c7e0c60863d873498e0"}
Sep 18 20:20:45.945204 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.945178    2561 generic.go:356] "Generic (PLEG): container finished" podID="55add1d8-b559-4fdd-a1b0-826dce56a516" containerID="b7f96d405addc4a93f2420439352a112393e9f3e917eca3030535d61a03ca92f" exitCode=0
Sep 18 20:20:45.945325 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.945251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9qjz" event={"ID":"55add1d8-b559-4fdd-a1b0-826dce56a516","Type":"ContainerDied","Data":"b7f96d405addc4a93f2420439352a112393e9f3e917eca3030535d61a03ca92f"}
Sep 18 20:20:45.946829 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.946806    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp" event={"ID":"b7301a41-9314-4033-98b1-a75fecb0032f","Type":"ContainerStarted","Data":"193c4c9c6a1c09336acdd0c093d5d0b359bce6200f9076cf9dde4e17cee112c7"}
Sep 18 20:20:45.948126 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.948102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z94b2" event={"ID":"4abd2472-d1ce-46a6-9a61-10c40afc1839","Type":"ContainerStarted","Data":"4194c15e221a8cfc4da4f50c15f9ae78da985765503c08168a5f6fbd8eb84235"}
Sep 18 20:20:45.950634 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.950615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" event={"ID":"a99f3975-9435-41dc-b6ba-ba6368dabf2e","Type":"ContainerStarted","Data":"f29229a55a6626dc2a7f22fd25d69bbf754f12c111c676222d26b4da3218a856"}
Sep 18 20:20:45.950715 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.950677    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" event={"ID":"a99f3975-9435-41dc-b6ba-ba6368dabf2e","Type":"ContainerStarted","Data":"5bd98d7657ee3e198d7d4e0a569a53d6a2859c5c1c5b5db0cfc61da675deb541"}
Sep 18 20:20:45.950766 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.950718    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" event={"ID":"a99f3975-9435-41dc-b6ba-ba6368dabf2e","Type":"ContainerStarted","Data":"1b4e8d530b2815b4790b2be4c2a7fece280420623749d2cee71133c8014cb73e"}
Sep 18 20:20:45.950766 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.950759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" event={"ID":"a99f3975-9435-41dc-b6ba-ba6368dabf2e","Type":"ContainerStarted","Data":"d468accb95f33b028de692c9a2377f6c9f65b30f5f4657855874223c0abbf01f"}
Sep 18 20:20:45.950841 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.950787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" event={"ID":"a99f3975-9435-41dc-b6ba-ba6368dabf2e","Type":"ContainerStarted","Data":"04dbedbc9649cc996f6d2b76300f477219752b65ad5414c6dc273acb1fab14d2"}
Sep 18 20:20:45.952033 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.952013    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jpmmv" event={"ID":"dbffc223-931d-49e0-963a-6f8e3da5e44d","Type":"ContainerStarted","Data":"5e496571f82a853c61cd3b2e9fee6006b2ebd8f9a1bd8fe96ae5cff70a5f02f0"}
Sep 18 20:20:45.953472 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.953448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5878l" event={"ID":"bc26bf29-f99a-4f12-976f-a0bbbbf432ca","Type":"ContainerStarted","Data":"7b5de9d41062dea4d065b1b65b1ad4340ab357f9398ad0b12b108bade1d2bff2"}
Sep 18 20:20:45.954744 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.954720    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q24cm" event={"ID":"8de51077-e633-44cc-a1da-94c9e2c0139c","Type":"ContainerStarted","Data":"9e46e6436deaf4c36a6e28fc0d8529320e944407307776e72053a5f1ab5499ee"}
Sep 18 20:20:45.958724 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:45.958689    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ffdj8" podStartSLOduration=10.689124863 podStartE2EDuration="20.958677431s" totalImagesPullingTime="10.269552568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:45.958377802 +0000 UTC m=+21.562556146" watchObservedRunningTime="2026-09-18 20:20:45.958677431 +0000 UTC m=+21.562855778"
Sep 18 20:20:46.001119 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.001014    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jpmmv" podStartSLOduration=3.326728231 podStartE2EDuration="21.000976406s" totalImagesPullingTime="17.674248175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:46.000905988 +0000 UTC m=+21.605084357" watchObservedRunningTime="2026-09-18 20:20:46.000976406 +0000 UTC m=+21.605154775"
Sep 18 20:20:46.036807 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.036748    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q24cm" podStartSLOduration=3.4180817 podStartE2EDuration="21.036733288s" totalImagesPullingTime="17.618651588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:46.02118937 +0000 UTC m=+21.625367717" watchObservedRunningTime="2026-09-18 20:20:46.036733288 +0000 UTC m=+21.640911634"
Sep 18 20:20:46.036985 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.036861    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z94b2" podStartSLOduration=3.419219744 podStartE2EDuration="21.03685119s" totalImagesPullingTime="17.617631446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:46.036145555 +0000 UTC m=+21.640323905" watchObservedRunningTime="2026-09-18 20:20:46.03685119 +0000 UTC m=+21.641029538"
Sep 18 20:20:46.055044 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.054976    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5878l" podStartSLOduration=3.439330383 podStartE2EDuration="21.054960435s" totalImagesPullingTime="17.615630052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:46.0540865 +0000 UTC m=+21.658264847" watchObservedRunningTime="2026-09-18 20:20:46.054960435 +0000 UTC m=+21.659138787"
Sep 18 20:20:46.664685 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.664598    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:46.665163 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.665144    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:46.834141 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.834106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:46.834306 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.834106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:46.834306 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.834258    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:46.834306 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:46.834259    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:46.834485 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:46.834360    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:46.834485 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:46.834444    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:46.937253 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.937012    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 20:20:46.959108 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.959080    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp" event={"ID":"b7301a41-9314-4033-98b1-a75fecb0032f","Type":"ContainerStarted","Data":"9aca3a17daedbdd957b75518c4cb2026b732856aaa46ef2337959f3edb96381d"}
Sep 18 20:20:46.962641 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.962614    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" event={"ID":"a99f3975-9435-41dc-b6ba-ba6368dabf2e","Type":"ContainerStarted","Data":"e51afae1cf704109e52efb34675a174f249ab1a147318320cd4a0bb1f0d5d926"}
Sep 18 20:20:46.964331 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.964282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fq2ll" event={"ID":"4ebc4418-54be-4583-8d56-2cad39923c56","Type":"ContainerStarted","Data":"001c5d53e4d0d89e95565fcaf9d8c180530218138198fea00194ee52a3d1e4dc"}
Sep 18 20:20:46.979647 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:46.979593    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fq2ll" podStartSLOduration=4.37095225 podStartE2EDuration="21.97957259s" totalImagesPullingTime="17.60862034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:46.979199641 +0000 UTC m=+22.583377988" watchObservedRunningTime="2026-09-18 20:20:46.97957259 +0000 UTC m=+22.583750933"
Sep 18 20:20:47.935392 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:47.935208    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T20:20:46.93724126Z","UUID":"8c348480-e419-4185-9fd3-cdf8776b1fb6","Handler":null,"Name":"","Endpoint":""}
Sep 18 20:20:47.937019 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:47.936980    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 20:20:47.937136 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:47.937031    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 20:20:47.966333 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:47.966306    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 20:20:48.834143 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:48.834103    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:48.834412 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:48.834103    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:48.834412 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:48.834254    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:48.834412 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:48.834113    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:48.834412 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:48.834339    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:48.834603 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:48.834409    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:48.971535 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:48.971495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp" event={"ID":"b7301a41-9314-4033-98b1-a75fecb0032f","Type":"ContainerStarted","Data":"36035d7115887b2ffe27aecf04a1426a7523ead1fbaad557616dde1d5bc535a1"}
Sep 18 20:20:48.975670 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:48.975630    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" event={"ID":"a99f3975-9435-41dc-b6ba-ba6368dabf2e","Type":"ContainerStarted","Data":"8d2d82aa24785ac787f3788e81904bad1dfd5e7c6054e3e36e4fdf3d83aeb554"}
Sep 18 20:20:48.990258 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:48.990195    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t26xp" podStartSLOduration=4.011033692 podStartE2EDuration="23.990173507s" totalImagesPullingTime="19.979139815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:48.989675261 +0000 UTC m=+24.593853609" watchObservedRunningTime="2026-09-18 20:20:48.990173507 +0000 UTC m=+24.594351853"
Sep 18 20:20:50.078390 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:50.078343    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:50.078860 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:50.078511    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 20:20:50.078958 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:50.078938    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ffdj8"
Sep 18 20:20:50.834053 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:50.834016    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:50.834053 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:50.834046    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:50.834259 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:50.834020    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:50.834259 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:50.834107    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:50.834259 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:50.834197    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:50.834368 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:50.834310    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:50.981563 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:50.981480    2561 generic.go:356] "Generic (PLEG): container finished" podID="55add1d8-b559-4fdd-a1b0-826dce56a516" containerID="930dbefba3b6f649bbf460b466e1bb9c416611fa21d708ca18578c35efe3e14e" exitCode=0
Sep 18 20:20:50.981731 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:50.981557    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9qjz" event={"ID":"55add1d8-b559-4fdd-a1b0-826dce56a516","Type":"ContainerDied","Data":"930dbefba3b6f649bbf460b466e1bb9c416611fa21d708ca18578c35efe3e14e"}
Sep 18 20:20:50.985680 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:50.985652    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" event={"ID":"a99f3975-9435-41dc-b6ba-ba6368dabf2e","Type":"ContainerStarted","Data":"449dd63080fa71d8efb00f4a5b7bc7f0f85a350955e7259ee865f6706128ea74"}
Sep 18 20:20:51.028308 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:51.028255    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" podStartSLOduration=8.363598629 podStartE2EDuration="26.028240226s" totalImagesPullingTime="17.664641597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:51.027714659 +0000 UTC m=+26.631893005" watchObservedRunningTime="2026-09-18 20:20:51.028240226 +0000 UTC m=+26.632418571"
Sep 18 20:20:51.991069 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:51.990973    2561 generic.go:356] "Generic (PLEG): container finished" podID="55add1d8-b559-4fdd-a1b0-826dce56a516" containerID="b64ea3e5f084b2379f08b17486de1d57fc0809d429a5973e8ac5ec7b3392723b" exitCode=0
Sep 18 20:20:51.991069 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:51.991023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9qjz" event={"ID":"55add1d8-b559-4fdd-a1b0-826dce56a516","Type":"ContainerDied","Data":"b64ea3e5f084b2379f08b17486de1d57fc0809d429a5973e8ac5ec7b3392723b"}
Sep 18 20:20:51.991913 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:51.991140    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 20:20:51.991913 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:51.991547    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:51.991913 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:51.991629    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:52.007274 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.007247    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:52.007416 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.007355    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:52.320976 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.320945    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4l4bl"]
Sep 18 20:20:52.321174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.321103    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:52.321235 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:52.321207    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:52.324028 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.323983    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5b59g"]
Sep 18 20:20:52.324162 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.324106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:52.324222 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:52.324179    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:52.324623 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.324600    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-84j95"]
Sep 18 20:20:52.324733 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.324688    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:52.324791 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:52.324772    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:52.996320 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.996281    2561 generic.go:356] "Generic (PLEG): container finished" podID="55add1d8-b559-4fdd-a1b0-826dce56a516" containerID="bfb5a2107e7538e9568f4cdeb3cc7fbfcd9721f8fa6fb4b6f3d6b4cbaf261791" exitCode=0
Sep 18 20:20:52.996773 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.996350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9qjz" event={"ID":"55add1d8-b559-4fdd-a1b0-826dce56a516","Type":"ContainerDied","Data":"bfb5a2107e7538e9568f4cdeb3cc7fbfcd9721f8fa6fb4b6f3d6b4cbaf261791"}
Sep 18 20:20:52.996773 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:52.996472    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 20:20:53.834063 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:53.834028    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:53.834063 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:53.834046    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:53.834321 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:53.834148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:53.834321 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:53.834172    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:53.834321 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:53.834239    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:53.834475 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:53.834321    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:53.998961 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:53.998929    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 20:20:55.115788 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:55.115747    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:55.208788 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:55.208753    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:55.834359 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:55.834321    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:55.834561 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:55.834440    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:55.834561 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:55.834457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:55.834561 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:55.834454    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:55.834722 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:55.834572    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:55.834722 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:55.834664    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:56.603529 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:56.603468    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:20:56.604052 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:56.603736    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 18 20:20:56.617158 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:56.617111    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" podUID="a99f3975-9435-41dc-b6ba-ba6368dabf2e" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 20:20:56.626760 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:56.626719    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2" podUID="a99f3975-9435-41dc-b6ba-ba6368dabf2e" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 18 20:20:57.833786 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:57.833746    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:57.834242 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:57.833762    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:57.834242 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:57.833861    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84j95" podUID="018cb5c7-0ac8-4eea-9866-5611fe0b7644"
Sep 18 20:20:57.834242 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:57.833884    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:57.834242 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:57.834018    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5b59g" podUID="3fafbef2-fe0c-4220-a499-d703aa74bb7c"
Sep 18 20:20:57.834242 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:57.834082    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4l4bl" podUID="20943fec-278e-4c96-8729-0309298862e5"
Sep 18 20:20:57.945894 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:57.945793    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:58.006510 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:58.006473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:58.012630 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:58.012600    2561 generic.go:356] "Generic (PLEG): container finished" podID="55add1d8-b559-4fdd-a1b0-826dce56a516" containerID="5d940fad8a9908eecbbfeef37c651abfee5afa80b35db82a06d5b48e26bc97e9" exitCode=0
Sep 18 20:20:58.012776 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:58.012657    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9qjz" event={"ID":"55add1d8-b559-4fdd-a1b0-826dce56a516","Type":"ContainerDied","Data":"5d940fad8a9908eecbbfeef37c651abfee5afa80b35db82a06d5b48e26bc97e9"}
Sep 18 20:20:58.502595 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:58.502551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:58.502745 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:58.502703    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:58.502804 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:58.502777    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret podName:20943fec-278e-4c96-8729-0309298862e5 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:30.502756684 +0000 UTC m=+66.106935026 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret") pod "global-pull-secret-syncer-4l4bl" (UID: "20943fec-278e-4c96-8729-0309298862e5") : object "kube-system"/"original-pull-secret" not registered
Sep 18 20:20:58.570087 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:58.570047    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:58.603230 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:58.603145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:58.603366 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:58.603288    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:58.603366 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:58.603360    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs podName:018cb5c7-0ac8-4eea-9866-5611fe0b7644 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:30.603339878 +0000 UTC m=+66.207518218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs") pod "network-metrics-daemon-84j95" (UID: "018cb5c7-0ac8-4eea-9866-5611fe0b7644") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 20:20:58.672673 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:58.672639    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:58.703808 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:58.703771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:58.703962 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:58.703943    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 20:20:58.704130 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:58.703966    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 20:20:58.704130 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:58.703978    2561 projected.go:196] Error preparing data for projected volume kube-api-access-6nkj8 for pod openshift-network-diagnostics/network-check-target-5b59g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:58.704130 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:58.704045    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8 podName:3fafbef2-fe0c-4220-a499-d703aa74bb7c nodeName:}" failed. No retries permitted until 2026-09-18 20:21:30.704030808 +0000 UTC m=+66.308209135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6nkj8" (UniqueName: "kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8") pod "network-check-target-5b59g" (UID: "3fafbef2-fe0c-4220-a499-d703aa74bb7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 20:20:59.018265 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.018098    2561 generic.go:356] "Generic (PLEG): container finished" podID="55add1d8-b559-4fdd-a1b0-826dce56a516" containerID="7d91c5056128e1ea188aa1f06032678963765d95ee65b8c647ff97342b566d92" exitCode=0
Sep 18 20:20:59.018265 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.018181    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9qjz" event={"ID":"55add1d8-b559-4fdd-a1b0-826dce56a516","Type":"ContainerDied","Data":"7d91c5056128e1ea188aa1f06032678963765d95ee65b8c647ff97342b566d92"}
Sep 18 20:20:59.170181 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.170157    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-235.ec2.internal" event="NodeReady"
Sep 18 20:20:59.170312 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.170289    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 20:20:59.240121 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.240083    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qs7p2"]
Sep 18 20:20:59.261628 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.261597    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zgqnr"]
Sep 18 20:20:59.261789 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.261739    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qs7p2"
Sep 18 20:20:59.264429 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.264406    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 20:20:59.264700 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.264680    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 20:20:59.265030 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.265006    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 20:20:59.265149 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.265013    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jl6dr\""
Sep 18 20:20:59.285826 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.285792    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qs7p2"]
Sep 18 20:20:59.285826 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.285828    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zgqnr"]
Sep 18 20:20:59.286027 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.285919    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.289250 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.289227    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 20:20:59.289250 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.289239    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 20:20:59.289250 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.289232    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pmtgt\""
Sep 18 20:20:59.409485 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.409396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.409485 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.409434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-tmp-dir\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.409674 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.409543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-config-volume\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.409674 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.409586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhtbb\" (UniqueName: \"kubernetes.io/projected/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-kube-api-access-fhtbb\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.409674 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.409606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5166b166-51d6-4fb0-8c0c-ddcf656c6969-cert\") pod \"ingress-canary-qs7p2\" (UID: \"5166b166-51d6-4fb0-8c0c-ddcf656c6969\") " pod="openshift-ingress-canary/ingress-canary-qs7p2"
Sep 18 20:20:59.409674 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.409628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2rr4\" (UniqueName: \"kubernetes.io/projected/5166b166-51d6-4fb0-8c0c-ddcf656c6969-kube-api-access-k2rr4\") pod \"ingress-canary-qs7p2\" (UID: \"5166b166-51d6-4fb0-8c0c-ddcf656c6969\") " pod="openshift-ingress-canary/ingress-canary-qs7p2"
Sep 18 20:20:59.510750 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.510712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-config-volume\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.510932 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.510762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhtbb\" (UniqueName: \"kubernetes.io/projected/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-kube-api-access-fhtbb\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.510932 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.510780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5166b166-51d6-4fb0-8c0c-ddcf656c6969-cert\") pod \"ingress-canary-qs7p2\" (UID: \"5166b166-51d6-4fb0-8c0c-ddcf656c6969\") " pod="openshift-ingress-canary/ingress-canary-qs7p2"
Sep 18 20:20:59.510932 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.510796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2rr4\" (UniqueName: \"kubernetes.io/projected/5166b166-51d6-4fb0-8c0c-ddcf656c6969-kube-api-access-k2rr4\") pod \"ingress-canary-qs7p2\" (UID: \"5166b166-51d6-4fb0-8c0c-ddcf656c6969\") " pod="openshift-ingress-canary/ingress-canary-qs7p2"
Sep 18 20:20:59.510932 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.510812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.510932 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:59.510885    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 20:20:59.511211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.510933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-tmp-dir\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.511211 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:20:59.510950    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls podName:55a7ca5f-82b2-4f88-923e-1ba0f52c4808 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:00.010931691 +0000 UTC m=+35.615110031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls") pod "dns-default-zgqnr" (UID: "55a7ca5f-82b2-4f88-923e-1ba0f52c4808") : secret "dns-default-metrics-tls" not found
Sep 18 20:20:59.511325 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.511263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-tmp-dir\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.511399 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.511374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-config-volume\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.515103 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.515086    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5166b166-51d6-4fb0-8c0c-ddcf656c6969-cert\") pod \"ingress-canary-qs7p2\" (UID: \"5166b166-51d6-4fb0-8c0c-ddcf656c6969\") " pod="openshift-ingress-canary/ingress-canary-qs7p2"
Sep 18 20:20:59.521022 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.519846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2rr4\" (UniqueName: \"kubernetes.io/projected/5166b166-51d6-4fb0-8c0c-ddcf656c6969-kube-api-access-k2rr4\") pod \"ingress-canary-qs7p2\" (UID: \"5166b166-51d6-4fb0-8c0c-ddcf656c6969\") " pod="openshift-ingress-canary/ingress-canary-qs7p2"
Sep 18 20:20:59.521022 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.520030    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhtbb\" (UniqueName: \"kubernetes.io/projected/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-kube-api-access-fhtbb\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:20:59.571394 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.571346    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qs7p2"
Sep 18 20:20:59.833830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.833781    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:20:59.834024 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.833800    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:20:59.834024 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.833911    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:20:59.836433 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.836405    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 20:20:59.836433 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.836431    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 20:20:59.836633 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.836445    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 20:20:59.836633 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.836450    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27fhx\""
Sep 18 20:20:59.836633 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.836517    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 20:20:59.837129 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.837114    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bmjzr\""
Sep 18 20:20:59.888260 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:20:59.888229    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qs7p2"]
Sep 18 20:20:59.893514 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:20:59.893485    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5166b166_51d6_4fb0_8c0c_ddcf656c6969.slice/crio-ec8f5fe5d0b7e61e99fe0fd78f659fdea3d9a43038e8f3f9a1e39d3836748ff7 WatchSource:0}: Error finding container ec8f5fe5d0b7e61e99fe0fd78f659fdea3d9a43038e8f3f9a1e39d3836748ff7: Status 404 returned error can't find the container with id ec8f5fe5d0b7e61e99fe0fd78f659fdea3d9a43038e8f3f9a1e39d3836748ff7
Sep 18 20:21:00.016830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:00.016745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:00.016968 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:00.016893    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 20:21:00.016968 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:00.016954    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls podName:55a7ca5f-82b2-4f88-923e-1ba0f52c4808 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:01.016939053 +0000 UTC m=+36.621117398 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls") pod "dns-default-zgqnr" (UID: "55a7ca5f-82b2-4f88-923e-1ba0f52c4808") : secret "dns-default-metrics-tls" not found
Sep 18 20:21:00.023814 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:00.023781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t9qjz" event={"ID":"55add1d8-b559-4fdd-a1b0-826dce56a516","Type":"ContainerStarted","Data":"279c33b74d9a5fba3285d123adf4e739a4e6684ed16e665f9e1cc259d9027841"}
Sep 18 20:21:00.024959 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:00.024938    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qs7p2" event={"ID":"5166b166-51d6-4fb0-8c0c-ddcf656c6969","Type":"ContainerStarted","Data":"ec8f5fe5d0b7e61e99fe0fd78f659fdea3d9a43038e8f3f9a1e39d3836748ff7"}
Sep 18 20:21:00.048117 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:00.048061    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t9qjz" podStartSLOduration=6.869168848 podStartE2EDuration="35.048044239s" totalImagesPullingTime="28.178875391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:00.046920435 +0000 UTC m=+35.651098781" watchObservedRunningTime="2026-09-18 20:21:00.048044239 +0000 UTC m=+35.652222585"
Sep 18 20:21:00.172227 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:00.172188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:00.264251 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:00.264221    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:01.025762 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:01.025728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:01.026250 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:01.025851    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 20:21:01.026250 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:01.025922    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls podName:55a7ca5f-82b2-4f88-923e-1ba0f52c4808 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:03.025901227 +0000 UTC m=+38.630079574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls") pod "dns-default-zgqnr" (UID: "55a7ca5f-82b2-4f88-923e-1ba0f52c4808") : secret "dns-default-metrics-tls" not found
Sep 18 20:21:03.034244 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.034207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qs7p2" event={"ID":"5166b166-51d6-4fb0-8c0c-ddcf656c6969","Type":"ContainerStarted","Data":"ab6ea6d838061c16dcabd463d257b1871684c79ba7761cd7c3433396986fe057"}
Sep 18 20:21:03.039870 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.039849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:03.040024 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.040008    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 20:21:03.040082 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.040066    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls podName:55a7ca5f-82b2-4f88-923e-1ba0f52c4808 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:07.040050372 +0000 UTC m=+42.644228720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls") pod "dns-default-zgqnr" (UID: "55a7ca5f-82b2-4f88-923e-1ba0f52c4808") : secret "dns-default-metrics-tls" not found
Sep 18 20:21:03.050987 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.050922    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qs7p2" podStartSLOduration=1.588371151 podStartE2EDuration="4.050903317s" totalImagesPullingTime="2.462532166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:03.050541896 +0000 UTC m=+38.654720265" watchObservedRunningTime="2026-09-18 20:21:03.050903317 +0000 UTC m=+38.655081665"
Sep 18 20:21:03.407313 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.407236    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"]
Sep 18 20:21:03.430276 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.430243    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-lgdjd"]
Sep 18 20:21:03.430422 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.430376    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:03.436155 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.436130    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 18 20:21:03.437925 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.437904    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mr6sr\""
Sep 18 20:21:03.438019 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.437904    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 20:21:03.438019 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.437908    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 20:21:03.438019 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.437908    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 18 20:21:03.449105 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.449078    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"]
Sep 18 20:21:03.449241 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.449116    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-lgdjd"]
Sep 18 20:21:03.449241 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.449191    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.451697 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.451677    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 20:21:03.451800 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.451677    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 20:21:03.451800 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.451677    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 18 20:21:03.451896 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.451810    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qhsgk\""
Sep 18 20:21:03.452038 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.452010    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 18 20:21:03.457860 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.457842    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 18 20:21:03.518224 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.518173    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"]
Sep 18 20:21:03.529501 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.529468    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-755486fdf6-jwrgf"]
Sep 18 20:21:03.529621 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.529597    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.532508 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.532447    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 18 20:21:03.532508 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.532455    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 18 20:21:03.532831 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.532514    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 18 20:21:03.532831 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.532559    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 18 20:21:03.532831 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.532719    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4fr4d\""
Sep 18 20:21:03.540073 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.540041    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"]
Sep 18 20:21:03.540192 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.540175    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.542748 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.542719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdvkc\" (UniqueName: \"kubernetes.io/projected/5348af9b-8ea7-499f-81f3-e53ce18e42ee-kube-api-access-qdvkc\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:03.542865 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.542776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5348af9b-8ea7-499f-81f3-e53ce18e42ee-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:03.542865 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.542801    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-snapshots\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.542865 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.542826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.542865 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.542850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.543079 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.542871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-serving-cert\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.543079 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.542911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrdpf\" (UniqueName: \"kubernetes.io/projected/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-kube-api-access-vrdpf\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.543079 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.542973    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:03.543079 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.543017    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-tmp\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.543652 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.543372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 18 20:21:03.543652 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.543393    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 20:21:03.543652 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.543444    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5bwk7\""
Sep 18 20:21:03.543652 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.543470    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 18 20:21:03.543652 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.543397    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 20:21:03.543652 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.543601    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 18 20:21:03.543957 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.543718    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 18 20:21:03.543957 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.543944    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-755486fdf6-jwrgf"]
Sep 18 20:21:03.616553 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.616524    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx"]
Sep 18 20:21:03.627962 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.627931    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-648759fc98-jzvdm"]
Sep 18 20:21:03.628152 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.628091    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx"
Sep 18 20:21:03.631262 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.631232    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 18 20:21:03.631426 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.631377    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5l76s\""
Sep 18 20:21:03.631527 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.631506    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 18 20:21:03.643423 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:03.643423 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-tmp\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.643630 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643466    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-default-certificate\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.643630 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.643630 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643529    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdvkc\" (UniqueName: \"kubernetes.io/projected/5348af9b-8ea7-499f-81f3-e53ce18e42ee-kube-api-access-qdvkc\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:03.643630 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh9h4\" (UniqueName: \"kubernetes.io/projected/de12d8c2-08ee-4d66-b78a-8b776c1f5430-kube-api-access-lh9h4\") pod \"kube-storage-version-migrator-operator-55889f7b47-h8lmm\" (UID: \"de12d8c2-08ee-4d66-b78a-8b776c1f5430\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.643630 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.643568    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:03.643630 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643585    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de12d8c2-08ee-4d66-b78a-8b776c1f5430-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-h8lmm\" (UID: \"de12d8c2-08ee-4d66-b78a-8b776c1f5430\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.643630 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5348af9b-8ea7-499f-81f3-e53ce18e42ee-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:03.644045 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-snapshots\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.644045 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.644045 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643689    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.644045 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-serving-cert\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.644045 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7flnr\" (UniqueName: \"kubernetes.io/projected/4eebb3de-b32f-4225-aa61-08b41feff46d-kube-api-access-7flnr\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.644045 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrdpf\" (UniqueName: \"kubernetes.io/projected/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-kube-api-access-vrdpf\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.644045 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-stats-auth\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.644045 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.644045 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.643862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de12d8c2-08ee-4d66-b78a-8b776c1f5430-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-h8lmm\" (UID: \"de12d8c2-08ee-4d66-b78a-8b776c1f5430\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.644460 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.644167    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx"]
Sep 18 20:21:03.644460 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.644276    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.644548 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.644467    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-snapshots\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.645015 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.644961    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.645015 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.645005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-tmp\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.645264 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.645244    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls podName:5348af9b-8ea7-499f-81f3-e53ce18e42ee nodeName:}" failed. No retries permitted until 2026-09-18 20:21:04.145223625 +0000 UTC m=+39.749401962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-wcrhm" (UID: "5348af9b-8ea7-499f-81f3-e53ce18e42ee") : secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:03.645264 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.645256    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5348af9b-8ea7-499f-81f3-e53ce18e42ee-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:03.645463 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.645441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.648352 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.648326    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-648759fc98-jzvdm"]
Sep 18 20:21:03.648821 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.648797    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 20:21:03.648952 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.648827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 20:21:03.649083 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.649066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-serving-cert\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.649527 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.649510    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pr778\""
Sep 18 20:21:03.649907 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.649885    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 20:21:03.656063 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.655941    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 20:21:03.666777 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.666711    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdvkc\" (UniqueName: \"kubernetes.io/projected/5348af9b-8ea7-499f-81f3-e53ce18e42ee-kube-api-access-qdvkc\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:03.668741 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.668719    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrdpf\" (UniqueName: \"kubernetes.io/projected/4c5a757a-6b53-433f-bc4a-35eceaedf6f7-kube-api-access-vrdpf\") pod \"insights-operator-6f9c644dd9-lgdjd\" (UID: \"4c5a757a-6b53-433f-bc4a-35eceaedf6f7\") " pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.690792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.690755    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:03.745202 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-trusted-ca\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.745202 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.745400 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745249    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-default-certificate\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.745400 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b477695-9014-456f-9f89-a8ee0b48e7a4-ca-trust-extracted\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.745400 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745296    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de12d8c2-08ee-4d66-b78a-8b776c1f5430-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-h8lmm\" (UID: \"de12d8c2-08ee-4d66-b78a-8b776c1f5430\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.745400 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745324    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-certificates\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.745400 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.745335    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 20:21:03.745400 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7flnr\" (UniqueName: \"kubernetes.io/projected/4eebb3de-b32f-4225-aa61-08b41feff46d-kube-api-access-7flnr\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.745613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-bound-sa-token\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.745613 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.745489    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:04.245464908 +0000 UTC m=+39.849643249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : secret "router-metrics-certs-default" not found
Sep 18 20:21:03.745613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745508    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbk8k\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-kube-api-access-xbk8k\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.745613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745543    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-stats-auth\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.745613 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de12d8c2-08ee-4d66-b78a-8b776c1f5430-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-h8lmm\" (UID: \"de12d8c2-08ee-4d66-b78a-8b776c1f5430\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.745852 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745613    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-image-registry-private-configuration\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.745852 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-installation-pull-secrets\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.745852 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh4hf\" (UniqueName: \"kubernetes.io/projected/a0de78e6-a766-4f67-9e33-fe27cb9b5831-kube-api-access-zh4hf\") pod \"volume-data-source-validator-5c4db8bdf9-pldzx\" (UID: \"a0de78e6-a766-4f67-9e33-fe27cb9b5831\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx"
Sep 18 20:21:03.746041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745868    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.746041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.746041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.745943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh9h4\" (UniqueName: \"kubernetes.io/projected/de12d8c2-08ee-4d66-b78a-8b776c1f5430-kube-api-access-lh9h4\") pod \"kube-storage-version-migrator-operator-55889f7b47-h8lmm\" (UID: \"de12d8c2-08ee-4d66-b78a-8b776c1f5430\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.746041 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.746009    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:04.245972929 +0000 UTC m=+39.850151271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : configmap references non-existent config key: service-ca.crt
Sep 18 20:21:03.746041 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.746016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de12d8c2-08ee-4d66-b78a-8b776c1f5430-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-h8lmm\" (UID: \"de12d8c2-08ee-4d66-b78a-8b776c1f5430\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.747818 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.747779    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de12d8c2-08ee-4d66-b78a-8b776c1f5430-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-h8lmm\" (UID: \"de12d8c2-08ee-4d66-b78a-8b776c1f5430\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.747938 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.747887    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-default-certificate\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.747938 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.747902    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-stats-auth\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.758095 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.758074    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd"
Sep 18 20:21:03.761474 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.761445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7flnr\" (UniqueName: \"kubernetes.io/projected/4eebb3de-b32f-4225-aa61-08b41feff46d-kube-api-access-7flnr\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:03.761731 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.761715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh9h4\" (UniqueName: \"kubernetes.io/projected/de12d8c2-08ee-4d66-b78a-8b776c1f5430-kube-api-access-lh9h4\") pod \"kube-storage-version-migrator-operator-55889f7b47-h8lmm\" (UID: \"de12d8c2-08ee-4d66-b78a-8b776c1f5430\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.812946 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.812907    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:03.839926 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.839891    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"
Sep 18 20:21:03.847270 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847234    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-certificates\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.847414 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-bound-sa-token\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.847414 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbk8k\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-kube-api-access-xbk8k\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.847414 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-image-registry-private-configuration\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.847414 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-installation-pull-secrets\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.847414 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh4hf\" (UniqueName: \"kubernetes.io/projected/a0de78e6-a766-4f67-9e33-fe27cb9b5831-kube-api-access-zh4hf\") pod \"volume-data-source-validator-5c4db8bdf9-pldzx\" (UID: \"a0de78e6-a766-4f67-9e33-fe27cb9b5831\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx"
Sep 18 20:21:03.847649 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.847649 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.847577    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 20:21:03.847649 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.847591    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648759fc98-jzvdm: secret "image-registry-tls" not found
Sep 18 20:21:03.847649 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-trusted-ca\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.847827 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:03.847645    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls podName:6b477695-9014-456f-9f89-a8ee0b48e7a4 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:04.347626945 +0000 UTC m=+39.951805270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls") pod "image-registry-648759fc98-jzvdm" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4") : secret "image-registry-tls" not found
Sep 18 20:21:03.847827 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847735    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b477695-9014-456f-9f89-a8ee0b48e7a4-ca-trust-extracted\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.848013 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.847978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-certificates\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.848122 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.848103    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b477695-9014-456f-9f89-a8ee0b48e7a4-ca-trust-extracted\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.848450 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.848433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-trusted-ca\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.849758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.849737    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-installation-pull-secrets\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.849859 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.849820    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-image-registry-private-configuration\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.855862 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.855822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbk8k\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-kube-api-access-xbk8k\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.856194 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.856178    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-bound-sa-token\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:03.856316 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.856300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh4hf\" (UniqueName: \"kubernetes.io/projected/a0de78e6-a766-4f67-9e33-fe27cb9b5831-kube-api-access-zh4hf\") pod \"volume-data-source-validator-5c4db8bdf9-pldzx\" (UID: \"a0de78e6-a766-4f67-9e33-fe27cb9b5831\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx"
Sep 18 20:21:03.902373 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.902336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:03.938257 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:03.938226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx"
Sep 18 20:21:04.052615 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:04.052581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-lgdjd"]
Sep 18 20:21:04.055585 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:04.055555    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5a757a_6b53_433f_bc4a_35eceaedf6f7.slice/crio-a5d148cc831989f9ab3e8c138841c3f0cf708c3747d63e12262e5488cbde856f WatchSource:0}: Error finding container a5d148cc831989f9ab3e8c138841c3f0cf708c3747d63e12262e5488cbde856f: Status 404 returned error can't find the container with id a5d148cc831989f9ab3e8c138841c3f0cf708c3747d63e12262e5488cbde856f
Sep 18 20:21:04.143008 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:04.142959    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm"]
Sep 18 20:21:04.145714 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:04.145687    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde12d8c2_08ee_4d66_b78a_8b776c1f5430.slice/crio-77e9bbdec4b679330a47ede64f7495552308867c717f49e7a2d823ab60b2255f WatchSource:0}: Error finding container 77e9bbdec4b679330a47ede64f7495552308867c717f49e7a2d823ab60b2255f: Status 404 returned error can't find the container with id 77e9bbdec4b679330a47ede64f7495552308867c717f49e7a2d823ab60b2255f
Sep 18 20:21:04.150676 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:04.150653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:04.150827 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:04.150806    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:04.150948 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:04.150933    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls podName:5348af9b-8ea7-499f-81f3-e53ce18e42ee nodeName:}" failed. No retries permitted until 2026-09-18 20:21:05.150911444 +0000 UTC m=+40.755089780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-wcrhm" (UID: "5348af9b-8ea7-499f-81f3-e53ce18e42ee") : secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:04.234323 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:04.234235    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx"]
Sep 18 20:21:04.237549 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:04.237523    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0de78e6_a766_4f67_9e33_fe27cb9b5831.slice/crio-a0591cf76cef577825c3397237b0cf354439dfe6ffbd7454f6819358deaa3686 WatchSource:0}: Error finding container a0591cf76cef577825c3397237b0cf354439dfe6ffbd7454f6819358deaa3686: Status 404 returned error can't find the container with id a0591cf76cef577825c3397237b0cf354439dfe6ffbd7454f6819358deaa3686
Sep 18 20:21:04.251460 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:04.251433    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:04.251544 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:04.251493    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:04.251611 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:04.251599    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 20:21:04.251658 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:04.251600    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:05.251582415 +0000 UTC m=+40.855760741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : configmap references non-existent config key: service-ca.crt
Sep 18 20:21:04.251658 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:04.251656    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:05.251640092 +0000 UTC m=+40.855818419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : secret "router-metrics-certs-default" not found
Sep 18 20:21:04.352563 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:04.352524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:04.352710 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:04.352675    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 20:21:04.352710 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:04.352695    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648759fc98-jzvdm: secret "image-registry-tls" not found
Sep 18 20:21:04.352798 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:04.352758    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls podName:6b477695-9014-456f-9f89-a8ee0b48e7a4 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:05.352737236 +0000 UTC m=+40.956915561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls") pod "image-registry-648759fc98-jzvdm" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4") : secret "image-registry-tls" not found
Sep 18 20:21:05.043312 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:05.043265    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx" event={"ID":"a0de78e6-a766-4f67-9e33-fe27cb9b5831","Type":"ContainerStarted","Data":"a0591cf76cef577825c3397237b0cf354439dfe6ffbd7454f6819358deaa3686"}
Sep 18 20:21:05.046864 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:05.046816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm" event={"ID":"de12d8c2-08ee-4d66-b78a-8b776c1f5430","Type":"ContainerStarted","Data":"77e9bbdec4b679330a47ede64f7495552308867c717f49e7a2d823ab60b2255f"}
Sep 18 20:21:05.048893 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:05.048859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd" event={"ID":"4c5a757a-6b53-433f-bc4a-35eceaedf6f7","Type":"ContainerStarted","Data":"a5d148cc831989f9ab3e8c138841c3f0cf708c3747d63e12262e5488cbde856f"}
Sep 18 20:21:05.159113 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:05.159069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:05.159566 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:05.159339    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:05.159566 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:05.159430    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls podName:5348af9b-8ea7-499f-81f3-e53ce18e42ee nodeName:}" failed. No retries permitted until 2026-09-18 20:21:07.159408073 +0000 UTC m=+42.763586418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-wcrhm" (UID: "5348af9b-8ea7-499f-81f3-e53ce18e42ee") : secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:05.259660 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:05.259619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:05.259865 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:05.259712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:05.259865 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:05.259782    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:07.259760452 +0000 UTC m=+42.863938798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : configmap references non-existent config key: service-ca.crt
Sep 18 20:21:05.259865 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:05.259855    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 20:21:05.260072 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:05.259894    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:07.259881519 +0000 UTC m=+42.864059858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : secret "router-metrics-certs-default" not found
Sep 18 20:21:05.360741 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:05.360651    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:05.360903 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:05.360769    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 20:21:05.360903 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:05.360789    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648759fc98-jzvdm: secret "image-registry-tls" not found
Sep 18 20:21:05.360903 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:05.360876    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls podName:6b477695-9014-456f-9f89-a8ee0b48e7a4 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:07.360846512 +0000 UTC m=+42.965024850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls") pod "image-registry-648759fc98-jzvdm" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4") : secret "image-registry-tls" not found
Sep 18 20:21:07.074973 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:07.074940    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:07.075360 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.075105    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 20:21:07.075360 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.075169    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls podName:55a7ca5f-82b2-4f88-923e-1ba0f52c4808 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:15.075153178 +0000 UTC m=+50.679331502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls") pod "dns-default-zgqnr" (UID: "55a7ca5f-82b2-4f88-923e-1ba0f52c4808") : secret "dns-default-metrics-tls" not found
Sep 18 20:21:07.176439 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:07.176404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:07.176587 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.176566    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:07.176646 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.176637    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls podName:5348af9b-8ea7-499f-81f3-e53ce18e42ee nodeName:}" failed. No retries permitted until 2026-09-18 20:21:11.176621787 +0000 UTC m=+46.780800111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-wcrhm" (UID: "5348af9b-8ea7-499f-81f3-e53ce18e42ee") : secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:07.276932 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:07.276906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:07.277047 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:07.276985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:07.277133 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.277110    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 20:21:07.277206 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.277189    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:11.277165963 +0000 UTC m=+46.881344310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : configmap references non-existent config key: service-ca.crt
Sep 18 20:21:07.277254 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.277223    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:11.277210986 +0000 UTC m=+46.881389327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : secret "router-metrics-certs-default" not found
Sep 18 20:21:07.377782 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:07.377748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:07.377946 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.377892    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 20:21:07.377946 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.377909    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648759fc98-jzvdm: secret "image-registry-tls" not found
Sep 18 20:21:07.378053 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:07.377963    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls podName:6b477695-9014-456f-9f89-a8ee0b48e7a4 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:11.377949933 +0000 UTC m=+46.982128270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls") pod "image-registry-648759fc98-jzvdm" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4") : secret "image-registry-tls" not found
Sep 18 20:21:08.056668 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.056633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:08.058769 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.058741    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd" event={"ID":"4c5a757a-6b53-433f-bc4a-35eceaedf6f7","Type":"ContainerStarted","Data":"a30c660d955c2ef080ab96ad54bd0e53db1ccf59cdabed6fdfad3ddd4c93e638"}
Sep 18 20:21:08.060353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.060328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx" event={"ID":"a0de78e6-a766-4f67-9e33-fe27cb9b5831","Type":"ContainerStarted","Data":"cb2749c618a16c43db1a7dca321891b6023b9e5355c30b09fdd4e964088ccf15"}
Sep 18 20:21:08.061940 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.061908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm" event={"ID":"de12d8c2-08ee-4d66-b78a-8b776c1f5430","Type":"ContainerStarted","Data":"b1de05529a9714da901c27a8bcc600ef62c978ce5a23c461be247b00e92ea0a8"}
Sep 18 20:21:08.077073 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.077023    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd" podStartSLOduration=1.8785494630000001 podStartE2EDuration="5.077003891s" totalImagesPullingTime="3.198454428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:08.076209256 +0000 UTC m=+43.680387614" watchObservedRunningTime="2026-09-18 20:21:08.077003891 +0000 UTC m=+43.681182228"
Sep 18 20:21:08.092781 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.092724    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-pldzx" podStartSLOduration=2.076551682 podStartE2EDuration="5.09270348s" totalImagesPullingTime="3.016151798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:08.092077029 +0000 UTC m=+43.696255376" watchObservedRunningTime="2026-09-18 20:21:08.09270348 +0000 UTC m=+43.696881828"
Sep 18 20:21:08.110815 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.110745    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm" podStartSLOduration=1.9965741019999999 podStartE2EDuration="5.110723848s" totalImagesPullingTime="3.114149746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:08.109727067 +0000 UTC m=+43.713905413" watchObservedRunningTime="2026-09-18 20:21:08.110723848 +0000 UTC m=+43.714902196"
Sep 18 20:21:08.155855 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.155819    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:08.264626 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.264590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:08.364973 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.364886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:08.430659 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.430623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:08.701260 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.701186    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b2jts"]
Sep 18 20:21:08.719738 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.719704    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:08.736264 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.736230    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b2jts"]
Sep 18 20:21:08.736436 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.736359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.741573 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.741539    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-299f5\""
Sep 18 20:21:08.741744 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.741605    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 20:21:08.747176 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.747151    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 20:21:08.834422 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.834381    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:08.891739 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.891701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8b8s\" (UniqueName: \"kubernetes.io/projected/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-api-access-z8b8s\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.891917 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.891789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.891917 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.891821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5ca3ef4-2a61-48fb-9f33-91626d917571-crio-socket\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.891917 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.891840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5ca3ef4-2a61-48fb-9f33-91626d917571-data-volume\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.891917 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.891868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.920391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.920353    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:08.992758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.992676    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5ca3ef4-2a61-48fb-9f33-91626d917571-data-volume\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.992758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.992717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.992939 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.992805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8b8s\" (UniqueName: \"kubernetes.io/projected/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-api-access-z8b8s\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.992939 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.992908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.993034 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.992945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5ca3ef4-2a61-48fb-9f33-91626d917571-crio-socket\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.993034 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:08.993024    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 20:21:08.993113 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.993060    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5ca3ef4-2a61-48fb-9f33-91626d917571-data-volume\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.993113 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:08.993090    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-rbac-proxy-cm podName:a5ca3ef4-2a61-48fb-9f33-91626d917571 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:09.493070513 +0000 UTC m=+45.097248852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b2jts" (UID: "a5ca3ef4-2a61-48fb-9f33-91626d917571") : configmap "kube-rbac-proxy" not found
Sep 18 20:21:08.993192 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:08.993108    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:08.993192 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:08.993169    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5ca3ef4-2a61-48fb-9f33-91626d917571-crio-socket\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:08.993192 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:08.993187    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls podName:a5ca3ef4-2a61-48fb-9f33-91626d917571 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:09.493162573 +0000 UTC m=+45.097340916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b2jts" (UID: "a5ca3ef4-2a61-48fb-9f33-91626d917571") : secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:09.004048 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:09.004025    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8b8s\" (UniqueName: \"kubernetes.io/projected/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-api-access-z8b8s\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:09.155428 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:09.155391    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:09.258324 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:09.258233    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:09.362641 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:09.362611    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:09.456499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:09.456429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:09.497595 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:09.497553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:09.497771 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:09.497677    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 20:21:09.497771 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:09.497746    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-rbac-proxy-cm podName:a5ca3ef4-2a61-48fb-9f33-91626d917571 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:10.49772419 +0000 UTC m=+46.101907041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-rbac-proxy-cm") pod "insights-runtime-extractor-b2jts" (UID: "a5ca3ef4-2a61-48fb-9f33-91626d917571") : configmap "kube-rbac-proxy" not found
Sep 18 20:21:09.497771 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:09.497684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:09.497771 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:09.497756    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:09.497909 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:09.497800    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls podName:a5ca3ef4-2a61-48fb-9f33-91626d917571 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:10.497789225 +0000 UTC m=+46.101967563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b2jts" (UID: "a5ca3ef4-2a61-48fb-9f33-91626d917571") : secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:09.556728 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:09.556697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:10.313757 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:10.313721    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:10.504868 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:10.504825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:10.505072 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:10.505040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:10.505158 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:10.505145    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:10.505210 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:10.505201    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls podName:a5ca3ef4-2a61-48fb-9f33-91626d917571 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:12.505187114 +0000 UTC m=+48.109365437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b2jts" (UID: "a5ca3ef4-2a61-48fb-9f33-91626d917571") : secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:10.505406 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:10.505383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5ca3ef4-2a61-48fb-9f33-91626d917571-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:10.851421 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:10.851392    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q24cm_8de51077-e633-44cc-a1da-94c9e2c0139c/dns-node-resolver/0.log"
Sep 18 20:21:11.077472 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:11.077436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:11.186051 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:11.185918    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:11.210020 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:11.209967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:11.210179 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:11.210113    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:11.210219 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:11.210180    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls podName:5348af9b-8ea7-499f-81f3-e53ce18e42ee nodeName:}" failed. No retries permitted until 2026-09-18 20:21:19.210164667 +0000 UTC m=+54.814343016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-wcrhm" (UID: "5348af9b-8ea7-499f-81f3-e53ce18e42ee") : secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:11.281804 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:11.281757    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:11.311270 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:11.311232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:11.311487 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:11.311325    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:11.311487 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:11.311425    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 20:21:11.311487 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:11.311451    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:19.311438007 +0000 UTC m=+54.915616344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : configmap references non-existent config key: service-ca.crt
Sep 18 20:21:11.311623 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:11.311488    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:19.311470784 +0000 UTC m=+54.915649120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : secret "router-metrics-certs-default" not found
Sep 18 20:21:11.411956 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:11.411926    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:11.412300 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:11.412089    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 20:21:11.412300 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:11.412110    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648759fc98-jzvdm: secret "image-registry-tls" not found
Sep 18 20:21:11.412300 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:11.412175    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls podName:6b477695-9014-456f-9f89-a8ee0b48e7a4 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:19.412159111 +0000 UTC m=+55.016337441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls") pod "image-registry-648759fc98-jzvdm" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4") : secret "image-registry-tls" not found
Sep 18 20:21:11.853299 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:11.853268    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z94b2_4abd2472-d1ce-46a6-9a61-10c40afc1839/node-ca/0.log"
Sep 18 20:21:12.522507 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:12.522445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:12.522886 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:12.522610    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:12.522886 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:12.522691    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls podName:a5ca3ef4-2a61-48fb-9f33-91626d917571 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:16.522675501 +0000 UTC m=+52.126853845 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b2jts" (UID: "a5ca3ef4-2a61-48fb-9f33-91626d917571") : secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:12.623539 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:12.623504    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:12.652479 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:12.652446    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qs7p2_5166b166-51d6-4fb0-8c0c-ddcf656c6969/serve-healthcheck-canary/0.log"
Sep 18 20:21:13.587651 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:13.587617    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:13.682968 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:13.682921    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:15.043985 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:15.043939    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:15.143938 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:15.143896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:15.144126 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:15.144074    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 20:21:15.144168 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:15.144141    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls podName:55a7ca5f-82b2-4f88-923e-1ba0f52c4808 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:31.144122011 +0000 UTC m=+66.748300356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls") pod "dns-default-zgqnr" (UID: "55a7ca5f-82b2-4f88-923e-1ba0f52c4808") : secret "dns-default-metrics-tls" not found
Sep 18 20:21:15.252299 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:15.252261    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:15.365390 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:15.365288    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:15.486114 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:15.486084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:15.718384 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:15.718295    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:15.869826 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:15.869793    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:16.369726 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:16.369692    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:16.556762 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:16.556730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:16.556938 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:16.556875    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:16.556982 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:16.556940    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls podName:a5ca3ef4-2a61-48fb-9f33-91626d917571 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:24.556924304 +0000 UTC m=+60.161102627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls") pod "insights-runtime-extractor-b2jts" (UID: "a5ca3ef4-2a61-48fb-9f33-91626d917571") : secret "insights-runtime-extractor-tls" not found
Sep 18 20:21:16.735518 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:16.735434    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:16.936706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:16.936672    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:17.331245 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:17.331201    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:17.520556 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:17.520519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:17.928340 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:17.928291    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:18.458147 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:18.458109    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:18.563693 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:18.563653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:18.721537 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:18.721456    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:18.920810 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:18.920779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:19.112864 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.112818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:19.183007 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.182956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:19.281088 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.281050    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:19.281255 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:19.281201    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:19.281322 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:19.281264    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls podName:5348af9b-8ea7-499f-81f3-e53ce18e42ee nodeName:}" failed. No retries permitted until 2026-09-18 20:21:35.281248366 +0000 UTC m=+70.885426707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-wcrhm" (UID: "5348af9b-8ea7-499f-81f3-e53ce18e42ee") : secret "cluster-monitoring-operator-tls" not found
Sep 18 20:21:19.382375 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.382291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:19.382534 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.382386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:19.382534 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:19.382471    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:35.382450086 +0000 UTC m=+70.986628433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : configmap references non-existent config key: service-ca.crt
Sep 18 20:21:19.382656 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:19.382554    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 20:21:19.382656 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:19.382636    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs podName:4eebb3de-b32f-4225-aa61-08b41feff46d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:35.382616921 +0000 UTC m=+70.986795319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs") pod "router-default-755486fdf6-jwrgf" (UID: "4eebb3de-b32f-4225-aa61-08b41feff46d") : secret "router-metrics-certs-default" not found
Sep 18 20:21:19.483825 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.483784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:19.486204 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.486173    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") pod \"image-registry-648759fc98-jzvdm\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") " pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:19.519102 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.519069    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:19.559079 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.559047    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:19.844897 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.844868    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-648759fc98-jzvdm"]
Sep 18 20:21:19.849355 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:19.849328    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b477695_9014_456f_9f89_a8ee0b48e7a4.slice/crio-2e4525256c5087e1c6991c6f17ff263185c89bc7154794411a2879e3352e380b WatchSource:0}: Error finding container 2e4525256c5087e1c6991c6f17ff263185c89bc7154794411a2879e3352e380b: Status 404 returned error can't find the container with id 2e4525256c5087e1c6991c6f17ff263185c89bc7154794411a2879e3352e380b
Sep 18 20:21:19.940095 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:19.940058    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:20.095370 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:20.095285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-648759fc98-jzvdm" event={"ID":"6b477695-9014-456f-9f89-a8ee0b48e7a4","Type":"ContainerStarted","Data":"7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f"}
Sep 18 20:21:20.095370 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:20.095333    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-648759fc98-jzvdm" event={"ID":"6b477695-9014-456f-9f89-a8ee0b48e7a4","Type":"ContainerStarted","Data":"2e4525256c5087e1c6991c6f17ff263185c89bc7154794411a2879e3352e380b"}
Sep 18 20:21:20.095370 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:20.095367    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:20.120611 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:20.120563    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-648759fc98-jzvdm" podStartSLOduration=17.120547078 podStartE2EDuration="17.120547078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:20.119091628 +0000 UTC m=+55.723269974" watchObservedRunningTime="2026-09-18 20:21:20.120547078 +0000 UTC m=+55.724725424"
Sep 18 20:21:20.710232 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:20.710185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:20.924237 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:20.924199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:21.119888 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:21.119852    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:21.221122 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:21.221087    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:21.517537 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:21.517455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:22.143444 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:22.143404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:22.712969 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:22.712935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:22.913502 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:22.913465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:23.118503 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:23.118470    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:23.517113 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:23.517020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:24.111204 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:24.111171    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:24.494412 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:24.494319    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:24.594261 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:24.594228    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:24.628535 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:24.628495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:24.630784 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:24.630750    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5ca3ef4-2a61-48fb-9f33-91626d917571-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b2jts\" (UID: \"a5ca3ef4-2a61-48fb-9f33-91626d917571\") " pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:24.649812 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:24.649779    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b2jts"
Sep 18 20:21:24.716974 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:24.716941    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:24.920857 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:24.920825    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b2jts"]
Sep 18 20:21:24.924107 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:24.924074    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ca3ef4_2a61_48fb_9f33_91626d917571.slice/crio-47f49a316f440fe660cdc28f7c99c88a0fb2561c565ab7c5f2f4568d1636761f WatchSource:0}: Error finding container 47f49a316f440fe660cdc28f7c99c88a0fb2561c565ab7c5f2f4568d1636761f: Status 404 returned error can't find the container with id 47f49a316f440fe660cdc28f7c99c88a0fb2561c565ab7c5f2f4568d1636761f
Sep 18 20:21:25.111880 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:25.111851    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2jts" event={"ID":"a5ca3ef4-2a61-48fb-9f33-91626d917571","Type":"ContainerStarted","Data":"b38af73d072b50ec9fa008dea7bff7c454a99182b90a906fbed4767411c621ed"}
Sep 18 20:21:25.112044 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:25.111907    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2jts" event={"ID":"a5ca3ef4-2a61-48fb-9f33-91626d917571","Type":"ContainerStarted","Data":"47f49a316f440fe660cdc28f7c99c88a0fb2561c565ab7c5f2f4568d1636761f"}
Sep 18 20:21:25.323313 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:25.323271    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:25.530930 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:25.530891    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:25.732744 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:25.732666    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:26.117627 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:26.117591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2jts" event={"ID":"a5ca3ef4-2a61-48fb-9f33-91626d917571","Type":"ContainerStarted","Data":"47cff516a0d74504694f31f55cce8984927f68fc31fdc90247cc73571713eb44"}
Sep 18 20:21:26.627758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:26.627718    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfsh2"
Sep 18 20:21:27.123641 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:27.123606    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b2jts" event={"ID":"a5ca3ef4-2a61-48fb-9f33-91626d917571","Type":"ContainerStarted","Data":"96fc66b4719881ce7ba2467600bc04a54ae8bffab5b336055b8ca3a2baef641e"}
Sep 18 20:21:27.142223 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:27.142159    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b2jts" podStartSLOduration=17.503732184 podStartE2EDuration="19.142141685s" totalImagesPullingTime="1.638409501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:21:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:27.141514371 +0000 UTC m=+62.745692718" watchObservedRunningTime="2026-09-18 20:21:27.142141685 +0000 UTC m=+62.746320030"
Sep 18 20:21:28.576207 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:28.576169    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:28.674779 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:28.674743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:30.023290 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.023253    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:30.124248 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.124206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:30.224619 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.224540    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:30.537874 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.537848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:30.580198 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.580149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:21:30.582483 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.582466    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 20:21:30.592568 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.592537    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20943fec-278e-4c96-8729-0309298862e5-original-pull-secret\") pod \"global-pull-secret-syncer-4l4bl\" (UID: \"20943fec-278e-4c96-8729-0309298862e5\") " pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:21:30.680701 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.680665    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:21:30.682803 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.682782    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 20:21:30.693673 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.693642    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/018cb5c7-0ac8-4eea-9866-5611fe0b7644-metrics-certs\") pod \"network-metrics-daemon-84j95\" (UID: \"018cb5c7-0ac8-4eea-9866-5611fe0b7644\") " pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:21:30.702589 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.702555    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:30.743798 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.743761    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4l4bl"
Sep 18 20:21:30.756506 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.756481    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27fhx\""
Sep 18 20:21:30.762138 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.762108    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:30.764890 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.764867    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84j95"
Sep 18 20:21:30.782074 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.781527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:21:30.784061 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.784032    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 20:21:30.794369 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.794339    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 20:21:30.805061 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:30.805030    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nkj8\" (UniqueName: \"kubernetes.io/projected/3fafbef2-fe0c-4220-a499-d703aa74bb7c-kube-api-access-6nkj8\") pod \"network-check-target-5b59g\" (UID: \"3fafbef2-fe0c-4220-a499-d703aa74bb7c\") " pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:21:31.017773 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.017743    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4l4bl"]
Sep 18 20:21:31.020679 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:31.020650    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20943fec_278e_4c96_8729_0309298862e5.slice/crio-f32b29341ac5680a039f180a0322adb434826a52ce0365d2890390a08e2fac34 WatchSource:0}: Error finding container f32b29341ac5680a039f180a0322adb434826a52ce0365d2890390a08e2fac34: Status 404 returned error can't find the container with id f32b29341ac5680a039f180a0322adb434826a52ce0365d2890390a08e2fac34
Sep 18 20:21:31.043495 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.043416    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-84j95"]
Sep 18 20:21:31.046497 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:31.046472    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018cb5c7_0ac8_4eea_9866_5611fe0b7644.slice/crio-dd4fd33dd116ed79944e9d2af29a55707c3a688056e33231857cf91a7a374d33 WatchSource:0}: Error finding container dd4fd33dd116ed79944e9d2af29a55707c3a688056e33231857cf91a7a374d33: Status 404 returned error can't find the container with id dd4fd33dd116ed79944e9d2af29a55707c3a688056e33231857cf91a7a374d33
Sep 18 20:21:31.051866 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.051843    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bmjzr\""
Sep 18 20:21:31.060365 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.060342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:21:31.119768 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.119737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:31.137214 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.137182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4l4bl" event={"ID":"20943fec-278e-4c96-8729-0309298862e5","Type":"ContainerStarted","Data":"f32b29341ac5680a039f180a0322adb434826a52ce0365d2890390a08e2fac34"}
Sep 18 20:21:31.138268 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.138235    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84j95" event={"ID":"018cb5c7-0ac8-4eea-9866-5611fe0b7644","Type":"ContainerStarted","Data":"dd4fd33dd116ed79944e9d2af29a55707c3a688056e33231857cf91a7a374d33"}
Sep 18 20:21:31.184964 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.184919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:31.187286 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.187259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/55a7ca5f-82b2-4f88-923e-1ba0f52c4808-metrics-tls\") pod \"dns-default-zgqnr\" (UID: \"55a7ca5f-82b2-4f88-923e-1ba0f52c4808\") " pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:31.328590 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.328504    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5b59g"]
Sep 18 20:21:31.332939 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:31.332906    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fafbef2_fe0c_4220_a499_d703aa74bb7c.slice/crio-e3456c0453355af768da5c46ea35cf2bf85790e4e855883babb2eafba733acf8 WatchSource:0}: Error finding container e3456c0453355af768da5c46ea35cf2bf85790e4e855883babb2eafba733acf8: Status 404 returned error can't find the container with id e3456c0453355af768da5c46ea35cf2bf85790e4e855883babb2eafba733acf8
Sep 18 20:21:31.336074 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.336043    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:31.396496 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.396460    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pmtgt\""
Sep 18 20:21:31.404658 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.404621    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:31.405887 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.405855    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:31.527354 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.527311    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:31.682880 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.682741    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zgqnr"]
Sep 18 20:21:31.689694 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:31.689662    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a7ca5f_82b2_4f88_923e_1ba0f52c4808.slice/crio-c9421357d388d7b73f4e3130e448ad0f4066831e5e73565b55d2f252f3442cdd WatchSource:0}: Error finding container c9421357d388d7b73f4e3130e448ad0f4066831e5e73565b55d2f252f3442cdd: Status 404 returned error can't find the container with id c9421357d388d7b73f4e3130e448ad0f4066831e5e73565b55d2f252f3442cdd
Sep 18 20:21:31.729424 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.729383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:31.808729 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:31.808692    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:32.061476 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:32.061434    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:32.145155 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:32.145119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zgqnr" event={"ID":"55a7ca5f-82b2-4f88-923e-1ba0f52c4808","Type":"ContainerStarted","Data":"c9421357d388d7b73f4e3130e448ad0f4066831e5e73565b55d2f252f3442cdd"}
Sep 18 20:21:32.146893 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:32.146729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5b59g" event={"ID":"3fafbef2-fe0c-4220-a499-d703aa74bb7c","Type":"ContainerStarted","Data":"e3456c0453355af768da5c46ea35cf2bf85790e4e855883babb2eafba733acf8"}
Sep 18 20:21:33.156305 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:33.156262    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84j95" event={"ID":"018cb5c7-0ac8-4eea-9866-5611fe0b7644","Type":"ContainerStarted","Data":"53df7d5091962015991557066bc248d67e1bb091e7fcbead36bffa31030ed2fa"}
Sep 18 20:21:33.156830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:33.156337    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84j95" event={"ID":"018cb5c7-0ac8-4eea-9866-5611fe0b7644","Type":"ContainerStarted","Data":"bdfbe14df372125b0875a9b22a56526a0d7e65cf3d138627c260929c2883a0ea"}
Sep 18 20:21:33.178117 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:33.177713    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-84j95" podStartSLOduration=67.159891401 podStartE2EDuration="1m8.177690682s" totalImagesPullingTime="1.017799281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:33.175743378 +0000 UTC m=+68.779921737" watchObservedRunningTime="2026-09-18 20:21:33.177690682 +0000 UTC m=+68.781869029"
Sep 18 20:21:33.935795 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:33.935756    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:34.010451 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.010411    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:34.214891 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.214794    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:34.315441 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.315382    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:34.769763 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.769719    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-648759fc98-jzvdm"]
Sep 18 20:21:34.774927 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.774891    2561 patch_prober.go:28] interesting pod/image-registry-648759fc98-jzvdm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 20:21:34.775121 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.774948    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-648759fc98-jzvdm" podUID="6b477695-9014-456f-9f89-a8ee0b48e7a4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:21:34.821029 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.820979    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-clsvj"]
Sep 18 20:21:34.826325 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.826297    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-clsvj"
Sep 18 20:21:34.829548 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.829507    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 20:21:34.829694 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.829653    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 20:21:34.830064 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.830043    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g6crd\""
Sep 18 20:21:34.838755 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.838730    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-544f998677-x6rkc"]
Sep 18 20:21:34.842492 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.842468    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-clsvj"]
Sep 18 20:21:34.842619 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.842586    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:34.854368 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.854294    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-544f998677-x6rkc"]
Sep 18 20:21:34.919101 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.919060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a509bcac-d911-4782-b673-0a256f1ae05d-image-registry-private-configuration\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:34.919320 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.919117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a509bcac-d911-4782-b673-0a256f1ae05d-registry-certificates\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:34.919320 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.919156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lztsh\" (UniqueName: \"kubernetes.io/projected/a509bcac-d911-4782-b673-0a256f1ae05d-kube-api-access-lztsh\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:34.919320 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.919177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a509bcac-d911-4782-b673-0a256f1ae05d-bound-sa-token\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:34.919320 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.919292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a509bcac-d911-4782-b673-0a256f1ae05d-trusted-ca\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:34.919504 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.919343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a509bcac-d911-4782-b673-0a256f1ae05d-registry-tls\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:34.919504 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.919399    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92lkb\" (UniqueName: \"kubernetes.io/projected/b0183275-cf60-40a1-b34b-5e5efc74adc9-kube-api-access-92lkb\") pod \"downloads-6594f4c75-clsvj\" (UID: \"b0183275-cf60-40a1-b34b-5e5efc74adc9\") " pod="openshift-console/downloads-6594f4c75-clsvj"
Sep 18 20:21:34.919504 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.919436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a509bcac-d911-4782-b673-0a256f1ae05d-installation-pull-secrets\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:34.919504 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.919476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a509bcac-d911-4782-b673-0a256f1ae05d-ca-trust-extracted\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:34.934274 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:34.934198    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:35.021211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.020923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a509bcac-d911-4782-b673-0a256f1ae05d-trusted-ca\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.021211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.021019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a509bcac-d911-4782-b673-0a256f1ae05d-registry-tls\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.021211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.021055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92lkb\" (UniqueName: \"kubernetes.io/projected/b0183275-cf60-40a1-b34b-5e5efc74adc9-kube-api-access-92lkb\") pod \"downloads-6594f4c75-clsvj\" (UID: \"b0183275-cf60-40a1-b34b-5e5efc74adc9\") " pod="openshift-console/downloads-6594f4c75-clsvj"
Sep 18 20:21:35.021211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.021117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a509bcac-d911-4782-b673-0a256f1ae05d-installation-pull-secrets\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.021211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.021147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a509bcac-d911-4782-b673-0a256f1ae05d-ca-trust-extracted\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.021211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.021203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a509bcac-d911-4782-b673-0a256f1ae05d-image-registry-private-configuration\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.021593 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.021232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a509bcac-d911-4782-b673-0a256f1ae05d-registry-certificates\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.021593 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.021272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lztsh\" (UniqueName: \"kubernetes.io/projected/a509bcac-d911-4782-b673-0a256f1ae05d-kube-api-access-lztsh\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.021593 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.021306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a509bcac-d911-4782-b673-0a256f1ae05d-bound-sa-token\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.022195 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.022168    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a509bcac-d911-4782-b673-0a256f1ae05d-trusted-ca\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.022195 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.022185    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a509bcac-d911-4782-b673-0a256f1ae05d-ca-trust-extracted\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.023190 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.023164    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a509bcac-d911-4782-b673-0a256f1ae05d-registry-certificates\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.024940 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.024921    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a509bcac-d911-4782-b673-0a256f1ae05d-registry-tls\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.025050 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.024983    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a509bcac-d911-4782-b673-0a256f1ae05d-installation-pull-secrets\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.025109 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.025085    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a509bcac-d911-4782-b673-0a256f1ae05d-image-registry-private-configuration\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.037136 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.037109    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a509bcac-d911-4782-b673-0a256f1ae05d-bound-sa-token\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.038535 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.038512    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lztsh\" (UniqueName: \"kubernetes.io/projected/a509bcac-d911-4782-b673-0a256f1ae05d-kube-api-access-lztsh\") pod \"image-registry-544f998677-x6rkc\" (UID: \"a509bcac-d911-4782-b673-0a256f1ae05d\") " pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.042513 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.042477    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92lkb\" (UniqueName: \"kubernetes.io/projected/b0183275-cf60-40a1-b34b-5e5efc74adc9-kube-api-access-92lkb\") pod \"downloads-6594f4c75-clsvj\" (UID: \"b0183275-cf60-40a1-b34b-5e5efc74adc9\") " pod="openshift-console/downloads-6594f4c75-clsvj"
Sep 18 20:21:35.052606 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.052569    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:35.137793 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.137760    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-clsvj"
Sep 18 20:21:35.152298 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.152268    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:35.211332 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.211295    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:35.305503 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.305422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:35.324453 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.324417    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:35.327135 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.327109    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5348af9b-8ea7-499f-81f3-e53ce18e42ee-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-wcrhm\" (UID: \"5348af9b-8ea7-499f-81f3-e53ce18e42ee\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:35.425505 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.425468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:35.425698 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.425534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:35.426177 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.426151    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eebb3de-b32f-4225-aa61-08b41feff46d-service-ca-bundle\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:35.428438 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.428403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4eebb3de-b32f-4225-aa61-08b41feff46d-metrics-certs\") pod \"router-default-755486fdf6-jwrgf\" (UID: \"4eebb3de-b32f-4225-aa61-08b41feff46d\") " pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:35.542197 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.542164    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mr6sr\""
Sep 18 20:21:35.550917 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.550889    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"
Sep 18 20:21:35.653628 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.653554    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5bwk7\""
Sep 18 20:21:35.661484 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:35.661452    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:36.171512 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:36.171479    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5b59g" event={"ID":"3fafbef2-fe0c-4220-a499-d703aa74bb7c","Type":"ContainerStarted","Data":"d47ff6f6b473898e82ecb295be86b7412b26637399249342691cadc795da026f"}
Sep 18 20:21:36.171731 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:36.171709    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:21:36.193747 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:36.193553    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5b59g" podStartSLOduration=66.509482608 podStartE2EDuration="1m11.193530446s" totalImagesPullingTime="4.684047838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:36.192299697 +0000 UTC m=+71.796478046" watchObservedRunningTime="2026-09-18 20:21:36.193530446 +0000 UTC m=+71.797708792"
Sep 18 20:21:36.310557 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:36.310519    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm"]
Sep 18 20:21:36.314391 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:36.314356    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5348af9b_8ea7_499f_81f3_e53ce18e42ee.slice/crio-382177111fa3e0a8664a67ec9d66be52499eae851d59fba482bd5eff86c01b28 WatchSource:0}: Error finding container 382177111fa3e0a8664a67ec9d66be52499eae851d59fba482bd5eff86c01b28: Status 404 returned error can't find the container with id 382177111fa3e0a8664a67ec9d66be52499eae851d59fba482bd5eff86c01b28
Sep 18 20:21:36.314913 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:36.314833    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-clsvj"]
Sep 18 20:21:36.316985 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:36.316904    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-544f998677-x6rkc"]
Sep 18 20:21:36.319495 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:36.319458    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0183275_cf60_40a1_b34b_5e5efc74adc9.slice/crio-32f90ad7a1f988f1eee25cad76af5bc3ba4118fcb7b155c609221f437597134d WatchSource:0}: Error finding container 32f90ad7a1f988f1eee25cad76af5bc3ba4118fcb7b155c609221f437597134d: Status 404 returned error can't find the container with id 32f90ad7a1f988f1eee25cad76af5bc3ba4118fcb7b155c609221f437597134d
Sep 18 20:21:36.319933 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:36.319902    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda509bcac_d911_4782_b673_0a256f1ae05d.slice/crio-c829d83a8ef188b46420bea677f79d5c6fb88385f32816d21ebc453f761ad74b WatchSource:0}: Error finding container c829d83a8ef188b46420bea677f79d5c6fb88385f32816d21ebc453f761ad74b: Status 404 returned error can't find the container with id c829d83a8ef188b46420bea677f79d5c6fb88385f32816d21ebc453f761ad74b
Sep 18 20:21:36.333106 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:36.333081    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-755486fdf6-jwrgf"]
Sep 18 20:21:37.178583 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.178529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-clsvj" event={"ID":"b0183275-cf60-40a1-b34b-5e5efc74adc9","Type":"ContainerStarted","Data":"32f90ad7a1f988f1eee25cad76af5bc3ba4118fcb7b155c609221f437597134d"}
Sep 18 20:21:37.180575 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.180518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4l4bl" event={"ID":"20943fec-278e-4c96-8729-0309298862e5","Type":"ContainerStarted","Data":"6ea822e9d445303eb272b78341470a2dbcdc62d5a18fd46a2f39d5b41409b2eb"}
Sep 18 20:21:37.182168 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.182140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm" event={"ID":"5348af9b-8ea7-499f-81f3-e53ce18e42ee","Type":"ContainerStarted","Data":"382177111fa3e0a8664a67ec9d66be52499eae851d59fba482bd5eff86c01b28"}
Sep 18 20:21:37.184273 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.184241    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-755486fdf6-jwrgf" event={"ID":"4eebb3de-b32f-4225-aa61-08b41feff46d","Type":"ContainerStarted","Data":"abfd5eab10af7278808c627355d62d66d9cf91522db403ad86ba905f00a8d07e"}
Sep 18 20:21:37.184395 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.184291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-755486fdf6-jwrgf" event={"ID":"4eebb3de-b32f-4225-aa61-08b41feff46d","Type":"ContainerStarted","Data":"62f2beed279a2a265f598776eda8b2099f9d9c6f7c86a2117a479763c419600b"}
Sep 18 20:21:37.186607 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.186583    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zgqnr" event={"ID":"55a7ca5f-82b2-4f88-923e-1ba0f52c4808","Type":"ContainerStarted","Data":"ea58d47161746b69f941878ddaa7da6a4cd25f4aef3755895ad055e7f6da5e57"}
Sep 18 20:21:37.186718 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.186629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zgqnr" event={"ID":"55a7ca5f-82b2-4f88-923e-1ba0f52c4808","Type":"ContainerStarted","Data":"9634bb0d76f509b36c8d672ddf07d7454d6241b5da352b05a49a462764ae8dd6"}
Sep 18 20:21:37.186718 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.186690    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:37.188923 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.188847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-544f998677-x6rkc" event={"ID":"a509bcac-d911-4782-b673-0a256f1ae05d","Type":"ContainerStarted","Data":"bf85e1bfa06d20a741118820cbeb1886700448e1081922abdef2d65af4ac1248"}
Sep 18 20:21:37.188923 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.188893    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-544f998677-x6rkc" event={"ID":"a509bcac-d911-4782-b673-0a256f1ae05d","Type":"ContainerStarted","Data":"c829d83a8ef188b46420bea677f79d5c6fb88385f32816d21ebc453f761ad74b"}
Sep 18 20:21:37.189170 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.189147    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:37.224625 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.224571    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4l4bl" podStartSLOduration=67.226320064 podStartE2EDuration="1m12.224552046s" totalImagesPullingTime="4.998231982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:37.200612593 +0000 UTC m=+72.804790961" watchObservedRunningTime="2026-09-18 20:21:37.224552046 +0000 UTC m=+72.828730409"
Sep 18 20:21:37.225061 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.225024    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-755486fdf6-jwrgf" podStartSLOduration=34.225011968 podStartE2EDuration="34.225011968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:37.223356513 +0000 UTC m=+72.827534872" watchObservedRunningTime="2026-09-18 20:21:37.225011968 +0000 UTC m=+72.829190324"
Sep 18 20:21:37.256625 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.256567    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-544f998677-x6rkc" podStartSLOduration=3.256545758 podStartE2EDuration="3.256545758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:37.256096881 +0000 UTC m=+72.860275251" watchObservedRunningTime="2026-09-18 20:21:37.256545758 +0000 UTC m=+72.860724105"
Sep 18 20:21:37.282878 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.282797    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zgqnr" podStartSLOduration=33.960392108 podStartE2EDuration="38.282778077s" totalImagesPullingTime="4.322385969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:37.281508122 +0000 UTC m=+72.885686491" watchObservedRunningTime="2026-09-18 20:21:37.282778077 +0000 UTC m=+72.886956421"
Sep 18 20:21:37.662171 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.662132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:37.665170 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:37.664926    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:38.085696 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.085659    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5db9474986-nkz2g"]
Sep 18 20:21:38.088617 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.088593    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.090839 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.090814    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 20:21:38.091267 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.091243    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 20:21:38.091394 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.091281    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-88xm9\""
Sep 18 20:21:38.091457 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.091416    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 20:21:38.091937 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.091654    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 20:21:38.091937 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.091688    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 20:21:38.101150 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.101125    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5db9474986-nkz2g"]
Sep 18 20:21:38.195120 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.195029    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm" event={"ID":"5348af9b-8ea7-499f-81f3-e53ce18e42ee","Type":"ContainerStarted","Data":"6c98e78a6ad58d8096a4132f8e5c90733e0fa601161c4c2a70bfd78f5fe58f88"}
Sep 18 20:21:38.195625 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.195581    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:38.197385 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.197363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-755486fdf6-jwrgf"
Sep 18 20:21:38.214431 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.214359    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-wcrhm" podStartSLOduration=33.435589989 podStartE2EDuration="35.21433566s" totalImagesPullingTime="1.778745671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:38.214059971 +0000 UTC m=+73.818238320" watchObservedRunningTime="2026-09-18 20:21:38.21433566 +0000 UTC m=+73.818514006"
Sep 18 20:21:38.248693 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.248013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-console-config\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.248693 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.248114    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdpng\" (UniqueName: \"kubernetes.io/projected/74415323-f157-4eec-8e71-0686ff6b1f61-kube-api-access-kdpng\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.248693 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.248163    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-service-ca\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.248693 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.248193    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-oauth-config\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.248693 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.248211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-serving-cert\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.248693 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.248240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-oauth-serving-cert\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.351265 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.351177    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-console-config\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.351416 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.351294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdpng\" (UniqueName: \"kubernetes.io/projected/74415323-f157-4eec-8e71-0686ff6b1f61-kube-api-access-kdpng\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.351416 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.351379    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-service-ca\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.351531 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.351430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-oauth-config\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.351531 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.351477    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-serving-cert\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.351629 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.351547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-oauth-serving-cert\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.352113 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.352087    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-console-config\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.352908 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.352309    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-service-ca\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.353773 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.353703    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-oauth-serving-cert\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.356592 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.356524    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-oauth-config\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.356712 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.356611    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-serving-cert\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.365005 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.360976    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdpng\" (UniqueName: \"kubernetes.io/projected/74415323-f157-4eec-8e71-0686ff6b1f61-kube-api-access-kdpng\") pod \"console-5db9474986-nkz2g\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") " pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.380669 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.380632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:38.400442 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.400397    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:38.473474 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.473433    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:38.640550 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.640455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:38.705255 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.705218    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5db9474986-nkz2g"]
Sep 18 20:21:38.706177 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:38.706147    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74415323_f157_4eec_8e71_0686ff6b1f61.slice/crio-31d634e8c437d42823fc2439cf3d584aadbcefb474881c73adbe7bdd7a3a7695 WatchSource:0}: Error finding container 31d634e8c437d42823fc2439cf3d584aadbcefb474881c73adbe7bdd7a3a7695: Status 404 returned error can't find the container with id 31d634e8c437d42823fc2439cf3d584aadbcefb474881c73adbe7bdd7a3a7695
Sep 18 20:21:38.832249 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:38.832209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:39.205076 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:39.205028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db9474986-nkz2g" event={"ID":"74415323-f157-4eec-8e71-0686ff6b1f61","Type":"ContainerStarted","Data":"31d634e8c437d42823fc2439cf3d584aadbcefb474881c73adbe7bdd7a3a7695"}
Sep 18 20:21:43.684905 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:43.684788    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:43.771554 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:43.771498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:43.916037 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:43.915973    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:44.008551 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:44.008461    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:44.227762 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:44.227728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db9474986-nkz2g" event={"ID":"74415323-f157-4eec-8e71-0686ff6b1f61","Type":"ContainerStarted","Data":"c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17"}
Sep 18 20:21:44.245910 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:44.245656    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5db9474986-nkz2g" podStartSLOduration=1.555232784 podStartE2EDuration="6.245633588s" totalImagesPullingTime="4.690400804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:44.244932007 +0000 UTC m=+79.849110355" watchObservedRunningTime="2026-09-18 20:21:44.245633588 +0000 UTC m=+79.849811950"
Sep 18 20:21:44.775213 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:44.775181    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:21:44.885772 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:44.885698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:44.986950 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:44.986911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:45.782750 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:45.782712    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:45.955097 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:45.955054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:46.047566 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:46.047488    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:47.197980 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:47.197856    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zgqnr"
Sep 18 20:21:47.436740 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:47.436705    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:47.527682 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:47.527650    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:47.898094 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:47.898013    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:48.151669 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.151560    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:48.274288 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.274223    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"]
Sep 18 20:21:48.279058 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.279036    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.282217 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.282196    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 20:21:48.282363 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.282327    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8x8sf\""
Sep 18 20:21:48.282363 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.282327    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 18 20:21:48.283732 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.283672    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 18 20:21:48.286935 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.286784    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 18 20:21:48.306432 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.306396    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"]
Sep 18 20:21:48.309803 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.309768    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-brh65"]
Sep 18 20:21:48.313981 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.313464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.313981 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.313519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:48.323257 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.323226    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 20:21:48.324219 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.324197    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 20:21:48.324356 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.324209    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-42k9n\""
Sep 18 20:21:48.324465 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.324441    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 20:21:48.400802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.400764    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:48.400986 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.400831    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:48.406170 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.406105    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:48.421937 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.421903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:48.443560 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c44c1a-d595-4b16-8620-ed89457e3f52-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.443560 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.443792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k584r\" (UniqueName: \"kubernetes.io/projected/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-api-access-k584r\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.443792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-textfile\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.443792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-tls\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.443792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.443792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d72600b3-4c15-451d-a3bf-dafda91eb364-metrics-client-ca\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.443792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.443792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-accelerators-collector-config\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.443792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443794    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d72600b3-4c15-451d-a3bf-dafda91eb364-sys\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.444152 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c3c44c1a-d595-4b16-8620-ed89457e3f52-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.444152 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b94kt\" (UniqueName: \"kubernetes.io/projected/d72600b3-4c15-451d-a3bf-dafda91eb364-kube-api-access-b94kt\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.444152 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-wtmp\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.444152 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.443970    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.444152 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.444024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d72600b3-4c15-451d-a3bf-dafda91eb364-root\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.545525 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-wtmp\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.545730 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.545730 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d72600b3-4c15-451d-a3bf-dafda91eb364-root\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.545849 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d72600b3-4c15-451d-a3bf-dafda91eb364-root\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.545849 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c44c1a-d595-4b16-8620-ed89457e3f52-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.545849 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-wtmp\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.545849 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.545849 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k584r\" (UniqueName: \"kubernetes.io/projected/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-api-access-k584r\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.546120 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-textfile\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.546120 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-tls\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.546120 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.545960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.546120 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:48.545975    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 20:21:48.546120 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d72600b3-4c15-451d-a3bf-dafda91eb364-metrics-client-ca\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.546120 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:48.546058    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-tls podName:d72600b3-4c15-451d-a3bf-dafda91eb364 nodeName:}" failed. No retries permitted until 2026-09-18 20:21:49.046036693 +0000 UTC m=+84.650215034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-tls") pod "node-exporter-brh65" (UID: "d72600b3-4c15-451d-a3bf-dafda91eb364") : secret "node-exporter-tls" not found
Sep 18 20:21:48.546120 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.546451 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546124    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-accelerators-collector-config\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.546451 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d72600b3-4c15-451d-a3bf-dafda91eb364-sys\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.546451 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c3c44c1a-d595-4b16-8620-ed89457e3f52-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.546451 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546289    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b94kt\" (UniqueName: \"kubernetes.io/projected/d72600b3-4c15-451d-a3bf-dafda91eb364-kube-api-access-b94kt\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.546451 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-textfile\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.546700 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546565    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c44c1a-d595-4b16-8620-ed89457e3f52-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.546700 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546595    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d72600b3-4c15-451d-a3bf-dafda91eb364-metrics-client-ca\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.546700 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.546600    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d72600b3-4c15-451d-a3bf-dafda91eb364-sys\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.547139 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.547043    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c3c44c1a-d595-4b16-8620-ed89457e3f52-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.547384 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.547338    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.547530 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.547502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-accelerators-collector-config\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.549108 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.549088    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.549509 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.549462    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.549509 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.549485    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.564876 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.564849    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k584r\" (UniqueName: \"kubernetes.io/projected/c3c44c1a-d595-4b16-8620-ed89457e3f52-kube-api-access-k584r\") pod \"kube-state-metrics-84c885658c-tlq2g\" (UID: \"c3c44c1a-d595-4b16-8620-ed89457e3f52\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.566684 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.566664    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b94kt\" (UniqueName: \"kubernetes.io/projected/d72600b3-4c15-451d-a3bf-dafda91eb364-kube-api-access-b94kt\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:48.590686 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.590639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"
Sep 18 20:21:48.694752 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.694666    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:48.841599 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:48.841561    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:49.051819 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:49.051776    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-tls\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:49.054345 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:49.054316    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d72600b3-4c15-451d-a3bf-dafda91eb364-node-exporter-tls\") pod \"node-exporter-brh65\" (UID: \"d72600b3-4c15-451d-a3bf-dafda91eb364\") " pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:49.069836 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:49.069801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:49.224496 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:49.224464    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-brh65"
Sep 18 20:21:49.253090 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:49.253052    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:21:49.461115 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:49.461011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:49.597771 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:49.597723    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:49.751449 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:49.751362    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:51.283486 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.283439    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:51.386773 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.386727    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:51.728047 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.727911    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66766bf99d-mm5sk"]
Sep 18 20:21:51.734936 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.734902    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.737937 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.737910    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 18 20:21:51.738119 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.738022    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 18 20:21:51.738119 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.738047    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 18 20:21:51.738119 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.738115    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 18 20:21:51.738351 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.738332    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dbrvz\""
Sep 18 20:21:51.738412 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.738336    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 18 20:21:51.738693 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.738666    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f2fssi3e1kg5d\""
Sep 18 20:21:51.741098 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.741007    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:51.748445 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.748367    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66766bf99d-mm5sk"]
Sep 18 20:21:51.876787 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.876750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-metrics-client-ca\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.876965 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.876799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.876965 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.876845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.876965 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.876889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-grpc-tls\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.876965 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.876912    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-tls\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.876965 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.876941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.877223 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.877077    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2nsm\" (UniqueName: \"kubernetes.io/projected/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-kube-api-access-c2nsm\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.877223 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.877131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.916222 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.916181    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:51.977726 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.977689    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-metrics-client-ca\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.977930 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.977802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.977930 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.977872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.978102 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.977972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-grpc-tls\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.978102 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.978026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-tls\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.978102 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.978063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.978239 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.978105    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2nsm\" (UniqueName: \"kubernetes.io/projected/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-kube-api-access-c2nsm\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.978239 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.978134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.978706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.978604    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-metrics-client-ca\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.981403 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.981374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.981529 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.981458    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-grpc-tls\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.981641 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.981594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-tls\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.981841 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.981822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.981936 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.981912    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:51.982149 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:51.982112    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:52.003198 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.003160    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2nsm\" (UniqueName: \"kubernetes.io/projected/d48d29c2-27fe-4fab-9f42-3cd66f7d6730-kube-api-access-c2nsm\") pod \"thanos-querier-66766bf99d-mm5sk\" (UID: \"d48d29c2-27fe-4fab-9f42-3cd66f7d6730\") " pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:52.046854 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.046812    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:21:52.354821 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.354785    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:52.451602 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.451488    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:52.929645 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.929607    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"]
Sep 18 20:21:52.937561 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.937522    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:52.973942 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.973901    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"]
Sep 18 20:21:52.974150 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.974039    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:52.976813 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.976791    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-km4sj\""
Sep 18 20:21:52.977153 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.977127    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 18 20:21:52.986696 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.986673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5tkc\" (UniqueName: \"kubernetes.io/projected/a12ff131-81b1-47f3-b758-219a078b666d-kube-api-access-t5tkc\") pod \"monitoring-plugin-5984459ff8-dr7sv\" (UID: \"a12ff131-81b1-47f3-b758-219a078b666d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:52.986824 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:52.986732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a12ff131-81b1-47f3-b758-219a078b666d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-dr7sv\" (UID: \"a12ff131-81b1-47f3-b758-219a078b666d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:53.044040 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.043977    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:53.087907 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.087859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a12ff131-81b1-47f3-b758-219a078b666d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-dr7sv\" (UID: \"a12ff131-81b1-47f3-b758-219a078b666d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:53.088099 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:53.088034    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 18 20:21:53.088099 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.088039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tkc\" (UniqueName: \"kubernetes.io/projected/a12ff131-81b1-47f3-b758-219a078b666d-kube-api-access-t5tkc\") pod \"monitoring-plugin-5984459ff8-dr7sv\" (UID: \"a12ff131-81b1-47f3-b758-219a078b666d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:53.088223 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:21:53.088106    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a12ff131-81b1-47f3-b758-219a078b666d-monitoring-plugin-cert podName:a12ff131-81b1-47f3-b758-219a078b666d nodeName:}" failed. No retries permitted until 2026-09-18 20:21:53.588082812 +0000 UTC m=+89.192261159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a12ff131-81b1-47f3-b758-219a078b666d-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-dr7sv" (UID: "a12ff131-81b1-47f3-b758-219a078b666d") : secret "monitoring-plugin-cert" not found
Sep 18 20:21:53.096763 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.096735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5tkc\" (UniqueName: \"kubernetes.io/projected/a12ff131-81b1-47f3-b758-219a078b666d-kube-api-access-t5tkc\") pod \"monitoring-plugin-5984459ff8-dr7sv\" (UID: \"a12ff131-81b1-47f3-b758-219a078b666d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:53.148235 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:53.148194    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72600b3_4c15_451d_a3bf_dafda91eb364.slice/crio-76f520b3397cd25f5cae539cc5a5e57afc2eacadea4f2d06a650eab3dd86bc75 WatchSource:0}: Error finding container 76f520b3397cd25f5cae539cc5a5e57afc2eacadea4f2d06a650eab3dd86bc75: Status 404 returned error can't find the container with id 76f520b3397cd25f5cae539cc5a5e57afc2eacadea4f2d06a650eab3dd86bc75
Sep 18 20:21:53.267317 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.267285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brh65" event={"ID":"d72600b3-4c15-451d-a3bf-dafda91eb364","Type":"ContainerStarted","Data":"76f520b3397cd25f5cae539cc5a5e57afc2eacadea4f2d06a650eab3dd86bc75"}
Sep 18 20:21:53.270351 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.270323    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:53.418257 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.418225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tlq2g"]
Sep 18 20:21:53.422174 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.422153    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66766bf99d-mm5sk"]
Sep 18 20:21:53.422244 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:53.422175    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c44c1a_d595_4b16_8620_ed89457e3f52.slice/crio-bed3302311bcb0fe9e611ba17ac82517d7810410a8e78b490e505582e4656fa9 WatchSource:0}: Error finding container bed3302311bcb0fe9e611ba17ac82517d7810410a8e78b490e505582e4656fa9: Status 404 returned error can't find the container with id bed3302311bcb0fe9e611ba17ac82517d7810410a8e78b490e505582e4656fa9
Sep 18 20:21:53.424531 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:53.424488    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48d29c2_27fe_4fab_9f42_3cd66f7d6730.slice/crio-e621775bfc088810599c4c5c06d7d8ffd3eebcd6815748685646858bb13d4ba6 WatchSource:0}: Error finding container e621775bfc088810599c4c5c06d7d8ffd3eebcd6815748685646858bb13d4ba6: Status 404 returned error can't find the container with id e621775bfc088810599c4c5c06d7d8ffd3eebcd6815748685646858bb13d4ba6
Sep 18 20:21:53.594091 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.594052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a12ff131-81b1-47f3-b758-219a078b666d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-dr7sv\" (UID: \"a12ff131-81b1-47f3-b758-219a078b666d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:53.596661 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.596637    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a12ff131-81b1-47f3-b758-219a078b666d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-dr7sv\" (UID: \"a12ff131-81b1-47f3-b758-219a078b666d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:53.885253 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:53.885018    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:54.190149 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.190061    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"]
Sep 18 20:21:54.235028 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.234874    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:54.279798 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.279686    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk" event={"ID":"d48d29c2-27fe-4fab-9f42-3cd66f7d6730","Type":"ContainerStarted","Data":"e621775bfc088810599c4c5c06d7d8ffd3eebcd6815748685646858bb13d4ba6"}
Sep 18 20:21:54.282454 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.282423    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g" event={"ID":"c3c44c1a-d595-4b16-8620-ed89457e3f52","Type":"ContainerStarted","Data":"bed3302311bcb0fe9e611ba17ac82517d7810410a8e78b490e505582e4656fa9"}
Sep 18 20:21:54.286267 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.286234    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-clsvj" event={"ID":"b0183275-cf60-40a1-b34b-5e5efc74adc9","Type":"ContainerStarted","Data":"5a5bb56bb8de79ebfbbb412e501a7f73e85a36dd82ae3fb3936a8cf662cf0bd7"}
Sep 18 20:21:54.287375 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.287353    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-clsvj"
Sep 18 20:21:54.298637 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.298356    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-clsvj"
Sep 18 20:21:54.318898 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.316711    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-clsvj" podStartSLOduration=3.243636157 podStartE2EDuration="20.316687111s" totalImagesPullingTime="17.073050954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:54.302780634 +0000 UTC m=+89.906958984" watchObservedRunningTime="2026-09-18 20:21:54.316687111 +0000 UTC m=+89.920865460"
Sep 18 20:21:54.323619 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.323564    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:54.597458 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:54.597414    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12ff131_81b1_47f3_b758_219a078b666d.slice/crio-7ef2fb05e4ab91c3eab066256c97ba7a54f2b85b70609d0d73710c1bbabc9323 WatchSource:0}: Error finding container 7ef2fb05e4ab91c3eab066256c97ba7a54f2b85b70609d0d73710c1bbabc9323: Status 404 returned error can't find the container with id 7ef2fb05e4ab91c3eab066256c97ba7a54f2b85b70609d0d73710c1bbabc9323
Sep 18 20:21:54.604268 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.604242    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6df7d7864d-2c9vz"]
Sep 18 20:21:54.627793 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.626726    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df7d7864d-2c9vz"]
Sep 18 20:21:54.627793 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.626835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.636755 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.636638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:54.638920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.638893    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 20:21:54.646744 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.645659    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 20:21:54.658698 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.658529    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.661764 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.661728    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 18 20:21:54.662669 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.662554    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 18 20:21:54.662669 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.662620    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 18 20:21:54.662832 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.662719    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 18 20:21:54.662832 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.662830    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 18 20:21:54.662945 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.662893    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c45rm\""
Sep 18 20:21:54.662945 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.662916    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 18 20:21:54.663075 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.663014    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 18 20:21:54.665015 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.663733    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 18 20:21:54.665015 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.664159    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1i0v64341jod5\""
Sep 18 20:21:54.665015 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.664387    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 18 20:21:54.665015 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.664786    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 18 20:21:54.666019 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.665375    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 18 20:21:54.666019 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.665585    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 18 20:21:54.666019 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.665836    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 18 20:21:54.666211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.666038    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 18 20:21:54.669510 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.669491    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 18 20:21:54.680710 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.680679    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 20:21:54.727629 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k4wh\" (UniqueName: \"kubernetes.io/projected/1f1a516e-76a2-4394-ad29-19a732c8ea6c-kube-api-access-6k4wh\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.727629 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-config\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-service-ca\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82e84cd2-9062-4149-8fe1-67dd40db3d46-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-serving-cert\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-oauth-serving-cert\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-oauth-config\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.727872 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-web-config\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.727974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-config\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5rn9\" (UniqueName: \"kubernetes.io/projected/82e84cd2-9062-4149-8fe1-67dd40db3d46-kube-api-access-x5rn9\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-trusted-ca-bundle\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.728391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728929 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82e84cd2-9062-4149-8fe1-67dd40db3d46-config-out\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728929 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.728929 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.728562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830082    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830162    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830262    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-config\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5rn9\" (UniqueName: \"kubernetes.io/projected/82e84cd2-9062-4149-8fe1-67dd40db3d46-kube-api-access-x5rn9\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-trusted-ca-bundle\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82e84cd2-9062-4149-8fe1-67dd40db3d46-config-out\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k4wh\" (UniqueName: \"kubernetes.io/projected/1f1a516e-76a2-4394-ad29-19a732c8ea6c-kube-api-access-6k4wh\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-config\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.831353 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830613    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830648    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-service-ca\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82e84cd2-9062-4149-8fe1-67dd40db3d46-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830696    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-serving-cert\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830796    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-oauth-serving-cert\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-oauth-config\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.830874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-web-config\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.832393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.831668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-trusted-ca-bundle\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.832887 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.832531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-service-ca\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.832887 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.832877    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.833011 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.832944    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.833074 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.833036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.834614 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.834580    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.836418 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.836319    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.836536 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.836472    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-config\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.837698 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.837667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-config\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.838545 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.838156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.839606 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.839077    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.839606 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.839510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.840757 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.840723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.842370 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.841962    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-oauth-serving-cert\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.842370 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.842028    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k4wh\" (UniqueName: \"kubernetes.io/projected/1f1a516e-76a2-4394-ad29-19a732c8ea6c-kube-api-access-6k4wh\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.842722 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.842697    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/82e84cd2-9062-4149-8fe1-67dd40db3d46-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.842863 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.842836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.843248 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.843224    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82e84cd2-9062-4149-8fe1-67dd40db3d46-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.843359 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.843271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-oauth-config\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.843583 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.843551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-serving-cert\") pod \"console-6df7d7864d-2c9vz\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") " pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.844288 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.844230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.846073 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.845294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.846073 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.845601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82e84cd2-9062-4149-8fe1-67dd40db3d46-config-out\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.846073 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.845906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5rn9\" (UniqueName: \"kubernetes.io/projected/82e84cd2-9062-4149-8fe1-67dd40db3d46-kube-api-access-x5rn9\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.846073 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.846068    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.846780 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.846706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-web-config\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.852720 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.852645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82e84cd2-9062-4149-8fe1-67dd40db3d46-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82e84cd2-9062-4149-8fe1-67dd40db3d46\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:54.944227 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.944190    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:21:54.976795 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:54.976739    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:21:55.293139 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:55.293072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv" event={"ID":"a12ff131-81b1-47f3-b758-219a078b666d","Type":"ContainerStarted","Data":"7ef2fb05e4ab91c3eab066256c97ba7a54f2b85b70609d0d73710c1bbabc9323"}
Sep 18 20:21:56.824793 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:56.824071    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6df7d7864d-2c9vz"]
Sep 18 20:21:56.832368 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:21:56.832336    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1a516e_76a2_4394_ad29_19a732c8ea6c.slice/crio-174d22141471ab160b001d2bc3d367ee7a5c9c2d48d723284c5569c61fa3c5e9 WatchSource:0}: Error finding container 174d22141471ab160b001d2bc3d367ee7a5c9c2d48d723284c5569c61fa3c5e9: Status 404 returned error can't find the container with id 174d22141471ab160b001d2bc3d367ee7a5c9c2d48d723284c5569c61fa3c5e9
Sep 18 20:21:56.848945 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:56.848906    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 18 20:21:57.305289 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.305249    2561 generic.go:356] "Generic (PLEG): container finished" podID="d72600b3-4c15-451d-a3bf-dafda91eb364" containerID="1650ae98a5187a065f4e3d98364f20793a16cf5af1fc6391705bbeebddaef844" exitCode=0
Sep 18 20:21:57.305510 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.305401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brh65" event={"ID":"d72600b3-4c15-451d-a3bf-dafda91eb364","Type":"ContainerDied","Data":"1650ae98a5187a065f4e3d98364f20793a16cf5af1fc6391705bbeebddaef844"}
Sep 18 20:21:57.309449 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.309235    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk" event={"ID":"d48d29c2-27fe-4fab-9f42-3cd66f7d6730","Type":"ContainerStarted","Data":"8e39d7a3f98ba42349ac0061c1eae2404bd0f94a6e5137046be7d047bdfa970a"}
Sep 18 20:21:57.309449 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.309325    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk" event={"ID":"d48d29c2-27fe-4fab-9f42-3cd66f7d6730","Type":"ContainerStarted","Data":"4c7fc1c853322f6b27f5c5b59e4ad55461d783f2bc22f2dc1ae62d44e68e9a16"}
Sep 18 20:21:57.309449 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.309411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk" event={"ID":"d48d29c2-27fe-4fab-9f42-3cd66f7d6730","Type":"ContainerStarted","Data":"b33be6123d4eece88ce00ece544317ae0dce2da398dcd0379737ca36369e5d45"}
Sep 18 20:21:57.312128 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.311886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df7d7864d-2c9vz" event={"ID":"1f1a516e-76a2-4394-ad29-19a732c8ea6c","Type":"ContainerStarted","Data":"39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de"}
Sep 18 20:21:57.312128 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.311931    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df7d7864d-2c9vz" event={"ID":"1f1a516e-76a2-4394-ad29-19a732c8ea6c","Type":"ContainerStarted","Data":"174d22141471ab160b001d2bc3d367ee7a5c9c2d48d723284c5569c61fa3c5e9"}
Sep 18 20:21:57.316082 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.316053    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g" event={"ID":"c3c44c1a-d595-4b16-8620-ed89457e3f52","Type":"ContainerStarted","Data":"9c87f05562796010a0a694bb7bb1d06ae40aac26ceb1c0b04f3d94793793c54e"}
Sep 18 20:21:57.316202 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.316114    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g" event={"ID":"c3c44c1a-d595-4b16-8620-ed89457e3f52","Type":"ContainerStarted","Data":"5a68f7b34f6792ff62559a301504477b88f7977cd05ec5488d75352a6f07dd11"}
Sep 18 20:21:57.316202 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.316143    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g" event={"ID":"c3c44c1a-d595-4b16-8620-ed89457e3f52","Type":"ContainerStarted","Data":"90a28b05831010974fe717fb01b34bfa694b8275f97c23bef393cc549bef144d"}
Sep 18 20:21:57.318450 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.318368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82e84cd2-9062-4149-8fe1-67dd40db3d46","Type":"ContainerStarted","Data":"3fa5c8d88c88efa50b223ba2f135f5bdc600a9ffd95811aaeb7c2c613cc68de2"}
Sep 18 20:21:57.354933 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.354353    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6df7d7864d-2c9vz" podStartSLOduration=3.354329499 podStartE2EDuration="3.354329499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:57.352288025 +0000 UTC m=+92.956466372" watchObservedRunningTime="2026-09-18 20:21:57.354329499 +0000 UTC m=+92.958507847"
Sep 18 20:21:57.378676 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:57.378610    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-tlq2g" podStartSLOduration=6.293676898 podStartE2EDuration="9.378590698s" totalImagesPullingTime="3.0849138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:57.376470884 +0000 UTC m=+92.980649225" watchObservedRunningTime="2026-09-18 20:21:57.378590698 +0000 UTC m=+92.982769045"
Sep 18 20:21:58.200941 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:58.200913    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-544f998677-x6rkc"
Sep 18 20:21:58.405273 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:58.405232    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:58.505281 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:58.505195    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:58.607733 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:58.607694    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:58.684249 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:58.684209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:59.333293 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.333253    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brh65" event={"ID":"d72600b3-4c15-451d-a3bf-dafda91eb364","Type":"ContainerStarted","Data":"9dc558fb91b068a76bc095811df8defa1e57b030bd37bd3ed4c40836f79e4f68"}
Sep 18 20:21:59.333794 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.333322    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-brh65" event={"ID":"d72600b3-4c15-451d-a3bf-dafda91eb364","Type":"ContainerStarted","Data":"780c9a5f7625ecae07c182a9e592919e39b84e5a391b4d7eed4efca18a3f55cd"}
Sep 18 20:21:59.335355 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.335317    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv" event={"ID":"a12ff131-81b1-47f3-b758-219a078b666d","Type":"ContainerStarted","Data":"54eec386a7171107e035cdc3f4ec1ca20a0f64b8f39895f472d75bf333365404"}
Sep 18 20:21:59.335488 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.335380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:59.338015 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.337315    2561 generic.go:356] "Generic (PLEG): container finished" podID="82e84cd2-9062-4149-8fe1-67dd40db3d46" containerID="adca1d67f8198355374ee8f4932b3e43ce5bfd923e1993bfcfbb7536ce71a599" exitCode=0
Sep 18 20:21:59.338015 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.337362    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82e84cd2-9062-4149-8fe1-67dd40db3d46","Type":"ContainerDied","Data":"adca1d67f8198355374ee8f4932b3e43ce5bfd923e1993bfcfbb7536ce71a599"}
Sep 18 20:21:59.341631 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.341606    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv"
Sep 18 20:21:59.356731 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.356675    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-brh65" podStartSLOduration=7.892465297 podStartE2EDuration="11.356658408s" totalImagesPullingTime="3.328924784s" totalInitContainerRuntime="135.268327ms" isStatefulPod=true podCreationTimestamp="2026-09-18 20:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:59.355180185 +0000 UTC m=+94.959358562" watchObservedRunningTime="2026-09-18 20:21:59.356658408 +0000 UTC m=+94.960836754"
Sep 18 20:21:59.372701 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.372651    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-dr7sv" podStartSLOduration=3.054712342 podStartE2EDuration="7.372634482s" totalImagesPullingTime="4.31792214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:21:59.371317766 +0000 UTC m=+94.975496125" watchObservedRunningTime="2026-09-18 20:21:59.372634482 +0000 UTC m=+94.976812828"
Sep 18 20:21:59.790975 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:21:59.790871    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-648759fc98-jzvdm" podUID="6b477695-9014-456f-9f89-a8ee0b48e7a4" containerName="registry" containerID="cri-o://7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f" gracePeriod=30
Sep 18 20:22:00.083442 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.083405    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:22:00.194884 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.194788    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") pod \"6b477695-9014-456f-9f89-a8ee0b48e7a4\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") "
Sep 18 20:22:00.194884 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.194859    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-bound-sa-token\") pod \"6b477695-9014-456f-9f89-a8ee0b48e7a4\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") "
Sep 18 20:22:00.195211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.194893    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b477695-9014-456f-9f89-a8ee0b48e7a4-ca-trust-extracted\") pod \"6b477695-9014-456f-9f89-a8ee0b48e7a4\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") "
Sep 18 20:22:00.195211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.194927    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-trusted-ca\") pod \"6b477695-9014-456f-9f89-a8ee0b48e7a4\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") "
Sep 18 20:22:00.195211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.194983    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbk8k\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-kube-api-access-xbk8k\") pod \"6b477695-9014-456f-9f89-a8ee0b48e7a4\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") "
Sep 18 20:22:00.195211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.195045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-image-registry-private-configuration\") pod \"6b477695-9014-456f-9f89-a8ee0b48e7a4\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") "
Sep 18 20:22:00.195211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.195074    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-installation-pull-secrets\") pod \"6b477695-9014-456f-9f89-a8ee0b48e7a4\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") "
Sep 18 20:22:00.195211 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.195126    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-certificates\") pod \"6b477695-9014-456f-9f89-a8ee0b48e7a4\" (UID: \"6b477695-9014-456f-9f89-a8ee0b48e7a4\") "
Sep 18 20:22:00.195842 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.195798    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6b477695-9014-456f-9f89-a8ee0b48e7a4" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:22:00.195986 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.195805    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6b477695-9014-456f-9f89-a8ee0b48e7a4" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:22:00.199707 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.199653    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6b477695-9014-456f-9f89-a8ee0b48e7a4" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:22:00.200202 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.200137    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6b477695-9014-456f-9f89-a8ee0b48e7a4" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:22:00.200202 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.200174    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6b477695-9014-456f-9f89-a8ee0b48e7a4" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:22:00.208583 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.208299    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-kube-api-access-xbk8k" (OuterVolumeSpecName: "kube-api-access-xbk8k") pod "6b477695-9014-456f-9f89-a8ee0b48e7a4" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4"). InnerVolumeSpecName "kube-api-access-xbk8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:22:00.208583 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.208453    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6b477695-9014-456f-9f89-a8ee0b48e7a4" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:22:00.210157 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.210128    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b477695-9014-456f-9f89-a8ee0b48e7a4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6b477695-9014-456f-9f89-a8ee0b48e7a4" (UID: "6b477695-9014-456f-9f89-a8ee0b48e7a4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:22:00.296830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.296671    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:00.296830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.296711    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-bound-sa-token\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:00.296830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.296726    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b477695-9014-456f-9f89-a8ee0b48e7a4-ca-trust-extracted\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:00.296830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.296740    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-trusted-ca\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:00.296830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.296772    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbk8k\" (UniqueName: \"kubernetes.io/projected/6b477695-9014-456f-9f89-a8ee0b48e7a4-kube-api-access-xbk8k\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:00.296830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.296783    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-image-registry-private-configuration\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:00.296830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.296792    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b477695-9014-456f-9f89-a8ee0b48e7a4-installation-pull-secrets\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:00.296830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.296803    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b477695-9014-456f-9f89-a8ee0b48e7a4-registry-certificates\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:00.348286 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.348239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk" event={"ID":"d48d29c2-27fe-4fab-9f42-3cd66f7d6730","Type":"ContainerStarted","Data":"208b316eb7c68c928297eda25fa23b9d5d841091ac3aa9f8b0cef5b7a507cc62"}
Sep 18 20:22:00.348748 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.348380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk" event={"ID":"d48d29c2-27fe-4fab-9f42-3cd66f7d6730","Type":"ContainerStarted","Data":"a0b8774b3f79385ecc70663949cd57d7cc00ad643bcba36d5df588a087cd2eab"}
Sep 18 20:22:00.348748 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.348424    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk" event={"ID":"d48d29c2-27fe-4fab-9f42-3cd66f7d6730","Type":"ContainerStarted","Data":"98574308a906fd84c8482e8a235d551c81593e6c1fe310b93855707600d44445"}
Sep 18 20:22:00.348748 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.348672    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:22:00.350551 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.350524    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b477695-9014-456f-9f89-a8ee0b48e7a4" containerID="7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f" exitCode=0
Sep 18 20:22:00.350917 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.350869    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-648759fc98-jzvdm" event={"ID":"6b477695-9014-456f-9f89-a8ee0b48e7a4","Type":"ContainerDied","Data":"7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f"}
Sep 18 20:22:00.351014 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.350933    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-648759fc98-jzvdm" event={"ID":"6b477695-9014-456f-9f89-a8ee0b48e7a4","Type":"ContainerDied","Data":"2e4525256c5087e1c6991c6f17ff263185c89bc7154794411a2879e3352e380b"}
Sep 18 20:22:00.351014 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.350971    2561 scope.go:117] "RemoveContainer" containerID="7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f"
Sep 18 20:22:00.351195 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.351175    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-648759fc98-jzvdm"
Sep 18 20:22:00.364141 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.364084    2561 scope.go:117] "RemoveContainer" containerID="7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f"
Sep 18 20:22:00.365010 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:22:00.364898    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f\": container with ID starting with 7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f not found: ID does not exist" containerID="7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f"
Sep 18 20:22:00.365010 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.364945    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f"} err="failed to get container status \"7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f\": rpc error: code = NotFound desc = could not find container \"7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f\": container with ID starting with 7e8481c14756f4e029dc01cf86e23acfda11cc6c60be4b78ed490fac7edf837f not found: ID does not exist"
Sep 18 20:22:00.373367 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.373308    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk" podStartSLOduration=3.976997792 podStartE2EDuration="9.373287141s" totalImagesPullingTime="5.396289349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:22:00.370823906 +0000 UTC m=+95.975002245" watchObservedRunningTime="2026-09-18 20:22:00.373287141 +0000 UTC m=+95.977465556"
Sep 18 20:22:00.393332 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.393292    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-648759fc98-jzvdm"]
Sep 18 20:22:00.398316 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.397064    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-648759fc98-jzvdm"]
Sep 18 20:22:00.841419 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:00.841379    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b477695-9014-456f-9f89-a8ee0b48e7a4" path="/var/lib/kubelet/pods/6b477695-9014-456f-9f89-a8ee0b48e7a4/volumes"
Sep 18 20:22:01.366333 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:01.366302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66766bf99d-mm5sk"
Sep 18 20:22:01.996916 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:01.996814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:02.096235 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:02.096115    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:04.376378 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.376342    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82e84cd2-9062-4149-8fe1-67dd40db3d46","Type":"ContainerStarted","Data":"05563034969b6836d39632206a6b5eca4032d535977de3ca683d6bce0483fff3"}
Sep 18 20:22:04.376895 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.376429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82e84cd2-9062-4149-8fe1-67dd40db3d46","Type":"ContainerStarted","Data":"c9d3e8736503b45804063fe03d2267c5cb38afc9f653baff97d4964abb65031c"}
Sep 18 20:22:04.376895 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.376472    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82e84cd2-9062-4149-8fe1-67dd40db3d46","Type":"ContainerStarted","Data":"985a6d1add4591ee3278b1b94c12065ddcd790dcdd540547869ff406f4a0ae55"}
Sep 18 20:22:04.376895 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.376520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82e84cd2-9062-4149-8fe1-67dd40db3d46","Type":"ContainerStarted","Data":"0673546aee12ead360cea87f673052889ee8cd1315570308f472b322c393a87a"}
Sep 18 20:22:04.376895 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.376560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82e84cd2-9062-4149-8fe1-67dd40db3d46","Type":"ContainerStarted","Data":"599a239ac87f6876bfc8725456c6462b9145dc9579c1dee0870a85e6e044cf23"}
Sep 18 20:22:04.376895 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.376596    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82e84cd2-9062-4149-8fe1-67dd40db3d46","Type":"ContainerStarted","Data":"7e62a7461b8fcb796ee9231795b8a09d81789539dc5f347b341d4a60213ca8ec"}
Sep 18 20:22:04.406259 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.406070    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.329905231 podStartE2EDuration="10.406048173s" totalImagesPullingTime="6.067782571s" totalInitContainerRuntime="8.360371ms" isStatefulPod=false podCreationTimestamp="2026-09-18 20:21:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:22:04.404634829 +0000 UTC m=+100.008813186" watchObservedRunningTime="2026-09-18 20:22:04.406048173 +0000 UTC m=+100.010226588"
Sep 18 20:22:04.944883 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.944843    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:22:04.945169 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.944919    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:22:04.950283 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.950252    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:22:04.977746 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:04.977712    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:22:05.388321 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:05.388292    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:22:05.446825 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:05.446787    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5db9474986-nkz2g"]
Sep 18 20:22:05.576787 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:05.576751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:05.676968 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:05.676875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:05.776765 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:05.776729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:07.191683 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:07.191652    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5b59g"
Sep 18 20:22:08.152788 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:08.152751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:08.219763 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:08.219722    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:10.322122 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:10.322091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:10.423845 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:10.423807    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:10.524061 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:10.524025    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:18.431591 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:18.431499    2561 generic.go:356] "Generic (PLEG): container finished" podID="de12d8c2-08ee-4d66-b78a-8b776c1f5430" containerID="b1de05529a9714da901c27a8bcc600ef62c978ce5a23c461be247b00e92ea0a8" exitCode=0
Sep 18 20:22:18.431591 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:18.431575    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm" event={"ID":"de12d8c2-08ee-4d66-b78a-8b776c1f5430","Type":"ContainerDied","Data":"b1de05529a9714da901c27a8bcc600ef62c978ce5a23c461be247b00e92ea0a8"}
Sep 18 20:22:18.432177 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:18.432015    2561 scope.go:117] "RemoveContainer" containerID="b1de05529a9714da901c27a8bcc600ef62c978ce5a23c461be247b00e92ea0a8"
Sep 18 20:22:19.437793 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:19.437754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-h8lmm" event={"ID":"de12d8c2-08ee-4d66-b78a-8b776c1f5430","Type":"ContainerStarted","Data":"f1b809fb991d8d5a4002d29fcb0faa833da472cf89840e1bf735076ab6deed24"}
Sep 18 20:22:23.341663 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:23.341634    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:23.417480 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:23.417447    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:23.455259 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:23.455225    2561 generic.go:356] "Generic (PLEG): container finished" podID="4c5a757a-6b53-433f-bc4a-35eceaedf6f7" containerID="a30c660d955c2ef080ab96ad54bd0e53db1ccf59cdabed6fdfad3ddd4c93e638" exitCode=0
Sep 18 20:22:23.455430 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:23.455300    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd" event={"ID":"4c5a757a-6b53-433f-bc4a-35eceaedf6f7","Type":"ContainerDied","Data":"a30c660d955c2ef080ab96ad54bd0e53db1ccf59cdabed6fdfad3ddd4c93e638"}
Sep 18 20:22:23.455670 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:23.455656    2561 scope.go:117] "RemoveContainer" containerID="a30c660d955c2ef080ab96ad54bd0e53db1ccf59cdabed6fdfad3ddd4c93e638"
Sep 18 20:22:24.461387 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:24.461351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-lgdjd" event={"ID":"4c5a757a-6b53-433f-bc4a-35eceaedf6f7","Type":"ContainerStarted","Data":"0f568da93cbf77554dae4be0ec77a582dd96f3fbb37e3139e6f968e828ef5eaa"}
Sep 18 20:22:28.581424 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:28.581362    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:28.653198 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:28.653160    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:30.473327 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.473264    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5db9474986-nkz2g" podUID="74415323-f157-4eec-8e71-0686ff6b1f61" containerName="console" containerID="cri-o://c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17" gracePeriod=15
Sep 18 20:22:30.750096 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.750009    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:22:30.764389 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.764353    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-service-ca\") pod \"74415323-f157-4eec-8e71-0686ff6b1f61\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") "
Sep 18 20:22:30.764555 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.764400    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-oauth-config\") pod \"74415323-f157-4eec-8e71-0686ff6b1f61\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") "
Sep 18 20:22:30.764555 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.764426    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-oauth-serving-cert\") pod \"74415323-f157-4eec-8e71-0686ff6b1f61\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") "
Sep 18 20:22:30.764555 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.764447    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-serving-cert\") pod \"74415323-f157-4eec-8e71-0686ff6b1f61\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") "
Sep 18 20:22:30.764555 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.764483    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdpng\" (UniqueName: \"kubernetes.io/projected/74415323-f157-4eec-8e71-0686ff6b1f61-kube-api-access-kdpng\") pod \"74415323-f157-4eec-8e71-0686ff6b1f61\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") "
Sep 18 20:22:30.764555 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.764508    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-console-config\") pod \"74415323-f157-4eec-8e71-0686ff6b1f61\" (UID: \"74415323-f157-4eec-8e71-0686ff6b1f61\") "
Sep 18 20:22:30.764954 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.764863    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74415323-f157-4eec-8e71-0686ff6b1f61" (UID: "74415323-f157-4eec-8e71-0686ff6b1f61"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:22:30.764954 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.764815    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-service-ca" (OuterVolumeSpecName: "service-ca") pod "74415323-f157-4eec-8e71-0686ff6b1f61" (UID: "74415323-f157-4eec-8e71-0686ff6b1f61"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:22:30.765086 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.764968    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-console-config" (OuterVolumeSpecName: "console-config") pod "74415323-f157-4eec-8e71-0686ff6b1f61" (UID: "74415323-f157-4eec-8e71-0686ff6b1f61"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:22:30.767251 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.767213    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74415323-f157-4eec-8e71-0686ff6b1f61" (UID: "74415323-f157-4eec-8e71-0686ff6b1f61"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:22:30.767251 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.767226    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74415323-f157-4eec-8e71-0686ff6b1f61" (UID: "74415323-f157-4eec-8e71-0686ff6b1f61"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:22:30.767420 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.767402    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74415323-f157-4eec-8e71-0686ff6b1f61-kube-api-access-kdpng" (OuterVolumeSpecName: "kube-api-access-kdpng") pod "74415323-f157-4eec-8e71-0686ff6b1f61" (UID: "74415323-f157-4eec-8e71-0686ff6b1f61"). InnerVolumeSpecName "kube-api-access-kdpng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:22:30.866145 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.866111    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdpng\" (UniqueName: \"kubernetes.io/projected/74415323-f157-4eec-8e71-0686ff6b1f61-kube-api-access-kdpng\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:30.866145 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.866142    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-console-config\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:30.866145 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.866151    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-service-ca\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:30.866384 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.866159    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-oauth-config\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:30.866384 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.866167    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74415323-f157-4eec-8e71-0686ff6b1f61-oauth-serving-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:30.866384 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:30.866175    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74415323-f157-4eec-8e71-0686ff6b1f61-console-serving-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:22:31.489051 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:31.489016    2561 generic.go:356] "Generic (PLEG): container finished" podID="74415323-f157-4eec-8e71-0686ff6b1f61" containerID="c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17" exitCode=0
Sep 18 20:22:31.489478 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:31.489060    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5db9474986-nkz2g"
Sep 18 20:22:31.489478 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:31.489074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db9474986-nkz2g" event={"ID":"74415323-f157-4eec-8e71-0686ff6b1f61","Type":"ContainerDied","Data":"c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17"}
Sep 18 20:22:31.489478 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:31.489139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5db9474986-nkz2g" event={"ID":"74415323-f157-4eec-8e71-0686ff6b1f61","Type":"ContainerDied","Data":"31d634e8c437d42823fc2439cf3d584aadbcefb474881c73adbe7bdd7a3a7695"}
Sep 18 20:22:31.489478 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:31.489158    2561 scope.go:117] "RemoveContainer" containerID="c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17"
Sep 18 20:22:31.497184 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:31.497147    2561 scope.go:117] "RemoveContainer" containerID="c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17"
Sep 18 20:22:31.497491 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:22:31.497471    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17\": container with ID starting with c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17 not found: ID does not exist" containerID="c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17"
Sep 18 20:22:31.497545 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:31.497500    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17"} err="failed to get container status \"c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17\": rpc error: code = NotFound desc = could not find container \"c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17\": container with ID starting with c77e1ef3f7a61b6ccb7e461b493d470177088d3bcf04786faabaf8e54f8d4e17 not found: ID does not exist"
Sep 18 20:22:31.505492 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:31.505465    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5db9474986-nkz2g"]
Sep 18 20:22:31.511490 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:31.511468    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5db9474986-nkz2g"]
Sep 18 20:22:32.838815 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:32.838776    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74415323-f157-4eec-8e71-0686ff6b1f61" path="/var/lib/kubelet/pods/74415323-f157-4eec-8e71-0686ff6b1f61/volumes"
Sep 18 20:22:54.977926 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:54.977899    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:22:54.993509 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:54.993478    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:22:55.599744 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:22:55.599717    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 18 20:23:07.578438 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:07.578398    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:07.879094 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:07.878982    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:15.876032 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:15.875969    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:15.972988 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:15.972948    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:16.074509 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:16.074467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:16.602739 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:16.602701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:16.671334 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:16.671273    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:22.882908 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:22.882818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:22.983811 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:22.983779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:26.796549 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:26.796509    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df7d7864d-2c9vz"]
Sep 18 20:23:26.920594 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:26.920555    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:26.977323 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:26.977292    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:27.241426 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:27.241343    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:27.299663 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:27.299628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:27.850980 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:27.850947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:27.916806 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:27.916775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:28.647582 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:28.647544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:28.708220 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:28.708186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:32.696722 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:32.696673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:34.705425 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:34.705394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:34.771887 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:34.771850    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:37.937385 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:37.937342    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:38.079724 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:38.079672    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:38.175893 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:38.175834    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:43.569631 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:43.569592    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:43.668737 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:43.668701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:43.769525 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:43.769476    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:23:51.816716 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:51.816651    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6df7d7864d-2c9vz" podUID="1f1a516e-76a2-4394-ad29-19a732c8ea6c" containerName="console" containerID="cri-o://39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de" gracePeriod=15
Sep 18 20:23:52.055231 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.055204    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:23:52.159317 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159231    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-trusted-ca-bundle\") pod \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") "
Sep 18 20:23:52.159317 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159271    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-config\") pod \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") "
Sep 18 20:23:52.159317 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159313    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-service-ca\") pod \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") "
Sep 18 20:23:52.159628 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159343    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-oauth-serving-cert\") pod \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") "
Sep 18 20:23:52.159628 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159388    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-oauth-config\") pod \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") "
Sep 18 20:23:52.159628 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159415    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k4wh\" (UniqueName: \"kubernetes.io/projected/1f1a516e-76a2-4394-ad29-19a732c8ea6c-kube-api-access-6k4wh\") pod \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") "
Sep 18 20:23:52.159628 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159436    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-serving-cert\") pod \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\" (UID: \"1f1a516e-76a2-4394-ad29-19a732c8ea6c\") "
Sep 18 20:23:52.159837 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159707    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f1a516e-76a2-4394-ad29-19a732c8ea6c" (UID: "1f1a516e-76a2-4394-ad29-19a732c8ea6c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:23:52.159837 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159766    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-config" (OuterVolumeSpecName: "console-config") pod "1f1a516e-76a2-4394-ad29-19a732c8ea6c" (UID: "1f1a516e-76a2-4394-ad29-19a732c8ea6c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:23:52.159946 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159900    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f1a516e-76a2-4394-ad29-19a732c8ea6c" (UID: "1f1a516e-76a2-4394-ad29-19a732c8ea6c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:23:52.160035 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.159964    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f1a516e-76a2-4394-ad29-19a732c8ea6c" (UID: "1f1a516e-76a2-4394-ad29-19a732c8ea6c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:23:52.161681 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.161651    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f1a516e-76a2-4394-ad29-19a732c8ea6c" (UID: "1f1a516e-76a2-4394-ad29-19a732c8ea6c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:23:52.161794 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.161706    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f1a516e-76a2-4394-ad29-19a732c8ea6c" (UID: "1f1a516e-76a2-4394-ad29-19a732c8ea6c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:23:52.161794 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.161711    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f1a516e-76a2-4394-ad29-19a732c8ea6c-kube-api-access-6k4wh" (OuterVolumeSpecName: "kube-api-access-6k4wh") pod "1f1a516e-76a2-4394-ad29-19a732c8ea6c" (UID: "1f1a516e-76a2-4394-ad29-19a732c8ea6c"). InnerVolumeSpecName "kube-api-access-6k4wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:23:52.260857 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.260815    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-service-ca\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:23:52.260857 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.260849    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-oauth-serving-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:23:52.260857 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.260860    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-oauth-config\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:23:52.260857 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.260869    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k4wh\" (UniqueName: \"kubernetes.io/projected/1f1a516e-76a2-4394-ad29-19a732c8ea6c-kube-api-access-6k4wh\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:23:52.261151 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.260878    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-serving-cert\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:23:52.261151 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.260887    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-trusted-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:23:52.261151 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.260895    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f1a516e-76a2-4394-ad29-19a732c8ea6c-console-config\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:23:52.816671 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.816638    2561 generic.go:356] "Generic (PLEG): container finished" podID="1f1a516e-76a2-4394-ad29-19a732c8ea6c" containerID="39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de" exitCode=0
Sep 18 20:23:52.816846 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.816685    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6df7d7864d-2c9vz"
Sep 18 20:23:52.816846 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.816730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df7d7864d-2c9vz" event={"ID":"1f1a516e-76a2-4394-ad29-19a732c8ea6c","Type":"ContainerDied","Data":"39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de"}
Sep 18 20:23:52.816846 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.816784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6df7d7864d-2c9vz" event={"ID":"1f1a516e-76a2-4394-ad29-19a732c8ea6c","Type":"ContainerDied","Data":"174d22141471ab160b001d2bc3d367ee7a5c9c2d48d723284c5569c61fa3c5e9"}
Sep 18 20:23:52.816846 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.816806    2561 scope.go:117] "RemoveContainer" containerID="39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de"
Sep 18 20:23:52.825181 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.825166    2561 scope.go:117] "RemoveContainer" containerID="39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de"
Sep 18 20:23:52.825448 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:23:52.825430    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de\": container with ID starting with 39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de not found: ID does not exist" containerID="39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de"
Sep 18 20:23:52.825504 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.825458    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de"} err="failed to get container status \"39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de\": rpc error: code = NotFound desc = could not find container \"39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de\": container with ID starting with 39a30fd4ebb3b53b8fccb1560426efc35ef4f6292292fbd8fff6e211ff7398de not found: ID does not exist"
Sep 18 20:23:52.838843 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.838810    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6df7d7864d-2c9vz"]
Sep 18 20:23:52.841680 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:52.841657    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6df7d7864d-2c9vz"]
Sep 18 20:23:54.838538 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:23:54.838505    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f1a516e-76a2-4394-ad29-19a732c8ea6c" path="/var/lib/kubelet/pods/1f1a516e-76a2-4394-ad29-19a732c8ea6c/volumes"
Sep 18 20:24:47.808390 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:24:47.808293    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:24:53.463428 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:24:53.463384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:07.670251 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:07.670220    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:07.774525 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:07.774490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:07.874782 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:07.874743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:15.173652 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:15.173616    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:15.259492 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:15.259454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:24.759537 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:24.759509    2561 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 20:25:30.507685 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:30.507638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:32.348004 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:32.347953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:36.425962 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:36.425922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:36.689356 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:36.689266    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:36.807466 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:36.807428    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:37.147814 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:37.147781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:37.254162 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:37.254125    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:37.586539 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:37.586498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:37.700868 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:37.700832    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:38.023205 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:38.023176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:38.178322 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:38.178284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:38.347090 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:38.346971    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:25:38.437525 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:25:38.437475    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:26:35.209597 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:26:35.209556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:26:35.269938 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:26:35.269899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:26:38.622719 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:26:38.622681    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:26:38.697686 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:26:38.697650    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:26:49.727515 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:26:49.727471    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:26:49.845784 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:26:49.845743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:26:49.969420 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:26:49.969381    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:27:02.732834 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:27:02.732789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:27:02.843257 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:27:02.843216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:27:02.980498 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:27:02.980461    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:27:03.080905 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:27:03.080864    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:27:03.154007 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:27:03.153958    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:27:03.852706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:27:03.852673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:27:03.954287 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:27:03.954257    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:27:04.010467 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:27:04.010429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:27:47.761475 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:27:47.761389    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:28:22.116942 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:28:22.116903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:28:22.212091 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:28:22.212053    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:28:22.313919 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:28:22.313888    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:28:22.413624 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:28:22.413519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:28:22.512489 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:28:22.512421    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:28:23.284640 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:28:23.284597    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:28:23.383562 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:28:23.383529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:29:47.060137 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:29:47.060104    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:29:56.633202 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:29:56.633167    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:29:56.733975 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:29:56.733936    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:29:59.618052 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:29:59.618011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:29:59.720849 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:29:59.720813    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:08.924514 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:08.924479    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:09.041395 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:09.041350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:09.125496 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:09.125459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:09.216291 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:09.216216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:09.324398 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:09.324364    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:09.390250 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:09.390215    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:09.503435 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:09.503354    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:09.602291 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:09.602262    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:09.745474 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:09.745442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:30:20.870169 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:30:20.870134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:31:33.154496 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:33.154455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:31:46.434195 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:46.434158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:31:48.946493 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946453    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"]
Sep 18 20:31:48.946881 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946774    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74415323-f157-4eec-8e71-0686ff6b1f61" containerName="console"
Sep 18 20:31:48.946881 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946786    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="74415323-f157-4eec-8e71-0686ff6b1f61" containerName="console"
Sep 18 20:31:48.946881 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946796    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1a516e-76a2-4394-ad29-19a732c8ea6c" containerName="console"
Sep 18 20:31:48.946881 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946801    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1a516e-76a2-4394-ad29-19a732c8ea6c" containerName="console"
Sep 18 20:31:48.946881 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946812    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b477695-9014-456f-9f89-a8ee0b48e7a4" containerName="registry"
Sep 18 20:31:48.946881 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946818    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b477695-9014-456f-9f89-a8ee0b48e7a4" containerName="registry"
Sep 18 20:31:48.946881 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946871    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b477695-9014-456f-9f89-a8ee0b48e7a4" containerName="registry"
Sep 18 20:31:48.946881 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946886    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f1a516e-76a2-4394-ad29-19a732c8ea6c" containerName="console"
Sep 18 20:31:48.947236 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.946894    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="74415323-f157-4eec-8e71-0686ff6b1f61" containerName="console"
Sep 18 20:31:48.947822 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.947791    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:31:48.949768 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.949754    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:48.952277 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.952254    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6hbfs\""
Sep 18 20:31:48.952277 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.952273    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 20:31:48.952431 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.952274    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-ef587-kube-rbac-proxy-sar-config\""
Sep 18 20:31:48.952642 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.952626    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-ef587-serving-cert\""
Sep 18 20:31:48.962085 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:48.962062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"]
Sep 18 20:31:49.123200 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.123159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5347ba0-c5b0-4deb-970b-607e3c264bf3-openshift-service-ca-bundle\") pod \"switch-graph-ef587-6696c94f88-flwcc\" (UID: \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\") " pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:49.123392 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.123239    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5347ba0-c5b0-4deb-970b-607e3c264bf3-proxy-tls\") pod \"switch-graph-ef587-6696c94f88-flwcc\" (UID: \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\") " pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:49.137346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.137309    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:31:49.224581 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.224483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5347ba0-c5b0-4deb-970b-607e3c264bf3-openshift-service-ca-bundle\") pod \"switch-graph-ef587-6696c94f88-flwcc\" (UID: \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\") " pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:49.224760 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.224656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5347ba0-c5b0-4deb-970b-607e3c264bf3-proxy-tls\") pod \"switch-graph-ef587-6696c94f88-flwcc\" (UID: \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\") " pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:49.225150 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.225130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5347ba0-c5b0-4deb-970b-607e3c264bf3-openshift-service-ca-bundle\") pod \"switch-graph-ef587-6696c94f88-flwcc\" (UID: \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\") " pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:49.227151 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.227130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5347ba0-c5b0-4deb-970b-607e3c264bf3-proxy-tls\") pod \"switch-graph-ef587-6696c94f88-flwcc\" (UID: \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\") " pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:49.260040 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.260005    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:49.532266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.532234    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"]
Sep 18 20:31:49.535354 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:31:49.535325    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5347ba0_c5b0_4deb_970b_607e3c264bf3.slice/crio-255a237c20ca9fa4e385b828879da1e6a0b9a85d074a4d336132bc8f787d9aa2 WatchSource:0}: Error finding container 255a237c20ca9fa4e385b828879da1e6a0b9a85d074a4d336132bc8f787d9aa2: Status 404 returned error can't find the container with id 255a237c20ca9fa4e385b828879da1e6a0b9a85d074a4d336132bc8f787d9aa2
Sep 18 20:31:49.537227 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.537209    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 20:31:49.666529 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:49.666496    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" event={"ID":"b5347ba0-c5b0-4deb-970b-607e3c264bf3","Type":"ContainerStarted","Data":"255a237c20ca9fa4e385b828879da1e6a0b9a85d074a4d336132bc8f787d9aa2"}
Sep 18 20:31:52.681879 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:52.681838    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" event={"ID":"b5347ba0-c5b0-4deb-970b-607e3c264bf3","Type":"ContainerStarted","Data":"26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7"}
Sep 18 20:31:52.682322 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:52.681980    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:52.703196 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:52.703126    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" podStartSLOduration=2.331750793 podStartE2EDuration="4.703109196s" totalImagesPullingTime="2.371358403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:31:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:31:52.701827453 +0000 UTC m=+688.306005800" watchObservedRunningTime="2026-09-18 20:31:52.703109196 +0000 UTC m=+688.307287607"
Sep 18 20:31:56.897925 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:56.897886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:31:58.691679 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:58.691647    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:31:59.921234 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:59.921185    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"]
Sep 18 20:31:59.921706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:59.921405    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587" containerID="cri-o://26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7" gracePeriod=30
Sep 18 20:31:59.953987 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:31:59.953939    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:00.095074 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:00.095035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:00.191399 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:00.191284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:00.283210 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:00.283177    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:00.383832 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:00.383790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:00.598451 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:00.598416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:03.690884 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:03.690843    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:08.690468 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:08.690421    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:13.690359 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:13.690315    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:13.690740 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:13.690420    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:32:18.690163 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:18.690080    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:18.867893 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:18.867863    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"]
Sep 18 20:32:18.872807 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:18.872786    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:18.874863 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:18.874841    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Sep 18 20:32:18.874986 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:18.874945    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Sep 18 20:32:18.881390 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:18.881369    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"]
Sep 18 20:32:18.890278 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:18.890252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:18.973857 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:18.973773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fac4dd1-a86a-43bc-a97f-57689c43688e-openshift-service-ca-bundle\") pod \"model-chainer-7bcc66cdd8-xhw5g\" (UID: \"6fac4dd1-a86a-43bc-a97f-57689c43688e\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:18.973857 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:18.973811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fac4dd1-a86a-43bc-a97f-57689c43688e-proxy-tls\") pod \"model-chainer-7bcc66cdd8-xhw5g\" (UID: \"6fac4dd1-a86a-43bc-a97f-57689c43688e\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:19.075064 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.075020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fac4dd1-a86a-43bc-a97f-57689c43688e-openshift-service-ca-bundle\") pod \"model-chainer-7bcc66cdd8-xhw5g\" (UID: \"6fac4dd1-a86a-43bc-a97f-57689c43688e\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:19.075269 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.075081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fac4dd1-a86a-43bc-a97f-57689c43688e-proxy-tls\") pod \"model-chainer-7bcc66cdd8-xhw5g\" (UID: \"6fac4dd1-a86a-43bc-a97f-57689c43688e\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:19.075724 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.075691    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fac4dd1-a86a-43bc-a97f-57689c43688e-openshift-service-ca-bundle\") pod \"model-chainer-7bcc66cdd8-xhw5g\" (UID: \"6fac4dd1-a86a-43bc-a97f-57689c43688e\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:19.076229 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.076201    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:19.077638 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.077616    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fac4dd1-a86a-43bc-a97f-57689c43688e-proxy-tls\") pod \"model-chainer-7bcc66cdd8-xhw5g\" (UID: \"6fac4dd1-a86a-43bc-a97f-57689c43688e\") " pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:19.183632 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.183599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:19.459184 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.457805    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"]
Sep 18 20:32:19.463102 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:32:19.463075    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fac4dd1_a86a_43bc_a97f_57689c43688e.slice/crio-61eb7f2e301ca0d99b8cbcdae6f60ebc03d6ddc3f10dda9286380838f9527f2a WatchSource:0}: Error finding container 61eb7f2e301ca0d99b8cbcdae6f60ebc03d6ddc3f10dda9286380838f9527f2a: Status 404 returned error can't find the container with id 61eb7f2e301ca0d99b8cbcdae6f60ebc03d6ddc3f10dda9286380838f9527f2a
Sep 18 20:32:19.786728 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.786693    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" event={"ID":"6fac4dd1-a86a-43bc-a97f-57689c43688e","Type":"ContainerStarted","Data":"a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85"}
Sep 18 20:32:19.787154 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.786743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" event={"ID":"6fac4dd1-a86a-43bc-a97f-57689c43688e","Type":"ContainerStarted","Data":"61eb7f2e301ca0d99b8cbcdae6f60ebc03d6ddc3f10dda9286380838f9527f2a"}
Sep 18 20:32:19.787154 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.786813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:19.803355 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:19.803305    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" podStartSLOduration=1.8032883910000002 podStartE2EDuration="1.803288391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:32:19.802229342 +0000 UTC m=+715.406407701" watchObservedRunningTime="2026-09-18 20:32:19.803288391 +0000 UTC m=+715.407466737"
Sep 18 20:32:23.690683 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:23.690642    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:25.796518 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:25.796489    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:28.690852 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:28.690808    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:30.066664 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.066638    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:32:30.175200 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.175107    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5347ba0-c5b0-4deb-970b-607e3c264bf3-proxy-tls\") pod \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\" (UID: \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\") "
Sep 18 20:32:30.175200 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.175152    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5347ba0-c5b0-4deb-970b-607e3c264bf3-openshift-service-ca-bundle\") pod \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\" (UID: \"b5347ba0-c5b0-4deb-970b-607e3c264bf3\") "
Sep 18 20:32:30.175524 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.175500    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5347ba0-c5b0-4deb-970b-607e3c264bf3-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "b5347ba0-c5b0-4deb-970b-607e3c264bf3" (UID: "b5347ba0-c5b0-4deb-970b-607e3c264bf3"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:32:30.177337 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.177315    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5347ba0-c5b0-4deb-970b-607e3c264bf3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b5347ba0-c5b0-4deb-970b-607e3c264bf3" (UID: "b5347ba0-c5b0-4deb-970b-607e3c264bf3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:32:30.276355 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.276317    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5347ba0-c5b0-4deb-970b-607e3c264bf3-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:32:30.276355 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.276347    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b5347ba0-c5b0-4deb-970b-607e3c264bf3-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:32:30.519466 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.519387    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"]
Sep 18 20:32:30.519663 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.519612    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer" containerID="cri-o://a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85" gracePeriod=30
Sep 18 20:32:30.556249 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.556216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:30.644897 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.644853    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:30.733286 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.733247    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:30.794659 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.794618    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:30.819802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.819754    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:30.832348 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.832316    2561 generic.go:356] "Generic (PLEG): container finished" podID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerID="26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7" exitCode=0
Sep 18 20:32:30.832520 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.832361    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"
Sep 18 20:32:30.832520 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.832376    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" event={"ID":"b5347ba0-c5b0-4deb-970b-607e3c264bf3","Type":"ContainerDied","Data":"26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7"}
Sep 18 20:32:30.832520 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.832416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc" event={"ID":"b5347ba0-c5b0-4deb-970b-607e3c264bf3","Type":"ContainerDied","Data":"255a237c20ca9fa4e385b828879da1e6a0b9a85d074a4d336132bc8f787d9aa2"}
Sep 18 20:32:30.832520 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.832437    2561 scope.go:117] "RemoveContainer" containerID="26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7"
Sep 18 20:32:30.842229 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.842092    2561 scope.go:117] "RemoveContainer" containerID="26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7"
Sep 18 20:32:30.842508 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:32:30.842476    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7\": container with ID starting with 26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7 not found: ID does not exist" containerID="26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7"
Sep 18 20:32:30.842652 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.842517    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7"} err="failed to get container status \"26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7\": rpc error: code = NotFound desc = could not find container \"26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7\": container with ID starting with 26ac7e13add426eb6566911391088e0c2409077a047969fa21b7aab77e2dbfc7 not found: ID does not exist"
Sep 18 20:32:30.862172 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.862017    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"]
Sep 18 20:32:30.863507 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.863481    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-ef587-6696c94f88-flwcc"]
Sep 18 20:32:30.897701 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.897660    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:30.979754 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:30.979718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:31.080552 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:31.080464    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:32:32.839401 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:32.839362    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" path="/var/lib/kubelet/pods/b5347ba0-c5b0-4deb-970b-607e3c264bf3/volumes"
Sep 18 20:32:35.795248 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:35.795210    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:40.794492 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:40.794452    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:40.794928 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:40.794564    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:32:45.794622 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:45.794584    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:50.794750 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:50.794711    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:32:55.794935 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:32:55.794892    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:33:00.667421 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.667395    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:33:00.727428 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.727393    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fac4dd1-a86a-43bc-a97f-57689c43688e-proxy-tls\") pod \"6fac4dd1-a86a-43bc-a97f-57689c43688e\" (UID: \"6fac4dd1-a86a-43bc-a97f-57689c43688e\") "
Sep 18 20:33:00.727629 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.727442    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fac4dd1-a86a-43bc-a97f-57689c43688e-openshift-service-ca-bundle\") pod \"6fac4dd1-a86a-43bc-a97f-57689c43688e\" (UID: \"6fac4dd1-a86a-43bc-a97f-57689c43688e\") "
Sep 18 20:33:00.727792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.727772    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fac4dd1-a86a-43bc-a97f-57689c43688e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6fac4dd1-a86a-43bc-a97f-57689c43688e" (UID: "6fac4dd1-a86a-43bc-a97f-57689c43688e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:33:00.729486 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.729462    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fac4dd1-a86a-43bc-a97f-57689c43688e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6fac4dd1-a86a-43bc-a97f-57689c43688e" (UID: "6fac4dd1-a86a-43bc-a97f-57689c43688e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:33:00.828286 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.828193    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6fac4dd1-a86a-43bc-a97f-57689c43688e-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:33:00.828286 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.828233    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6fac4dd1-a86a-43bc-a97f-57689c43688e-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:33:00.950138 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.950097    2561 generic.go:356] "Generic (PLEG): container finished" podID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerID="a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85" exitCode=0
Sep 18 20:33:00.950300 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.950150    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"
Sep 18 20:33:00.950300 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.950177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" event={"ID":"6fac4dd1-a86a-43bc-a97f-57689c43688e","Type":"ContainerDied","Data":"a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85"}
Sep 18 20:33:00.950300 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.950232    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g" event={"ID":"6fac4dd1-a86a-43bc-a97f-57689c43688e","Type":"ContainerDied","Data":"61eb7f2e301ca0d99b8cbcdae6f60ebc03d6ddc3f10dda9286380838f9527f2a"}
Sep 18 20:33:00.950300 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.950252    2561 scope.go:117] "RemoveContainer" containerID="a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85"
Sep 18 20:33:00.958109 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.958088    2561 scope.go:117] "RemoveContainer" containerID="a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85"
Sep 18 20:33:00.958377 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:33:00.958359    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85\": container with ID starting with a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85 not found: ID does not exist" containerID="a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85"
Sep 18 20:33:00.958423 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.958384    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85"} err="failed to get container status \"a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85\": rpc error: code = NotFound desc = could not find container \"a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85\": container with ID starting with a350dd314a5e92293223ce6e9d47ab5e7824a0886552eadb69e7bd3dca6fee85 not found: ID does not exist"
Sep 18 20:33:00.967162 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.967141    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"]
Sep 18 20:33:00.970295 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:00.970273    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-7bcc66cdd8-xhw5g"]
Sep 18 20:33:02.838518 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:02.838482    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" path="/var/lib/kubelet/pods/6fac4dd1-a86a-43bc-a97f-57689c43688e/volumes"
Sep 18 20:33:10.192278 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.192247    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"]
Sep 18 20:33:10.192651 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.192544    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer"
Sep 18 20:33:10.192651 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.192555    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer"
Sep 18 20:33:10.192651 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.192573    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587"
Sep 18 20:33:10.192651 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.192579    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587"
Sep 18 20:33:10.192651 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.192633    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5347ba0-c5b0-4deb-970b-607e3c264bf3" containerName="switch-graph-ef587"
Sep 18 20:33:10.192651 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.192642    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fac4dd1-a86a-43bc-a97f-57689c43688e" containerName="model-chainer"
Sep 18 20:33:10.196844 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.196826    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:10.198746 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.198725    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-5b4a7-kube-rbac-proxy-sar-config\""
Sep 18 20:33:10.198871 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.198857    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-5b4a7-serving-cert\""
Sep 18 20:33:10.198917 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.198867    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 20:33:10.198981 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.198962    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6hbfs\""
Sep 18 20:33:10.202876 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.202804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:33:10.203256 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.203235    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"]
Sep 18 20:33:10.310654 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.310622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f8cf0c-7edb-421e-945f-6845cb57d0b3-openshift-service-ca-bundle\") pod \"switch-graph-5b4a7-659766d875-5zr7x\" (UID: \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\") " pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:10.310817 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.310707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50f8cf0c-7edb-421e-945f-6845cb57d0b3-proxy-tls\") pod \"switch-graph-5b4a7-659766d875-5zr7x\" (UID: \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\") " pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:10.412072 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.412022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50f8cf0c-7edb-421e-945f-6845cb57d0b3-proxy-tls\") pod \"switch-graph-5b4a7-659766d875-5zr7x\" (UID: \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\") " pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:10.412251 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.412184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f8cf0c-7edb-421e-945f-6845cb57d0b3-openshift-service-ca-bundle\") pod \"switch-graph-5b4a7-659766d875-5zr7x\" (UID: \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\") " pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:10.412316 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:33:10.412188    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-5b4a7-serving-cert: secret "switch-graph-5b4a7-serving-cert" not found
Sep 18 20:33:10.412368 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:33:10.412329    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f8cf0c-7edb-421e-945f-6845cb57d0b3-proxy-tls podName:50f8cf0c-7edb-421e-945f-6845cb57d0b3 nodeName:}" failed. No retries permitted until 2026-09-18 20:33:10.912308567 +0000 UTC m=+766.516486891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/50f8cf0c-7edb-421e-945f-6845cb57d0b3-proxy-tls") pod "switch-graph-5b4a7-659766d875-5zr7x" (UID: "50f8cf0c-7edb-421e-945f-6845cb57d0b3") : secret "switch-graph-5b4a7-serving-cert" not found
Sep 18 20:33:10.412802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.412776    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f8cf0c-7edb-421e-945f-6845cb57d0b3-openshift-service-ca-bundle\") pod \"switch-graph-5b4a7-659766d875-5zr7x\" (UID: \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\") " pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:10.611802 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.611772    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:33:10.915778 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.915671    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50f8cf0c-7edb-421e-945f-6845cb57d0b3-proxy-tls\") pod \"switch-graph-5b4a7-659766d875-5zr7x\" (UID: \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\") " pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:10.918031 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:10.918007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50f8cf0c-7edb-421e-945f-6845cb57d0b3-proxy-tls\") pod \"switch-graph-5b4a7-659766d875-5zr7x\" (UID: \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\") " pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:11.108247 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:11.108216    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:11.380571 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:11.380541    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"]
Sep 18 20:33:11.384461 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:33:11.384437    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f8cf0c_7edb_421e_945f_6845cb57d0b3.slice/crio-ea81e19420b0885f4aece8b228179b22ea99d638a6daa5d23c63d0725a9a3b2e WatchSource:0}: Error finding container ea81e19420b0885f4aece8b228179b22ea99d638a6daa5d23c63d0725a9a3b2e: Status 404 returned error can't find the container with id ea81e19420b0885f4aece8b228179b22ea99d638a6daa5d23c63d0725a9a3b2e
Sep 18 20:33:11.993672 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:11.993630    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" event={"ID":"50f8cf0c-7edb-421e-945f-6845cb57d0b3","Type":"ContainerStarted","Data":"4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0"}
Sep 18 20:33:11.993971 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:11.993694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" event={"ID":"50f8cf0c-7edb-421e-945f-6845cb57d0b3","Type":"ContainerStarted","Data":"ea81e19420b0885f4aece8b228179b22ea99d638a6daa5d23c63d0725a9a3b2e"}
Sep 18 20:33:11.993971 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:11.993772    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:12.011876 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:12.011826    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" podStartSLOduration=2.011808773 podStartE2EDuration="2.011808773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:33:12.01088877 +0000 UTC m=+767.615067129" watchObservedRunningTime="2026-09-18 20:33:12.011808773 +0000 UTC m=+767.615987119"
Sep 18 20:33:18.002884 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:18.002849    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:33:27.668816 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:27.668776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:33:40.749826 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.749794    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"]
Sep 18 20:33:40.750365 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.750248    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:33:40.754593 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.754572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:33:40.756549 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.756532    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-2bced-kube-rbac-proxy-sar-config\""
Sep 18 20:33:40.756549 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.756541    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-2bced-serving-cert\""
Sep 18 20:33:40.761456 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.761433    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"]
Sep 18 20:33:40.762889 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.762868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ec2994-6287-4215-a6c3-979f10d38af0-openshift-service-ca-bundle\") pod \"sequence-graph-2bced-68fbf74755-bnbzg\" (UID: \"18ec2994-6287-4215-a6c3-979f10d38af0\") " pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:33:40.762983 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.762911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18ec2994-6287-4215-a6c3-979f10d38af0-proxy-tls\") pod \"sequence-graph-2bced-68fbf74755-bnbzg\" (UID: \"18ec2994-6287-4215-a6c3-979f10d38af0\") " pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:33:40.864044 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.864008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18ec2994-6287-4215-a6c3-979f10d38af0-proxy-tls\") pod \"sequence-graph-2bced-68fbf74755-bnbzg\" (UID: \"18ec2994-6287-4215-a6c3-979f10d38af0\") " pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:33:40.864202 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.864084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ec2994-6287-4215-a6c3-979f10d38af0-openshift-service-ca-bundle\") pod \"sequence-graph-2bced-68fbf74755-bnbzg\" (UID: \"18ec2994-6287-4215-a6c3-979f10d38af0\") " pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:33:40.864679 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.864653    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ec2994-6287-4215-a6c3-979f10d38af0-openshift-service-ca-bundle\") pod \"sequence-graph-2bced-68fbf74755-bnbzg\" (UID: \"18ec2994-6287-4215-a6c3-979f10d38af0\") " pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:33:40.866203 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.866184    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18ec2994-6287-4215-a6c3-979f10d38af0-proxy-tls\") pod \"sequence-graph-2bced-68fbf74755-bnbzg\" (UID: \"18ec2994-6287-4215-a6c3-979f10d38af0\") " pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:33:40.893583 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:40.893541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:33:41.065345 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:41.065317    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:33:41.332351 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:41.332272    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"]
Sep 18 20:33:41.335213 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:33:41.335188    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ec2994_6287_4215_a6c3_979f10d38af0.slice/crio-b95b690977ac550e2ea84645a5c9f88fbc734857164859c30b96526a9f06e1c1 WatchSource:0}: Error finding container b95b690977ac550e2ea84645a5c9f88fbc734857164859c30b96526a9f06e1c1: Status 404 returned error can't find the container with id b95b690977ac550e2ea84645a5c9f88fbc734857164859c30b96526a9f06e1c1
Sep 18 20:33:42.116878 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:42.114954    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" event={"ID":"18ec2994-6287-4215-a6c3-979f10d38af0","Type":"ContainerStarted","Data":"cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44"}
Sep 18 20:33:42.116878 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:42.115079    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" event={"ID":"18ec2994-6287-4215-a6c3-979f10d38af0","Type":"ContainerStarted","Data":"b95b690977ac550e2ea84645a5c9f88fbc734857164859c30b96526a9f06e1c1"}
Sep 18 20:33:42.116878 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:42.115373    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:33:42.135928 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:42.135879    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" podStartSLOduration=2.135863496 podStartE2EDuration="2.135863496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:33:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:33:42.134935247 +0000 UTC m=+797.739113604" watchObservedRunningTime="2026-09-18 20:33:42.135863496 +0000 UTC m=+797.740041842"
Sep 18 20:33:48.124084 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:33:48.124009    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:36:08.424313 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:36:08.424277    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:40:05.582259 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:40:05.582168    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:40:06.752267 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:40:06.752228    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:40:45.670392 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:40:45.670358    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:25.321371 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:25.321287    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"]
Sep 18 20:41:25.323774 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:25.321494    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7" containerID="cri-o://4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0" gracePeriod=30
Sep 18 20:41:25.350718 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:25.350686    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:25.530793 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:25.530762    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:25.653154 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:25.653073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:25.741842 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:25.741807    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:25.889148 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:25.889118    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:26.047661 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:26.047631    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:28.001792 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:28.001754    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:41:33.001788 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:33.001743    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:41:38.001674 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:38.001636    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:41:38.002070 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:38.001747    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:41:43.001519 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:43.001478    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:41:48.001195 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:48.001153    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:41:53.001251 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:53.001214    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:41:55.460827 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:55.460803    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:41:55.574421 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:55.574388    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f8cf0c-7edb-421e-945f-6845cb57d0b3-openshift-service-ca-bundle\") pod \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\" (UID: \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\") "
Sep 18 20:41:55.574587 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:55.574451    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50f8cf0c-7edb-421e-945f-6845cb57d0b3-proxy-tls\") pod \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\" (UID: \"50f8cf0c-7edb-421e-945f-6845cb57d0b3\") "
Sep 18 20:41:55.574769 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:55.574744    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50f8cf0c-7edb-421e-945f-6845cb57d0b3-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "50f8cf0c-7edb-421e-945f-6845cb57d0b3" (UID: "50f8cf0c-7edb-421e-945f-6845cb57d0b3"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:41:55.576535 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:55.576489    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50f8cf0c-7edb-421e-945f-6845cb57d0b3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "50f8cf0c-7edb-421e-945f-6845cb57d0b3" (UID: "50f8cf0c-7edb-421e-945f-6845cb57d0b3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:41:55.675541 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:55.675510    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/50f8cf0c-7edb-421e-945f-6845cb57d0b3-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:41:55.675541 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:55.675534    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50f8cf0c-7edb-421e-945f-6845cb57d0b3-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:41:56.044727 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.044690    2561 generic.go:356] "Generic (PLEG): container finished" podID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerID="4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0" exitCode=0
Sep 18 20:41:56.044892 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.044733    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"
Sep 18 20:41:56.044892 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.044743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" event={"ID":"50f8cf0c-7edb-421e-945f-6845cb57d0b3","Type":"ContainerDied","Data":"4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0"}
Sep 18 20:41:56.044892 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.044785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x" event={"ID":"50f8cf0c-7edb-421e-945f-6845cb57d0b3","Type":"ContainerDied","Data":"ea81e19420b0885f4aece8b228179b22ea99d638a6daa5d23c63d0725a9a3b2e"}
Sep 18 20:41:56.044892 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.044806    2561 scope.go:117] "RemoveContainer" containerID="4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0"
Sep 18 20:41:56.053448 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.053430    2561 scope.go:117] "RemoveContainer" containerID="4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0"
Sep 18 20:41:56.053724 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:41:56.053707    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0\": container with ID starting with 4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0 not found: ID does not exist" containerID="4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0"
Sep 18 20:41:56.053774 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.053736    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0"} err="failed to get container status \"4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0\": rpc error: code = NotFound desc = could not find container \"4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0\": container with ID starting with 4d2a99e70109f676ec896a00672805e0beace7f0cbd755a76e85a8469e0e26d0 not found: ID does not exist"
Sep 18 20:41:56.066004 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.065974    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"]
Sep 18 20:41:56.069341 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.069317    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5b4a7-659766d875-5zr7x"]
Sep 18 20:41:56.215589 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.215553    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"]
Sep 18 20:41:56.215803 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.215778    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced" containerID="cri-o://cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44" gracePeriod=30
Sep 18 20:41:56.238053 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.237980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:56.339843 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.339762    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:56.416386 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.416353    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:56.501557 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.501527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:56.574478 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.574448    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:56.837961 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.837930    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" path="/var/lib/kubelet/pods/50f8cf0c-7edb-421e-945f-6845cb57d0b3/volumes"
Sep 18 20:41:56.983790 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:56.983760    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:41:58.122968 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:41:58.122932    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:42:03.123436 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:03.123395    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:42:08.123870 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:08.123828    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:42:08.124328 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:08.123947    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:42:11.974639 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:11.974597    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:12.047758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:12.047722    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:13.123114 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:13.123074    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:42:18.123006 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:18.122960    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:42:18.208416 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:18.208381    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:23.122706 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:23.122662    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:42:26.351232 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:26.351205    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:42:26.529079 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:26.529050    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ec2994-6287-4215-a6c3-979f10d38af0-openshift-service-ca-bundle\") pod \"18ec2994-6287-4215-a6c3-979f10d38af0\" (UID: \"18ec2994-6287-4215-a6c3-979f10d38af0\") "
Sep 18 20:42:26.529257 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:26.529096    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18ec2994-6287-4215-a6c3-979f10d38af0-proxy-tls\") pod \"18ec2994-6287-4215-a6c3-979f10d38af0\" (UID: \"18ec2994-6287-4215-a6c3-979f10d38af0\") "
Sep 18 20:42:26.529455 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:26.529428    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ec2994-6287-4215-a6c3-979f10d38af0-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "18ec2994-6287-4215-a6c3-979f10d38af0" (UID: "18ec2994-6287-4215-a6c3-979f10d38af0"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:42:26.530955 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:26.530927    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ec2994-6287-4215-a6c3-979f10d38af0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "18ec2994-6287-4215-a6c3-979f10d38af0" (UID: "18ec2994-6287-4215-a6c3-979f10d38af0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:42:26.630005 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:26.629963    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ec2994-6287-4215-a6c3-979f10d38af0-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:42:26.630005 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:26.629988    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18ec2994-6287-4215-a6c3-979f10d38af0-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:42:27.165036 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:27.164934    2561 generic.go:356] "Generic (PLEG): container finished" podID="18ec2994-6287-4215-a6c3-979f10d38af0" containerID="cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44" exitCode=0
Sep 18 20:42:27.165036 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:27.165011    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"
Sep 18 20:42:27.165036 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:27.165028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" event={"ID":"18ec2994-6287-4215-a6c3-979f10d38af0","Type":"ContainerDied","Data":"cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44"}
Sep 18 20:42:27.165385 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:27.165082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg" event={"ID":"18ec2994-6287-4215-a6c3-979f10d38af0","Type":"ContainerDied","Data":"b95b690977ac550e2ea84645a5c9f88fbc734857164859c30b96526a9f06e1c1"}
Sep 18 20:42:27.165385 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:27.165107    2561 scope.go:117] "RemoveContainer" containerID="cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44"
Sep 18 20:42:27.173002 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:27.172975    2561 scope.go:117] "RemoveContainer" containerID="cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44"
Sep 18 20:42:27.173258 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:42:27.173236    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44\": container with ID starting with cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44 not found: ID does not exist" containerID="cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44"
Sep 18 20:42:27.173313 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:27.173270    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44"} err="failed to get container status \"cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44\": rpc error: code = NotFound desc = could not find container \"cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44\": container with ID starting with cac930da66401002497bc348c1325f0ee85cee52876f6890925ebb246228ec44 not found: ID does not exist"
Sep 18 20:42:27.180891 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:27.180869    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"]
Sep 18 20:42:27.184443 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:27.184423    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-2bced-68fbf74755-bnbzg"]
Sep 18 20:42:28.840357 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:28.840326    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" path="/var/lib/kubelet/pods/18ec2994-6287-4215-a6c3-979f10d38af0/volumes"
Sep 18 20:42:35.599229 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.599157    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"]
Sep 18 20:42:35.599547 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.599459    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7"
Sep 18 20:42:35.599547 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.599473    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7"
Sep 18 20:42:35.599547 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.599495    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced"
Sep 18 20:42:35.599547 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.599502    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced"
Sep 18 20:42:35.599686 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.599553    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18ec2994-6287-4215-a6c3-979f10d38af0" containerName="sequence-graph-2bced"
Sep 18 20:42:35.599686 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.599560    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="50f8cf0c-7edb-421e-945f-6845cb57d0b3" containerName="switch-graph-5b4a7"
Sep 18 20:42:35.603725 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.603705    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:35.605150 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.605128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/599dd503-d5e8-405d-baf9-3a29e260e2bc-proxy-tls\") pod \"ensemble-graph-c092f-584d475545-7k5nt\" (UID: \"599dd503-d5e8-405d-baf9-3a29e260e2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:35.605248 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.605179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/599dd503-d5e8-405d-baf9-3a29e260e2bc-openshift-service-ca-bundle\") pod \"ensemble-graph-c092f-584d475545-7k5nt\" (UID: \"599dd503-d5e8-405d-baf9-3a29e260e2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:35.605958 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.605940    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 20:42:35.606159 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.605939    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c092f-kube-rbac-proxy-sar-config\""
Sep 18 20:42:35.606242 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.606222    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6hbfs\""
Sep 18 20:42:35.606446 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.606426    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-c092f-serving-cert\""
Sep 18 20:42:35.607144 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.606976    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:35.612393 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.612370    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"]
Sep 18 20:42:35.684184 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.684152    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:35.705621 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.705587    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/599dd503-d5e8-405d-baf9-3a29e260e2bc-proxy-tls\") pod \"ensemble-graph-c092f-584d475545-7k5nt\" (UID: \"599dd503-d5e8-405d-baf9-3a29e260e2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:35.705800 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.705646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/599dd503-d5e8-405d-baf9-3a29e260e2bc-openshift-service-ca-bundle\") pod \"ensemble-graph-c092f-584d475545-7k5nt\" (UID: \"599dd503-d5e8-405d-baf9-3a29e260e2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:35.706290 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.706271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/599dd503-d5e8-405d-baf9-3a29e260e2bc-openshift-service-ca-bundle\") pod \"ensemble-graph-c092f-584d475545-7k5nt\" (UID: \"599dd503-d5e8-405d-baf9-3a29e260e2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:35.707891 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.707870    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/599dd503-d5e8-405d-baf9-3a29e260e2bc-proxy-tls\") pod \"ensemble-graph-c092f-584d475545-7k5nt\" (UID: \"599dd503-d5e8-405d-baf9-3a29e260e2bc\") " pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:35.915201 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:35.915127    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:36.184804 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:36.184736    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"]
Sep 18 20:42:36.188241 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:42:36.188215    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599dd503_d5e8_405d_baf9_3a29e260e2bc.slice/crio-994e092ae3251dfea964a89646b025877e9a44f9ab729d5e79a093ec1b029bea WatchSource:0}: Error finding container 994e092ae3251dfea964a89646b025877e9a44f9ab729d5e79a093ec1b029bea: Status 404 returned error can't find the container with id 994e092ae3251dfea964a89646b025877e9a44f9ab729d5e79a093ec1b029bea
Sep 18 20:42:36.201740 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:36.201718    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" event={"ID":"599dd503-d5e8-405d-baf9-3a29e260e2bc","Type":"ContainerStarted","Data":"994e092ae3251dfea964a89646b025877e9a44f9ab729d5e79a093ec1b029bea"}
Sep 18 20:42:37.207068 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:37.207028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" event={"ID":"599dd503-d5e8-405d-baf9-3a29e260e2bc","Type":"ContainerStarted","Data":"33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07"}
Sep 18 20:42:37.207451 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:37.207209    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:37.225120 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:37.225074    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" podStartSLOduration=2.225059799 podStartE2EDuration="2.225059799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:42:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:42:37.223488257 +0000 UTC m=+1332.827666603" watchObservedRunningTime="2026-09-18 20:42:37.225059799 +0000 UTC m=+1332.829238145"
Sep 18 20:42:43.216723 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:43.216691    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:42:46.101830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:46.101797    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"]
Sep 18 20:42:46.102272 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:46.102013    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f" containerID="cri-o://33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07" gracePeriod=30
Sep 18 20:42:46.131502 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:46.131473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:46.233181 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:46.233145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:46.332044 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:46.332005    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:46.412724 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:46.412652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:46.508744 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:46.508707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:46.621010 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:46.620962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:46.724100 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:46.724012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:42:48.214466 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:48.214390    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:42:53.214282 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:53.214242    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:42:58.214434 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:58.214393    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:42:58.214883 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:42:58.214497    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:43:03.215457 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:03.215417    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:43:06.437457 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.437419    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"]
Sep 18 20:43:06.440797 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.440782    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:06.442421 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.442396    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:06.443171 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.443154    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-e7889-serving-cert\""
Sep 18 20:43:06.443247 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.443160    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-e7889-kube-rbac-proxy-sar-config\""
Sep 18 20:43:06.448460 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.448439    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"]
Sep 18 20:43:06.553090 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.553052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66f4608f-3ab4-4721-9bbe-5c6828342b00-proxy-tls\") pod \"sequence-graph-e7889-6c74498bf6-9ntcl\" (UID: \"66f4608f-3ab4-4721-9bbe-5c6828342b00\") " pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:06.553255 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.553099    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f4608f-3ab4-4721-9bbe-5c6828342b00-openshift-service-ca-bundle\") pod \"sequence-graph-e7889-6c74498bf6-9ntcl\" (UID: \"66f4608f-3ab4-4721-9bbe-5c6828342b00\") " pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:06.653822 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.653786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66f4608f-3ab4-4721-9bbe-5c6828342b00-proxy-tls\") pod \"sequence-graph-e7889-6c74498bf6-9ntcl\" (UID: \"66f4608f-3ab4-4721-9bbe-5c6828342b00\") " pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:06.654031 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.653835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f4608f-3ab4-4721-9bbe-5c6828342b00-openshift-service-ca-bundle\") pod \"sequence-graph-e7889-6c74498bf6-9ntcl\" (UID: \"66f4608f-3ab4-4721-9bbe-5c6828342b00\") " pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:06.654522 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.654501    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f4608f-3ab4-4721-9bbe-5c6828342b00-openshift-service-ca-bundle\") pod \"sequence-graph-e7889-6c74498bf6-9ntcl\" (UID: \"66f4608f-3ab4-4721-9bbe-5c6828342b00\") " pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:06.656225 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.656204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66f4608f-3ab4-4721-9bbe-5c6828342b00-proxy-tls\") pod \"sequence-graph-e7889-6c74498bf6-9ntcl\" (UID: \"66f4608f-3ab4-4721-9bbe-5c6828342b00\") " pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:06.685291 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.685263    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:06.751800 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:06.751732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:07.021901 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:07.021870    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"]
Sep 18 20:43:07.025063 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:43:07.025031    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f4608f_3ab4_4721_9bbe_5c6828342b00.slice/crio-2f35977f815fe40737e872ae806d90a1172c8c40be08d5f350aa35238580d70d WatchSource:0}: Error finding container 2f35977f815fe40737e872ae806d90a1172c8c40be08d5f350aa35238580d70d: Status 404 returned error can't find the container with id 2f35977f815fe40737e872ae806d90a1172c8c40be08d5f350aa35238580d70d
Sep 18 20:43:07.323952 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:07.323864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" event={"ID":"66f4608f-3ab4-4721-9bbe-5c6828342b00","Type":"ContainerStarted","Data":"65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c"}
Sep 18 20:43:07.323952 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:07.323919    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" event={"ID":"66f4608f-3ab4-4721-9bbe-5c6828342b00","Type":"ContainerStarted","Data":"2f35977f815fe40737e872ae806d90a1172c8c40be08d5f350aa35238580d70d"}
Sep 18 20:43:07.323952 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:07.323941    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:07.338554 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:07.338512    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" podStartSLOduration=1.338494007 podStartE2EDuration="1.338494007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:43:07.337773171 +0000 UTC m=+1362.941951517" watchObservedRunningTime="2026-09-18 20:43:07.338494007 +0000 UTC m=+1362.942672353"
Sep 18 20:43:08.214373 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:08.214335    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:43:13.214498 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:13.214462    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:43:13.333424 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:13.333394    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:16.264978 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.264948    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:43:16.360057 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.359958    2561 generic.go:356] "Generic (PLEG): container finished" podID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerID="33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07" exitCode=137
Sep 18 20:43:16.360057 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.360022    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"
Sep 18 20:43:16.360057 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.360032    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" event={"ID":"599dd503-d5e8-405d-baf9-3a29e260e2bc","Type":"ContainerDied","Data":"33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07"}
Sep 18 20:43:16.360267 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.360085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt" event={"ID":"599dd503-d5e8-405d-baf9-3a29e260e2bc","Type":"ContainerDied","Data":"994e092ae3251dfea964a89646b025877e9a44f9ab729d5e79a093ec1b029bea"}
Sep 18 20:43:16.360267 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.360109    2561 scope.go:117] "RemoveContainer" containerID="33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07"
Sep 18 20:43:16.368172 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.368155    2561 scope.go:117] "RemoveContainer" containerID="33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07"
Sep 18 20:43:16.368445 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:43:16.368425    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07\": container with ID starting with 33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07 not found: ID does not exist" containerID="33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07"
Sep 18 20:43:16.368507 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.368454    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07"} err="failed to get container status \"33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07\": rpc error: code = NotFound desc = could not find container \"33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07\": container with ID starting with 33b9a1585ac06bfb707dd5327c924097b30d34ab0be5eeebae9d1e46be6f6b07 not found: ID does not exist"
Sep 18 20:43:16.435429 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.435400    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/599dd503-d5e8-405d-baf9-3a29e260e2bc-openshift-service-ca-bundle\") pod \"599dd503-d5e8-405d-baf9-3a29e260e2bc\" (UID: \"599dd503-d5e8-405d-baf9-3a29e260e2bc\") "
Sep 18 20:43:16.435576 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.435465    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/599dd503-d5e8-405d-baf9-3a29e260e2bc-proxy-tls\") pod \"599dd503-d5e8-405d-baf9-3a29e260e2bc\" (UID: \"599dd503-d5e8-405d-baf9-3a29e260e2bc\") "
Sep 18 20:43:16.435765 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.435738    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/599dd503-d5e8-405d-baf9-3a29e260e2bc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "599dd503-d5e8-405d-baf9-3a29e260e2bc" (UID: "599dd503-d5e8-405d-baf9-3a29e260e2bc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:43:16.437475 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.437453    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/599dd503-d5e8-405d-baf9-3a29e260e2bc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "599dd503-d5e8-405d-baf9-3a29e260e2bc" (UID: "599dd503-d5e8-405d-baf9-3a29e260e2bc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:43:16.535980 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.535945    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/599dd503-d5e8-405d-baf9-3a29e260e2bc-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:43:16.535980 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.535974    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/599dd503-d5e8-405d-baf9-3a29e260e2bc-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:43:16.680629 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.680600    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"]
Sep 18 20:43:16.685804 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.685779    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-c092f-584d475545-7k5nt"]
Sep 18 20:43:16.838495 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:16.838467    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" path="/var/lib/kubelet/pods/599dd503-d5e8-405d-baf9-3a29e260e2bc/volumes"
Sep 18 20:43:17.566975 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:17.566938    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"]
Sep 18 20:43:17.567332 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:17.567148    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889" containerID="cri-o://65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c" gracePeriod=30
Sep 18 20:43:17.594912 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:17.594878    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:17.711120 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:17.711085    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:17.812899 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:17.812867    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:17.906271 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:17.906197    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:17.980836 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:17.980796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:18.331473 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:18.331438    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:43:23.331427 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:23.331380    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:43:28.332064 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:28.332022    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:43:28.332565 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:28.332140    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:33.331956 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:33.331919    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:43:38.332006 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:38.331960    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:43:43.332119 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:43.332081    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:43:47.710195 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:47.710171    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:47.776100 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:47.776071    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66f4608f-3ab4-4721-9bbe-5c6828342b00-proxy-tls\") pod \"66f4608f-3ab4-4721-9bbe-5c6828342b00\" (UID: \"66f4608f-3ab4-4721-9bbe-5c6828342b00\") "
Sep 18 20:43:47.776100 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:47.776101    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f4608f-3ab4-4721-9bbe-5c6828342b00-openshift-service-ca-bundle\") pod \"66f4608f-3ab4-4721-9bbe-5c6828342b00\" (UID: \"66f4608f-3ab4-4721-9bbe-5c6828342b00\") "
Sep 18 20:43:47.776503 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:47.776480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66f4608f-3ab4-4721-9bbe-5c6828342b00-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "66f4608f-3ab4-4721-9bbe-5c6828342b00" (UID: "66f4608f-3ab4-4721-9bbe-5c6828342b00"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:43:47.778131 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:47.778113    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66f4608f-3ab4-4721-9bbe-5c6828342b00-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "66f4608f-3ab4-4721-9bbe-5c6828342b00" (UID: "66f4608f-3ab4-4721-9bbe-5c6828342b00"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:43:47.876914 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:47.876843    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/66f4608f-3ab4-4721-9bbe-5c6828342b00-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:43:47.876914 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:47.876869    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66f4608f-3ab4-4721-9bbe-5c6828342b00-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:43:48.484465 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.484425    2561 generic.go:356] "Generic (PLEG): container finished" podID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerID="65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c" exitCode=0
Sep 18 20:43:48.484465 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.484468    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"
Sep 18 20:43:48.484723 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.484506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" event={"ID":"66f4608f-3ab4-4721-9bbe-5c6828342b00","Type":"ContainerDied","Data":"65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c"}
Sep 18 20:43:48.484723 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.484556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl" event={"ID":"66f4608f-3ab4-4721-9bbe-5c6828342b00","Type":"ContainerDied","Data":"2f35977f815fe40737e872ae806d90a1172c8c40be08d5f350aa35238580d70d"}
Sep 18 20:43:48.484723 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.484579    2561 scope.go:117] "RemoveContainer" containerID="65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c"
Sep 18 20:43:48.493015 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.492983    2561 scope.go:117] "RemoveContainer" containerID="65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c"
Sep 18 20:43:48.493282 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:43:48.493265    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c\": container with ID starting with 65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c not found: ID does not exist" containerID="65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c"
Sep 18 20:43:48.493334 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.493292    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c"} err="failed to get container status \"65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c\": rpc error: code = NotFound desc = could not find container \"65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c\": container with ID starting with 65de54a70d69da478495fa52418f7bff59bcedee6fa57c5bb0e0a089d5146d9c not found: ID does not exist"
Sep 18 20:43:48.507226 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.507199    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"]
Sep 18 20:43:48.509565 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.509544    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e7889-6c74498bf6-9ntcl"]
Sep 18 20:43:48.838024 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:48.837973    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" path="/var/lib/kubelet/pods/66f4608f-3ab4-4721-9bbe-5c6828342b00/volumes"
Sep 18 20:43:49.062465 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:49.062427    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:49.198687 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:49.198604    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:56.379418 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.379388    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"]
Sep 18 20:43:56.379779 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.379682    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f"
Sep 18 20:43:56.379779 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.379692    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f"
Sep 18 20:43:56.379779 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.379708    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889"
Sep 18 20:43:56.379779 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.379714    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889"
Sep 18 20:43:56.379779 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.379764    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="599dd503-d5e8-405d-baf9-3a29e260e2bc" containerName="ensemble-graph-c092f"
Sep 18 20:43:56.379779 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.379773    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="66f4608f-3ab4-4721-9bbe-5c6828342b00" containerName="sequence-graph-e7889"
Sep 18 20:43:56.382626 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.382609    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:56.384800 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.384779    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-4d797-kube-rbac-proxy-sar-config\""
Sep 18 20:43:56.384800 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.384797    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-4d797-serving-cert\""
Sep 18 20:43:56.384966 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.384847    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6hbfs\""
Sep 18 20:43:56.385310 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.385290    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 20:43:56.386888 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.386862    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:56.393836 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.393812    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"]
Sep 18 20:43:56.447456 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.447422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adbeb797-49d3-47a0-9de4-09fc90f6e234-proxy-tls\") pod \"ensemble-graph-4d797-7499bc55d8-mpnxg\" (UID: \"adbeb797-49d3-47a0-9de4-09fc90f6e234\") " pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:56.447656 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.447482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adbeb797-49d3-47a0-9de4-09fc90f6e234-openshift-service-ca-bundle\") pod \"ensemble-graph-4d797-7499bc55d8-mpnxg\" (UID: \"adbeb797-49d3-47a0-9de4-09fc90f6e234\") " pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:56.548546 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.548503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adbeb797-49d3-47a0-9de4-09fc90f6e234-openshift-service-ca-bundle\") pod \"ensemble-graph-4d797-7499bc55d8-mpnxg\" (UID: \"adbeb797-49d3-47a0-9de4-09fc90f6e234\") " pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:56.548749 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.548581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adbeb797-49d3-47a0-9de4-09fc90f6e234-proxy-tls\") pod \"ensemble-graph-4d797-7499bc55d8-mpnxg\" (UID: \"adbeb797-49d3-47a0-9de4-09fc90f6e234\") " pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:56.548749 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:43:56.548678    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-4d797-serving-cert: secret "ensemble-graph-4d797-serving-cert" not found
Sep 18 20:43:56.548749 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:43:56.548733    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adbeb797-49d3-47a0-9de4-09fc90f6e234-proxy-tls podName:adbeb797-49d3-47a0-9de4-09fc90f6e234 nodeName:}" failed. No retries permitted until 2026-09-18 20:43:57.048717734 +0000 UTC m=+1412.652896058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/adbeb797-49d3-47a0-9de4-09fc90f6e234-proxy-tls") pod "ensemble-graph-4d797-7499bc55d8-mpnxg" (UID: "adbeb797-49d3-47a0-9de4-09fc90f6e234") : secret "ensemble-graph-4d797-serving-cert" not found
Sep 18 20:43:56.549289 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.549263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adbeb797-49d3-47a0-9de4-09fc90f6e234-openshift-service-ca-bundle\") pod \"ensemble-graph-4d797-7499bc55d8-mpnxg\" (UID: \"adbeb797-49d3-47a0-9de4-09fc90f6e234\") " pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:56.788830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:56.788797    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:43:57.053476 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:57.053374    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adbeb797-49d3-47a0-9de4-09fc90f6e234-proxy-tls\") pod \"ensemble-graph-4d797-7499bc55d8-mpnxg\" (UID: \"adbeb797-49d3-47a0-9de4-09fc90f6e234\") " pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:57.055747 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:57.055722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adbeb797-49d3-47a0-9de4-09fc90f6e234-proxy-tls\") pod \"ensemble-graph-4d797-7499bc55d8-mpnxg\" (UID: \"adbeb797-49d3-47a0-9de4-09fc90f6e234\") " pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:57.293443 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:57.293397    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:57.564969 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:57.564934    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"]
Sep 18 20:43:57.568126 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:43:57.568104    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadbeb797_49d3_47a0_9de4_09fc90f6e234.slice/crio-36c95382de91c2e521c8d0edc372abfd61953bceaf143b7292663587c2e12ee1 WatchSource:0}: Error finding container 36c95382de91c2e521c8d0edc372abfd61953bceaf143b7292663587c2e12ee1: Status 404 returned error can't find the container with id 36c95382de91c2e521c8d0edc372abfd61953bceaf143b7292663587c2e12ee1
Sep 18 20:43:58.526434 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:58.526400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" event={"ID":"adbeb797-49d3-47a0-9de4-09fc90f6e234","Type":"ContainerStarted","Data":"c281071da4cc923cc2bae18f7e1c435baa81a79f9b514ca819b4e7c7cf129756"}
Sep 18 20:43:58.526628 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:58.526460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" event={"ID":"adbeb797-49d3-47a0-9de4-09fc90f6e234","Type":"ContainerStarted","Data":"36c95382de91c2e521c8d0edc372abfd61953bceaf143b7292663587c2e12ee1"}
Sep 18 20:43:58.526628 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:58.526535    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:43:58.547399 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:43:58.547351    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" podStartSLOduration=2.5473358729999998 podStartE2EDuration="2.547335873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:43:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:43:58.546668788 +0000 UTC m=+1414.150847147" watchObservedRunningTime="2026-09-18 20:43:58.547335873 +0000 UTC m=+1414.151514218"
Sep 18 20:44:04.536442 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:04.536413    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:44:27.842013 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:27.841956    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"]
Sep 18 20:44:27.845019 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:27.844982    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:44:27.847043 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:27.847020    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8cb8c-kube-rbac-proxy-sar-config\""
Sep 18 20:44:27.847150 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:27.847052    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8cb8c-serving-cert\""
Sep 18 20:44:27.853772 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:27.853749    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"]
Sep 18 20:44:27.857459 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:27.857436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:44:27.914158 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:27.914117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-proxy-tls\") pod \"sequence-graph-8cb8c-86db8c7d86-fnnss\" (UID: \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\") " pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:44:27.914346 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:27.914166    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-openshift-service-ca-bundle\") pod \"sequence-graph-8cb8c-86db8c7d86-fnnss\" (UID: \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\") " pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:44:28.015395 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.015360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-openshift-service-ca-bundle\") pod \"sequence-graph-8cb8c-86db8c7d86-fnnss\" (UID: \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\") " pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:44:28.015551 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.015445    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-proxy-tls\") pod \"sequence-graph-8cb8c-86db8c7d86-fnnss\" (UID: \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\") " pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:44:28.015961 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.015940    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-openshift-service-ca-bundle\") pod \"sequence-graph-8cb8c-86db8c7d86-fnnss\" (UID: \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\") " pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:44:28.017731 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.017713    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-proxy-tls\") pod \"sequence-graph-8cb8c-86db8c7d86-fnnss\" (UID: \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\") " pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:44:28.022514 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.022478    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:44:28.155465 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.155386    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:44:28.426189 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.425985    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"]
Sep 18 20:44:28.428779 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:44:28.428750    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c05394f_29ff_4c7e_8430_b7e8cb4f6931.slice/crio-c87ab0404aa2bb94aa7a8694ccf8393fcc6299570f63a57c4c062df3c52ac25a WatchSource:0}: Error finding container c87ab0404aa2bb94aa7a8694ccf8393fcc6299570f63a57c4c062df3c52ac25a: Status 404 returned error can't find the container with id c87ab0404aa2bb94aa7a8694ccf8393fcc6299570f63a57c4c062df3c52ac25a
Sep 18 20:44:28.645382 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.645341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" event={"ID":"4c05394f-29ff-4c7e-8430-b7e8cb4f6931","Type":"ContainerStarted","Data":"797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0"}
Sep 18 20:44:28.645576 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.645394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" event={"ID":"4c05394f-29ff-4c7e-8430-b7e8cb4f6931","Type":"ContainerStarted","Data":"c87ab0404aa2bb94aa7a8694ccf8393fcc6299570f63a57c4c062df3c52ac25a"}
Sep 18 20:44:28.645576 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.645479    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:44:28.661459 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:28.661411    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" podStartSLOduration=1.661398811 podStartE2EDuration="1.661398811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:44:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:44:28.660359133 +0000 UTC m=+1444.264537479" watchObservedRunningTime="2026-09-18 20:44:28.661398811 +0000 UTC m=+1444.265577157"
Sep 18 20:44:34.654892 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:44:34.654864    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:46:11.167728 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:46:11.167648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:49:36.382798 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:49:36.382765    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:49:36.448370 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:49:36.448326    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:11.457497 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:11.457421    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"]
Sep 18 20:52:11.458092 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:11.457641    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797" containerID="cri-o://c281071da4cc923cc2bae18f7e1c435baa81a79f9b514ca819b4e7c7cf129756" gracePeriod=30
Sep 18 20:52:11.502562 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:11.502530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:12.748415 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:12.748378    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:14.535046 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:14.534978    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:52:19.534282 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:19.534244    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:52:24.534729 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:24.534689    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:52:24.535181 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:24.534818    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:52:29.534266 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:29.534226    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:52:34.534583 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:34.534540    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:52:39.534799 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:39.534751    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:52:41.552536 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:41.552506    2561 generic.go:356] "Generic (PLEG): container finished" podID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerID="c281071da4cc923cc2bae18f7e1c435baa81a79f9b514ca819b4e7c7cf129756" exitCode=0
Sep 18 20:52:41.552857 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:41.552582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" event={"ID":"adbeb797-49d3-47a0-9de4-09fc90f6e234","Type":"ContainerDied","Data":"c281071da4cc923cc2bae18f7e1c435baa81a79f9b514ca819b4e7c7cf129756"}
Sep 18 20:52:41.598380 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:41.598349    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:52:41.716599 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:41.716518    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adbeb797-49d3-47a0-9de4-09fc90f6e234-proxy-tls\") pod \"adbeb797-49d3-47a0-9de4-09fc90f6e234\" (UID: \"adbeb797-49d3-47a0-9de4-09fc90f6e234\") "
Sep 18 20:52:41.716732 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:41.716609    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adbeb797-49d3-47a0-9de4-09fc90f6e234-openshift-service-ca-bundle\") pod \"adbeb797-49d3-47a0-9de4-09fc90f6e234\" (UID: \"adbeb797-49d3-47a0-9de4-09fc90f6e234\") "
Sep 18 20:52:41.716954 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:41.716929    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adbeb797-49d3-47a0-9de4-09fc90f6e234-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "adbeb797-49d3-47a0-9de4-09fc90f6e234" (UID: "adbeb797-49d3-47a0-9de4-09fc90f6e234"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:52:41.718595 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:41.718574    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adbeb797-49d3-47a0-9de4-09fc90f6e234-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "adbeb797-49d3-47a0-9de4-09fc90f6e234" (UID: "adbeb797-49d3-47a0-9de4-09fc90f6e234"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:52:41.817391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:41.817357    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adbeb797-49d3-47a0-9de4-09fc90f6e234-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:52:41.817391 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:41.817381    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/adbeb797-49d3-47a0-9de4-09fc90f6e234-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:52:42.557707 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:42.557680    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"
Sep 18 20:52:42.558220 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:42.557710    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg" event={"ID":"adbeb797-49d3-47a0-9de4-09fc90f6e234","Type":"ContainerDied","Data":"36c95382de91c2e521c8d0edc372abfd61953bceaf143b7292663587c2e12ee1"}
Sep 18 20:52:42.558220 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:42.557764    2561 scope.go:117] "RemoveContainer" containerID="c281071da4cc923cc2bae18f7e1c435baa81a79f9b514ca819b4e7c7cf129756"
Sep 18 20:52:42.576986 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:42.576964    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"]
Sep 18 20:52:42.580218 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:42.580190    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4d797-7499bc55d8-mpnxg"]
Sep 18 20:52:42.839222 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:42.839145    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" path="/var/lib/kubelet/pods/adbeb797-49d3-47a0-9de4-09fc90f6e234/volumes"
Sep 18 20:52:42.954543 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:42.954513    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"]
Sep 18 20:52:42.954742 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:42.954706    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c" containerID="cri-o://797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0" gracePeriod=30
Sep 18 20:52:42.979869 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:42.979842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:43.086290 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:43.086257    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:43.188157 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:43.188057    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:43.285411 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:43.285358    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:43.359455 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:43.359422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:43.441662 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:43.441570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:43.542458 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:43.542422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:44.653827 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:44.653784    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:52:44.810934 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:44.810889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:52:49.654144 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:49.654103    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:52:54.653852 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:54.653813    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:52:54.654284 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:54.653933    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:52:59.653130 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:52:59.653093    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:53:04.653619 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:04.653574    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:53:09.652930 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:09.652880    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:53:13.092806 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.092772    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:53:13.181122 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.181089    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-proxy-tls\") pod \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\" (UID: \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\") "
Sep 18 20:53:13.181270 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.181158    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-openshift-service-ca-bundle\") pod \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\" (UID: \"4c05394f-29ff-4c7e-8430-b7e8cb4f6931\") "
Sep 18 20:53:13.181503 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.181479    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4c05394f-29ff-4c7e-8430-b7e8cb4f6931" (UID: "4c05394f-29ff-4c7e-8430-b7e8cb4f6931"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:53:13.183222 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.183203    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4c05394f-29ff-4c7e-8430-b7e8cb4f6931" (UID: "4c05394f-29ff-4c7e-8430-b7e8cb4f6931"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:53:13.282623 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.282594    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:53:13.282623 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.282620    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c05394f-29ff-4c7e-8430-b7e8cb4f6931-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:53:13.675953 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.675867    2561 generic.go:356] "Generic (PLEG): container finished" podID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerID="797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0" exitCode=0
Sep 18 20:53:13.675953 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.675912    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"
Sep 18 20:53:13.676196 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.675952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" event={"ID":"4c05394f-29ff-4c7e-8430-b7e8cb4f6931","Type":"ContainerDied","Data":"797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0"}
Sep 18 20:53:13.676196 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.676033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss" event={"ID":"4c05394f-29ff-4c7e-8430-b7e8cb4f6931","Type":"ContainerDied","Data":"c87ab0404aa2bb94aa7a8694ccf8393fcc6299570f63a57c4c062df3c52ac25a"}
Sep 18 20:53:13.676196 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.676063    2561 scope.go:117] "RemoveContainer" containerID="797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0"
Sep 18 20:53:13.684253 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.684237    2561 scope.go:117] "RemoveContainer" containerID="797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0"
Sep 18 20:53:13.684569 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:53:13.684547    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0\": container with ID starting with 797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0 not found: ID does not exist" containerID="797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0"
Sep 18 20:53:13.684635 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.684578    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0"} err="failed to get container status \"797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0\": rpc error: code = NotFound desc = could not find container \"797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0\": container with ID starting with 797ce9a458a8b16ef9507f49bbead62ee04e959aac1d44d75a5497eaa8f59cc0 not found: ID does not exist"
Sep 18 20:53:13.696016 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.695980    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"]
Sep 18 20:53:13.700433 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:13.700410    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8cb8c-86db8c7d86-fnnss"]
Sep 18 20:53:14.838910 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:14.838874    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" path="/var/lib/kubelet/pods/4c05394f-29ff-4c7e-8430-b7e8cb4f6931/volumes"
Sep 18 20:53:21.722387 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.722300    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"]
Sep 18 20:53:21.722826 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.722725    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797"
Sep 18 20:53:21.722826 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.722742    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797"
Sep 18 20:53:21.722826 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.722775    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c"
Sep 18 20:53:21.722826 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.722782    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c"
Sep 18 20:53:21.723044 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.722854    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="adbeb797-49d3-47a0-9de4-09fc90f6e234" containerName="ensemble-graph-4d797"
Sep 18 20:53:21.723044 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.722871    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c05394f-29ff-4c7e-8430-b7e8cb4f6931" containerName="sequence-graph-8cb8c"
Sep 18 20:53:21.727215 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.727194    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:21.728342 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.728316    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:21.729658 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.729642    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 18 20:53:21.729774 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.729641    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-854fa-kube-rbac-proxy-sar-config\""
Sep 18 20:53:21.729912 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.729896    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-854fa-serving-cert\""
Sep 18 20:53:21.730403 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.730387    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-6hbfs\""
Sep 18 20:53:21.746162 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.746138    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"]
Sep 18 20:53:21.850262 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.850230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c85d72-eb57-47a0-87ec-08a7e8dda741-openshift-service-ca-bundle\") pod \"splitter-graph-854fa-7c7884b54-vxpwn\" (UID: \"18c85d72-eb57-47a0-87ec-08a7e8dda741\") " pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:21.850461 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.850282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18c85d72-eb57-47a0-87ec-08a7e8dda741-proxy-tls\") pod \"splitter-graph-854fa-7c7884b54-vxpwn\" (UID: \"18c85d72-eb57-47a0-87ec-08a7e8dda741\") " pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:21.951677 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.951640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18c85d72-eb57-47a0-87ec-08a7e8dda741-proxy-tls\") pod \"splitter-graph-854fa-7c7884b54-vxpwn\" (UID: \"18c85d72-eb57-47a0-87ec-08a7e8dda741\") " pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:21.951857 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.951707    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c85d72-eb57-47a0-87ec-08a7e8dda741-openshift-service-ca-bundle\") pod \"splitter-graph-854fa-7c7884b54-vxpwn\" (UID: \"18c85d72-eb57-47a0-87ec-08a7e8dda741\") " pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:21.951857 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:53:21.951806    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-854fa-serving-cert: secret "splitter-graph-854fa-serving-cert" not found
Sep 18 20:53:21.951933 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:53:21.951884    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c85d72-eb57-47a0-87ec-08a7e8dda741-proxy-tls podName:18c85d72-eb57-47a0-87ec-08a7e8dda741 nodeName:}" failed. No retries permitted until 2026-09-18 20:53:22.451866971 +0000 UTC m=+1978.056045300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/18c85d72-eb57-47a0-87ec-08a7e8dda741-proxy-tls") pod "splitter-graph-854fa-7c7884b54-vxpwn" (UID: "18c85d72-eb57-47a0-87ec-08a7e8dda741") : secret "splitter-graph-854fa-serving-cert" not found
Sep 18 20:53:21.952307 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:21.952289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c85d72-eb57-47a0-87ec-08a7e8dda741-openshift-service-ca-bundle\") pod \"splitter-graph-854fa-7c7884b54-vxpwn\" (UID: \"18c85d72-eb57-47a0-87ec-08a7e8dda741\") " pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:22.164963 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:22.164931    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:22.455489 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:22.455397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18c85d72-eb57-47a0-87ec-08a7e8dda741-proxy-tls\") pod \"splitter-graph-854fa-7c7884b54-vxpwn\" (UID: \"18c85d72-eb57-47a0-87ec-08a7e8dda741\") " pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:22.457940 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:22.457918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18c85d72-eb57-47a0-87ec-08a7e8dda741-proxy-tls\") pod \"splitter-graph-854fa-7c7884b54-vxpwn\" (UID: \"18c85d72-eb57-47a0-87ec-08a7e8dda741\") " pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:22.637228 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:22.637185    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:22.905887 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:22.905853    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"]
Sep 18 20:53:22.908855 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:53:22.908826    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c85d72_eb57_47a0_87ec_08a7e8dda741.slice/crio-08c366808bbeec0961183e49f30283c83fec9242c5344c13c75cf47a519a74dc WatchSource:0}: Error finding container 08c366808bbeec0961183e49f30283c83fec9242c5344c13c75cf47a519a74dc: Status 404 returned error can't find the container with id 08c366808bbeec0961183e49f30283c83fec9242c5344c13c75cf47a519a74dc
Sep 18 20:53:23.721592 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:23.721558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" event={"ID":"18c85d72-eb57-47a0-87ec-08a7e8dda741","Type":"ContainerStarted","Data":"5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d"}
Sep 18 20:53:23.721756 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:23.721608    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" event={"ID":"18c85d72-eb57-47a0-87ec-08a7e8dda741","Type":"ContainerStarted","Data":"08c366808bbeec0961183e49f30283c83fec9242c5344c13c75cf47a519a74dc"}
Sep 18 20:53:23.721756 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:23.721695    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:23.736922 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:23.736883    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" podStartSLOduration=2.736865165 podStartE2EDuration="2.736865165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:53:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:53:23.736073989 +0000 UTC m=+1979.340252335" watchObservedRunningTime="2026-09-18 20:53:23.736865165 +0000 UTC m=+1979.341043524"
Sep 18 20:53:29.730583 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:29.730555    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:32.623645 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:32.623614    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"]
Sep 18 20:53:32.624056 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:32.623792    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa" containerID="cri-o://5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d" gracePeriod=30
Sep 18 20:53:32.653231 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:32.653202    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:32.743596 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:32.743568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:32.840476 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:32.840447    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:32.948247 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:32.948166    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:33.237530 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:33.237450    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:33.332530 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:33.332501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:34.730069 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:34.730027    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:53:39.729464 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:39.729419    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:53:44.729764 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:44.729729    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:53:44.730258 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:44.729824    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:53:49.729413 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:49.729375    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:53:53.202239 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.202210    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"]
Sep 18 20:53:53.205670 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.205649    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:53.207640 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.207622    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-c7ffd-kube-rbac-proxy-sar-config\""
Sep 18 20:53:53.207716 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.207676    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-c7ffd-serving-cert\""
Sep 18 20:53:53.208100 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.208079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec22540-100a-462b-a26a-b2fef6511bb0-openshift-service-ca-bundle\") pod \"switch-graph-c7ffd-6f479c9f46-cq62h\" (UID: \"3ec22540-100a-462b-a26a-b2fef6511bb0\") " pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:53.208156 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.208109    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ec22540-100a-462b-a26a-b2fef6511bb0-proxy-tls\") pod \"switch-graph-c7ffd-6f479c9f46-cq62h\" (UID: \"3ec22540-100a-462b-a26a-b2fef6511bb0\") " pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:53.215577 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.215528    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:53.215806 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.215790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"]
Sep 18 20:53:53.308474 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.308442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec22540-100a-462b-a26a-b2fef6511bb0-openshift-service-ca-bundle\") pod \"switch-graph-c7ffd-6f479c9f46-cq62h\" (UID: \"3ec22540-100a-462b-a26a-b2fef6511bb0\") " pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:53.308474 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.308476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ec22540-100a-462b-a26a-b2fef6511bb0-proxy-tls\") pod \"switch-graph-c7ffd-6f479c9f46-cq62h\" (UID: \"3ec22540-100a-462b-a26a-b2fef6511bb0\") " pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:53.308705 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:53:53.308594    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-c7ffd-serving-cert: secret "switch-graph-c7ffd-serving-cert" not found
Sep 18 20:53:53.308742 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:53:53.308723    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec22540-100a-462b-a26a-b2fef6511bb0-proxy-tls podName:3ec22540-100a-462b-a26a-b2fef6511bb0 nodeName:}" failed. No retries permitted until 2026-09-18 20:53:53.808640974 +0000 UTC m=+2009.412819298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3ec22540-100a-462b-a26a-b2fef6511bb0-proxy-tls") pod "switch-graph-c7ffd-6f479c9f46-cq62h" (UID: "3ec22540-100a-462b-a26a-b2fef6511bb0") : secret "switch-graph-c7ffd-serving-cert" not found
Sep 18 20:53:53.309004 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.308975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec22540-100a-462b-a26a-b2fef6511bb0-openshift-service-ca-bundle\") pod \"switch-graph-c7ffd-6f479c9f46-cq62h\" (UID: \"3ec22540-100a-462b-a26a-b2fef6511bb0\") " pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:53.799225 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.799171    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:53:53.812236 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.812208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ec22540-100a-462b-a26a-b2fef6511bb0-proxy-tls\") pod \"switch-graph-c7ffd-6f479c9f46-cq62h\" (UID: \"3ec22540-100a-462b-a26a-b2fef6511bb0\") " pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:53.814562 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.814541    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ec22540-100a-462b-a26a-b2fef6511bb0-proxy-tls\") pod \"switch-graph-c7ffd-6f479c9f46-cq62h\" (UID: \"3ec22540-100a-462b-a26a-b2fef6511bb0\") " pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:53.816435 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:53.816417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:54.086906 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:54.086833    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"]
Sep 18 20:53:54.090324 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:53:54.090301    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec22540_100a_462b_a26a_b2fef6511bb0.slice/crio-7fefb1e2861536e6872f1ffb01b2969e5dc6410d5426df7f10b8efbd67aa2ae5 WatchSource:0}: Error finding container 7fefb1e2861536e6872f1ffb01b2969e5dc6410d5426df7f10b8efbd67aa2ae5: Status 404 returned error can't find the container with id 7fefb1e2861536e6872f1ffb01b2969e5dc6410d5426df7f10b8efbd67aa2ae5
Sep 18 20:53:54.729499 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:54.729460    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:53:54.844927 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:54.844893    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" event={"ID":"3ec22540-100a-462b-a26a-b2fef6511bb0","Type":"ContainerStarted","Data":"e907bef8d2f63cb8de68d2751e3035314326c53fef32bf3f3731c9a1b38a4dd9"}
Sep 18 20:53:54.845136 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:54.844943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" event={"ID":"3ec22540-100a-462b-a26a-b2fef6511bb0","Type":"ContainerStarted","Data":"7fefb1e2861536e6872f1ffb01b2969e5dc6410d5426df7f10b8efbd67aa2ae5"}
Sep 18 20:53:54.845136 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:54.845045    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:53:54.862053 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:54.861978    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" podStartSLOduration=1.8619598210000001 podStartE2EDuration="1.861959821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:53:54.861153979 +0000 UTC m=+2010.465332331" watchObservedRunningTime="2026-09-18 20:53:54.861959821 +0000 UTC m=+2010.466138168"
Sep 18 20:53:59.730007 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:53:59.729943    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:54:00.855224 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:00.855197    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 20:54:02.765090 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.765066    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:54:02.777237 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.777218    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18c85d72-eb57-47a0-87ec-08a7e8dda741-proxy-tls\") pod \"18c85d72-eb57-47a0-87ec-08a7e8dda741\" (UID: \"18c85d72-eb57-47a0-87ec-08a7e8dda741\") "
Sep 18 20:54:02.777330 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.777286    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c85d72-eb57-47a0-87ec-08a7e8dda741-openshift-service-ca-bundle\") pod \"18c85d72-eb57-47a0-87ec-08a7e8dda741\" (UID: \"18c85d72-eb57-47a0-87ec-08a7e8dda741\") "
Sep 18 20:54:02.777618 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.777595    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18c85d72-eb57-47a0-87ec-08a7e8dda741-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "18c85d72-eb57-47a0-87ec-08a7e8dda741" (UID: "18c85d72-eb57-47a0-87ec-08a7e8dda741"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:54:02.779267 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.779246    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18c85d72-eb57-47a0-87ec-08a7e8dda741-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "18c85d72-eb57-47a0-87ec-08a7e8dda741" (UID: "18c85d72-eb57-47a0-87ec-08a7e8dda741"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:54:02.877455 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.877422    2561 generic.go:356] "Generic (PLEG): container finished" podID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerID="5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d" exitCode=0
Sep 18 20:54:02.877655 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.877472    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"
Sep 18 20:54:02.877655 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.877510    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" event={"ID":"18c85d72-eb57-47a0-87ec-08a7e8dda741","Type":"ContainerDied","Data":"5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d"}
Sep 18 20:54:02.877655 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.877569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn" event={"ID":"18c85d72-eb57-47a0-87ec-08a7e8dda741","Type":"ContainerDied","Data":"08c366808bbeec0961183e49f30283c83fec9242c5344c13c75cf47a519a74dc"}
Sep 18 20:54:02.877655 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.877597    2561 scope.go:117] "RemoveContainer" containerID="5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d"
Sep 18 20:54:02.877878 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.877823    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18c85d72-eb57-47a0-87ec-08a7e8dda741-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:54:02.877878 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.877846    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/18c85d72-eb57-47a0-87ec-08a7e8dda741-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 20:54:02.885640 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.885625    2561 scope.go:117] "RemoveContainer" containerID="5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d"
Sep 18 20:54:02.885907 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:54:02.885888    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d\": container with ID starting with 5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d not found: ID does not exist" containerID="5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d"
Sep 18 20:54:02.885959 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.885915    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d"} err="failed to get container status \"5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d\": rpc error: code = NotFound desc = could not find container \"5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d\": container with ID starting with 5892c0e5e878cd9d40e5eb898ebe8470811a073be85cb14892ee840b3a888c1d not found: ID does not exist"
Sep 18 20:54:02.894726 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.894703    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"]
Sep 18 20:54:02.898587 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:02.898564    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-854fa-7c7884b54-vxpwn"]
Sep 18 20:54:04.838125 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:04.838098    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" path="/var/lib/kubelet/pods/18c85d72-eb57-47a0-87ec-08a7e8dda741/volumes"
Sep 18 20:54:28.566890 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:28.566855    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:54:28.631081 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:28.631047    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:54:42.867407 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:42.867377    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"]
Sep 18 20:54:42.867758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:42.867674    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa"
Sep 18 20:54:42.867758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:42.867686    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa"
Sep 18 20:54:42.867758 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:42.867737    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18c85d72-eb57-47a0-87ec-08a7e8dda741" containerName="splitter-graph-854fa"
Sep 18 20:54:42.870227 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:42.870200    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:42.872254 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:42.872232    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-8bda6-serving-cert\""
Sep 18 20:54:42.872830 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:42.872805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-8bda6-kube-rbac-proxy-sar-config\""
Sep 18 20:54:42.873652 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:42.873629    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:54:42.878258 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:42.878240    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"]
Sep 18 20:54:43.006047 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:43.005974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/403dd61d-f001-4634-ab2d-373d397f4b78-proxy-tls\") pod \"splitter-graph-8bda6-546cf494dd-ndzbv\" (UID: \"403dd61d-f001-4634-ab2d-373d397f4b78\") " pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:43.006047 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:43.006045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403dd61d-f001-4634-ab2d-373d397f4b78-openshift-service-ca-bundle\") pod \"splitter-graph-8bda6-546cf494dd-ndzbv\" (UID: \"403dd61d-f001-4634-ab2d-373d397f4b78\") " pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:43.107386 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:43.107354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/403dd61d-f001-4634-ab2d-373d397f4b78-proxy-tls\") pod \"splitter-graph-8bda6-546cf494dd-ndzbv\" (UID: \"403dd61d-f001-4634-ab2d-373d397f4b78\") " pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:43.107590 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:43.107395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403dd61d-f001-4634-ab2d-373d397f4b78-openshift-service-ca-bundle\") pod \"splitter-graph-8bda6-546cf494dd-ndzbv\" (UID: \"403dd61d-f001-4634-ab2d-373d397f4b78\") " pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:43.107590 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:54:43.107530    2561 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-8bda6-serving-cert: secret "splitter-graph-8bda6-serving-cert" not found
Sep 18 20:54:43.107715 ip-10-0-136-235 kubenswrapper[2561]: E0918 20:54:43.107625    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/403dd61d-f001-4634-ab2d-373d397f4b78-proxy-tls podName:403dd61d-f001-4634-ab2d-373d397f4b78 nodeName:}" failed. No retries permitted until 2026-09-18 20:54:43.607605869 +0000 UTC m=+2059.211784195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/403dd61d-f001-4634-ab2d-373d397f4b78-proxy-tls") pod "splitter-graph-8bda6-546cf494dd-ndzbv" (UID: "403dd61d-f001-4634-ab2d-373d397f4b78") : secret "splitter-graph-8bda6-serving-cert" not found
Sep 18 20:54:43.108035 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:43.107979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403dd61d-f001-4634-ab2d-373d397f4b78-openshift-service-ca-bundle\") pod \"splitter-graph-8bda6-546cf494dd-ndzbv\" (UID: \"403dd61d-f001-4634-ab2d-373d397f4b78\") " pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:43.270633 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:43.270602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 20:54:43.613018 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:43.612915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/403dd61d-f001-4634-ab2d-373d397f4b78-proxy-tls\") pod \"splitter-graph-8bda6-546cf494dd-ndzbv\" (UID: \"403dd61d-f001-4634-ab2d-373d397f4b78\") " pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:43.617102 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:43.617074    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/403dd61d-f001-4634-ab2d-373d397f4b78-proxy-tls\") pod \"splitter-graph-8bda6-546cf494dd-ndzbv\" (UID: \"403dd61d-f001-4634-ab2d-373d397f4b78\") " pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:43.780920 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:43.780887    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:44.057941 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:44.057911    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"]
Sep 18 20:54:44.062062 ip-10-0-136-235 kubenswrapper[2561]: W0918 20:54:44.062032    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403dd61d_f001_4634_ab2d_373d397f4b78.slice/crio-60129401d1da8dbc8f4090daa7783d641cb806ee7ceda93ee515423048fcdff3 WatchSource:0}: Error finding container 60129401d1da8dbc8f4090daa7783d641cb806ee7ceda93ee515423048fcdff3: Status 404 returned error can't find the container with id 60129401d1da8dbc8f4090daa7783d641cb806ee7ceda93ee515423048fcdff3
Sep 18 20:54:45.045878 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:45.045836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" event={"ID":"403dd61d-f001-4634-ab2d-373d397f4b78","Type":"ContainerStarted","Data":"75ab60f65f58fc7a2c68360294074076a3d6e7216ae3121a3d27ef012e4260d7"}
Sep 18 20:54:45.046092 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:45.045892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" event={"ID":"403dd61d-f001-4634-ab2d-373d397f4b78","Type":"ContainerStarted","Data":"60129401d1da8dbc8f4090daa7783d641cb806ee7ceda93ee515423048fcdff3"}
Sep 18 20:54:45.046092 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:45.045943    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:54:45.067570 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:45.067521    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" podStartSLOduration=3.067507023 podStartE2EDuration="3.067507023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:54:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:54:45.066674513 +0000 UTC m=+2060.670852862" watchObservedRunningTime="2026-09-18 20:54:45.067507023 +0000 UTC m=+2060.671685385"
Sep 18 20:54:51.055035 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:54:51.054783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 20:59:37.379972 ip-10-0-136-235 kubenswrapper[2561]: I0918 20:59:37.379928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:00:29.102550 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:00:29.102510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:02:57.914527 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:02:57.914495    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"]
Sep 18 21:02:57.915114 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:02:57.914705    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6" containerID="cri-o://75ab60f65f58fc7a2c68360294074076a3d6e7216ae3121a3d27ef012e4260d7" gracePeriod=30
Sep 18 21:02:57.966470 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:02:57.966442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:02:58.067789 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:02:58.067759    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:02:58.166449 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:02:58.166370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:03:01.053928 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:01.053891    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:03:06.052908 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:06.052868    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:03:11.053453 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:11.053400    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:03:11.053815 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:11.053507    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 21:03:16.053664 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:16.053626    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:03:21.053742 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:21.053696    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:03:26.053833 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:26.053786    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:03:28.057041 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.056982    2561 generic.go:356] "Generic (PLEG): container finished" podID="403dd61d-f001-4634-ab2d-373d397f4b78" containerID="75ab60f65f58fc7a2c68360294074076a3d6e7216ae3121a3d27ef012e4260d7" exitCode=0
Sep 18 21:03:28.057041 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.057025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" event={"ID":"403dd61d-f001-4634-ab2d-373d397f4b78","Type":"ContainerDied","Data":"75ab60f65f58fc7a2c68360294074076a3d6e7216ae3121a3d27ef012e4260d7"}
Sep 18 21:03:28.057374 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.057083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv" event={"ID":"403dd61d-f001-4634-ab2d-373d397f4b78","Type":"ContainerDied","Data":"60129401d1da8dbc8f4090daa7783d641cb806ee7ceda93ee515423048fcdff3"}
Sep 18 21:03:28.057374 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.057100    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60129401d1da8dbc8f4090daa7783d641cb806ee7ceda93ee515423048fcdff3"
Sep 18 21:03:28.060947 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.060929    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 21:03:28.079815 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.079790    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/403dd61d-f001-4634-ab2d-373d397f4b78-proxy-tls\") pod \"403dd61d-f001-4634-ab2d-373d397f4b78\" (UID: \"403dd61d-f001-4634-ab2d-373d397f4b78\") "
Sep 18 21:03:28.079966 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.079826    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403dd61d-f001-4634-ab2d-373d397f4b78-openshift-service-ca-bundle\") pod \"403dd61d-f001-4634-ab2d-373d397f4b78\" (UID: \"403dd61d-f001-4634-ab2d-373d397f4b78\") "
Sep 18 21:03:28.080410 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.080387    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/403dd61d-f001-4634-ab2d-373d397f4b78-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "403dd61d-f001-4634-ab2d-373d397f4b78" (UID: "403dd61d-f001-4634-ab2d-373d397f4b78"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:03:28.082485 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.082452    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403dd61d-f001-4634-ab2d-373d397f4b78-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "403dd61d-f001-4634-ab2d-373d397f4b78" (UID: "403dd61d-f001-4634-ab2d-373d397f4b78"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 21:03:28.180594 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.180515    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/403dd61d-f001-4634-ab2d-373d397f4b78-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 21:03:28.180594 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:28.180543    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/403dd61d-f001-4634-ab2d-373d397f4b78-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 21:03:29.060870 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:29.060836    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"
Sep 18 21:03:29.075269 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:29.075234    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"]
Sep 18 21:03:29.080939 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:29.080917    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-8bda6-546cf494dd-ndzbv"]
Sep 18 21:03:30.839077 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:03:30.839041    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" path="/var/lib/kubelet/pods/403dd61d-f001-4634-ab2d-373d397f4b78/volumes"
Sep 18 21:04:25.029679 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:04:25.029647    2561 scope.go:117] "RemoveContainer" containerID="75ab60f65f58fc7a2c68360294074076a3d6e7216ae3121a3d27ef012e4260d7"
Sep 18 21:05:42.766832 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:05:42.766795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:09:28.397628 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:09:28.397591    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:13.502873 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:13.502795    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"]
Sep 18 21:10:13.503375 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:13.503044    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd" containerID="cri-o://e907bef8d2f63cb8de68d2751e3035314326c53fef32bf3f3731c9a1b38a4dd9" gracePeriod=30
Sep 18 21:10:13.537212 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:13.537180    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:13.681682 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:13.681648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:13.761842 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:13.761758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:14.973128 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.973095    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-85jnd/must-gather-8gwhm"]
Sep 18 21:10:14.973514 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.973411    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6"
Sep 18 21:10:14.973514 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.973423    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6"
Sep 18 21:10:14.973514 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.973472    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="403dd61d-f001-4634-ab2d-373d397f4b78" containerName="splitter-graph-8bda6"
Sep 18 21:10:14.976558 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.976537    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:14.979897 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.979873    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-85jnd\"/\"kube-root-ca.crt\""
Sep 18 21:10:14.980132 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.979873    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-85jnd\"/\"openshift-service-ca.crt\""
Sep 18 21:10:14.980132 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.979874    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-85jnd\"/\"default-dockercfg-2vpjh\""
Sep 18 21:10:14.988216 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.988191    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-85jnd/must-gather-8gwhm"]
Sep 18 21:10:14.992856 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:14.992833    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:15.072048 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.072012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:15.131727 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.131690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-must-gather-output\") pod \"must-gather-8gwhm\" (UID: \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\") " pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:15.131853 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.131737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdg9c\" (UniqueName: \"kubernetes.io/projected/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-kube-api-access-zdg9c\") pod \"must-gather-8gwhm\" (UID: \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\") " pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:15.232965 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.232879    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-must-gather-output\") pod \"must-gather-8gwhm\" (UID: \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\") " pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:15.232965 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.232923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdg9c\" (UniqueName: \"kubernetes.io/projected/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-kube-api-access-zdg9c\") pod \"must-gather-8gwhm\" (UID: \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\") " pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:15.233232 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.233214    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-must-gather-output\") pod \"must-gather-8gwhm\" (UID: \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\") " pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:15.241003 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.240975    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdg9c\" (UniqueName: \"kubernetes.io/projected/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-kube-api-access-zdg9c\") pod \"must-gather-8gwhm\" (UID: \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\") " pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:15.293108 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.293068    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:15.612031 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.611985    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-85jnd/must-gather-8gwhm"]
Sep 18 21:10:15.615154 ip-10-0-136-235 kubenswrapper[2561]: W0918 21:10:15.615130    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod907ab4b9_a2a3_4d21_b2c4_02b4596335e8.slice/crio-998c98ee4998fdc1ceb5a2733cd17c601b46ee596ee594386c2dfb69e2aa151b WatchSource:0}: Error finding container 998c98ee4998fdc1ceb5a2733cd17c601b46ee596ee594386c2dfb69e2aa151b: Status 404 returned error can't find the container with id 998c98ee4998fdc1ceb5a2733cd17c601b46ee596ee594386c2dfb69e2aa151b
Sep 18 21:10:15.617446 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.617430    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 21:10:15.621483 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.621453    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-85jnd/must-gather-8gwhm" event={"ID":"907ab4b9-a2a3-4d21-b2c4-02b4596335e8","Type":"ContainerStarted","Data":"998c98ee4998fdc1ceb5a2733cd17c601b46ee596ee594386c2dfb69e2aa151b"}
Sep 18 21:10:15.854268 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:15.854222    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:10:20.853867 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:20.853831    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:10:22.656866 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:22.656827    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-85jnd/must-gather-8gwhm" event={"ID":"907ab4b9-a2a3-4d21-b2c4-02b4596335e8","Type":"ContainerStarted","Data":"0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85"}
Sep 18 21:10:22.657391 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:22.656879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-85jnd/must-gather-8gwhm" event={"ID":"907ab4b9-a2a3-4d21-b2c4-02b4596335e8","Type":"ContainerStarted","Data":"d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2"}
Sep 18 21:10:22.675609 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:22.675558    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-85jnd/must-gather-8gwhm" podStartSLOduration=2.583556325 podStartE2EDuration="8.675542777s" totalImagesPullingTime="6.091986452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:10:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:10:22.673394982 +0000 UTC m=+2998.277573328" watchObservedRunningTime="2026-09-18 21:10:22.675542777 +0000 UTC m=+2998.279721125"
Sep 18 21:10:25.855004 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:25.854939    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:10:25.855438 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:25.855104    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 21:10:30.586296 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:30.586236    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:30.854038 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:30.853926    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:10:31.421576 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:31.421545    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:32.284519 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:32.284488    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:33.092884 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:33.092856    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:33.903689 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:33.903661    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:34.722091 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:34.722061    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:35.527115 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:35.527089    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:35.853822 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:35.853732    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:10:36.410864 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:36.410833    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:37.216111 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:37.216082    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:38.013263 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:38.013224    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:38.835051 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:38.835027    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:39.658716 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:39.658686    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:40.457486 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:40.457459    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:40.853818 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:40.853776    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 21:10:41.257437 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:41.257367    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:42.126513 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:42.126484    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-c7ffd-6f479c9f46-cq62h_3ec22540-100a-462b-a26a-b2fef6511bb0/switch-graph-c7ffd/0.log"
Sep 18 21:10:44.753156 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.753126    2561 generic.go:356] "Generic (PLEG): container finished" podID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerID="e907bef8d2f63cb8de68d2751e3035314326c53fef32bf3f3731c9a1b38a4dd9" exitCode=0
Sep 18 21:10:44.753559 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.753207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" event={"ID":"3ec22540-100a-462b-a26a-b2fef6511bb0","Type":"ContainerDied","Data":"e907bef8d2f63cb8de68d2751e3035314326c53fef32bf3f3731c9a1b38a4dd9"}
Sep 18 21:10:44.755171 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.755144    2561 generic.go:356] "Generic (PLEG): container finished" podID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" containerID="d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2" exitCode=0
Sep 18 21:10:44.755292 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.755216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-85jnd/must-gather-8gwhm" event={"ID":"907ab4b9-a2a3-4d21-b2c4-02b4596335e8","Type":"ContainerDied","Data":"d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2"}
Sep 18 21:10:44.755518 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.755504    2561 scope.go:117] "RemoveContainer" containerID="d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2"
Sep 18 21:10:44.788153 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.788133    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 21:10:44.892628 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.892601    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ec22540-100a-462b-a26a-b2fef6511bb0-proxy-tls\") pod \"3ec22540-100a-462b-a26a-b2fef6511bb0\" (UID: \"3ec22540-100a-462b-a26a-b2fef6511bb0\") "
Sep 18 21:10:44.892774 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.892647    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec22540-100a-462b-a26a-b2fef6511bb0-openshift-service-ca-bundle\") pod \"3ec22540-100a-462b-a26a-b2fef6511bb0\" (UID: \"3ec22540-100a-462b-a26a-b2fef6511bb0\") "
Sep 18 21:10:44.893022 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.892980    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ec22540-100a-462b-a26a-b2fef6511bb0-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3ec22540-100a-462b-a26a-b2fef6511bb0" (UID: "3ec22540-100a-462b-a26a-b2fef6511bb0"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 21:10:44.894563 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.894547    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ec22540-100a-462b-a26a-b2fef6511bb0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3ec22540-100a-462b-a26a-b2fef6511bb0" (UID: "3ec22540-100a-462b-a26a-b2fef6511bb0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 21:10:44.993517 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.993440    2561 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ec22540-100a-462b-a26a-b2fef6511bb0-proxy-tls\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 21:10:44.993517 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:44.993468    2561 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec22540-100a-462b-a26a-b2fef6511bb0-openshift-service-ca-bundle\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 21:10:45.686627 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:45.686601    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-85jnd_must-gather-8gwhm_907ab4b9-a2a3-4d21-b2c4-02b4596335e8/gather/0.log"
Sep 18 21:10:45.759706 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:45.759684    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"
Sep 18 21:10:45.759706 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:45.759701    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h" event={"ID":"3ec22540-100a-462b-a26a-b2fef6511bb0","Type":"ContainerDied","Data":"7fefb1e2861536e6872f1ffb01b2969e5dc6410d5426df7f10b8efbd67aa2ae5"}
Sep 18 21:10:45.760182 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:45.759754    2561 scope.go:117] "RemoveContainer" containerID="e907bef8d2f63cb8de68d2751e3035314326c53fef32bf3f3731c9a1b38a4dd9"
Sep 18 21:10:45.782137 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:45.782115    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"]
Sep 18 21:10:45.786749 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:45.786728    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-c7ffd-6f479c9f46-cq62h"]
Sep 18 21:10:46.143349 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:46.143316    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:46.838487 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:46.838456    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" path="/var/lib/kubelet/pods/3ec22540-100a-462b-a26a-b2fef6511bb0/volumes"
Sep 18 21:10:47.273331 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:47.273302    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:49.030180 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:49.030124    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4l4bl_20943fec-278e-4c96-8729-0309298862e5/global-pull-secret-syncer/0.log"
Sep 18 21:10:49.299315 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:49.299234    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log"
Sep 18 21:10:49.436704 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:49.436673    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-235.ec2.internal_44f943e00746b4df90253a3c1d6c9471/haproxy/0.log"
Sep 18 21:10:51.121147 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.121115    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-85jnd/must-gather-8gwhm"]
Sep 18 21:10:51.121542 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.121307    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-85jnd/must-gather-8gwhm" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" containerName="copy" containerID="cri-o://0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85" gracePeriod=2
Sep 18 21:10:51.127485 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.127455    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-85jnd/must-gather-8gwhm"]
Sep 18 21:10:51.355446 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.355426    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-85jnd_must-gather-8gwhm_907ab4b9-a2a3-4d21-b2c4-02b4596335e8/copy/0.log"
Sep 18 21:10:51.356905 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.356889    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:51.359892 ip-10-0-136-235 kubenswrapper[2561]: E0918 21:10:51.359861    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8gwhm\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-85jnd\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:51.447881 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.447787    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-must-gather-output\") pod \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\" (UID: \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\") "
Sep 18 21:10:51.447881 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.447829    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdg9c\" (UniqueName: \"kubernetes.io/projected/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-kube-api-access-zdg9c\") pod \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\" (UID: \"907ab4b9-a2a3-4d21-b2c4-02b4596335e8\") "
Sep 18 21:10:51.449443 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.449411    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "907ab4b9-a2a3-4d21-b2c4-02b4596335e8" (UID: "907ab4b9-a2a3-4d21-b2c4-02b4596335e8"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 21:10:51.450050 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.450029    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-kube-api-access-zdg9c" (OuterVolumeSpecName: "kube-api-access-zdg9c") pod "907ab4b9-a2a3-4d21-b2c4-02b4596335e8" (UID: "907ab4b9-a2a3-4d21-b2c4-02b4596335e8"). InnerVolumeSpecName "kube-api-access-zdg9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 21:10:51.549346 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.549312    2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-must-gather-output\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 21:10:51.549346 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.549340    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdg9c\" (UniqueName: \"kubernetes.io/projected/907ab4b9-a2a3-4d21-b2c4-02b4596335e8-kube-api-access-zdg9c\") on node \"ip-10-0-136-235.ec2.internal\" DevicePath \"\""
Sep 18 21:10:51.783713 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.783685    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-85jnd_must-gather-8gwhm_907ab4b9-a2a3-4d21-b2c4-02b4596335e8/copy/0.log"
Sep 18 21:10:51.784036 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.784010    2561 generic.go:356] "Generic (PLEG): container finished" podID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" containerID="0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85" exitCode=143
Sep 18 21:10:51.784152 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.784053    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:51.784152 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.784115    2561 scope.go:117] "RemoveContainer" containerID="0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85"
Sep 18 21:10:51.786300 ip-10-0-136-235 kubenswrapper[2561]: E0918 21:10:51.786273    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8gwhm\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-85jnd\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:51.792569 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.792555    2561 scope.go:117] "RemoveContainer" containerID="d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2"
Sep 18 21:10:51.794674 ip-10-0-136-235 kubenswrapper[2561]: E0918 21:10:51.794652    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8gwhm\" is forbidden: User \"system:node:ip-10-0-136-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-85jnd\": no relationship found between node 'ip-10-0-136-235.ec2.internal' and this object" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" pod="openshift-must-gather-85jnd/must-gather-8gwhm"
Sep 18 21:10:51.804347 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.804329    2561 scope.go:117] "RemoveContainer" containerID="0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85"
Sep 18 21:10:51.804611 ip-10-0-136-235 kubenswrapper[2561]: E0918 21:10:51.804591    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85\": container with ID starting with 0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85 not found: ID does not exist" containerID="0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85"
Sep 18 21:10:51.804667 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.804620    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85"} err="failed to get container status \"0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85\": rpc error: code = NotFound desc = could not find container \"0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85\": container with ID starting with 0041b9a54d38016bc1e2e3afc3b75fe627c35ac3c212ffcb91a02bcfbdd46c85 not found: ID does not exist"
Sep 18 21:10:51.804667 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.804638    2561 scope.go:117] "RemoveContainer" containerID="d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2"
Sep 18 21:10:51.804893 ip-10-0-136-235 kubenswrapper[2561]: E0918 21:10:51.804875    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2\": container with ID starting with d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2 not found: ID does not exist" containerID="d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2"
Sep 18 21:10:51.804946 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:51.804904    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2"} err="failed to get container status \"d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2\": rpc error: code = NotFound desc = could not find container \"d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2\": container with ID starting with d6b4ad1c1ab865c4cfd103faba48f3bd4b14736f8e8e2eac0d45580760d023c2 not found: ID does not exist"
Sep 18 21:10:52.246175 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:52.246099    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:52.318167 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:52.318130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ffdj8_b743c4a1-78e3-4ea7-9c8c-d2a979fc54fc/konnectivity-agent/0.log" limit=1024
Sep 18 21:10:52.839004 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:52.838957    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" path="/var/lib/kubelet/pods/907ab4b9-a2a3-4d21-b2c4-02b4596335e8/volumes"
Sep 18 21:10:53.567846 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:53.567815    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-wcrhm_5348af9b-8ea7-499f-81f3-e53ce18e42ee/cluster-monitoring-operator/0.log"
Sep 18 21:10:53.594523 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:53.594495    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tlq2g_c3c44c1a-d595-4b16-8620-ed89457e3f52/kube-state-metrics/0.log"
Sep 18 21:10:53.623479 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:53.623452    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tlq2g_c3c44c1a-d595-4b16-8620-ed89457e3f52/kube-rbac-proxy-main/0.log"
Sep 18 21:10:53.652885 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:53.652841    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tlq2g_c3c44c1a-d595-4b16-8620-ed89457e3f52/kube-rbac-proxy-self/0.log"
Sep 18 21:10:53.715513 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:53.715483    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-dr7sv_a12ff131-81b1-47f3-b758-219a078b666d/monitoring-plugin/0.log"
Sep 18 21:10:53.760042 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:53.760011    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brh65_d72600b3-4c15-451d-a3bf-dafda91eb364/node-exporter/0.log"
Sep 18 21:10:53.788128 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:53.788099    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brh65_d72600b3-4c15-451d-a3bf-dafda91eb364/kube-rbac-proxy/0.log"
Sep 18 21:10:53.813510 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:53.813483    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-brh65_d72600b3-4c15-451d-a3bf-dafda91eb364/init-textfile/0.log"
Sep 18 21:10:54.150452 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.150379    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82e84cd2-9062-4149-8fe1-67dd40db3d46/prometheus/0.log"
Sep 18 21:10:54.173563 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.173541    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82e84cd2-9062-4149-8fe1-67dd40db3d46/config-reloader/0.log"
Sep 18 21:10:54.200131 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.200107    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82e84cd2-9062-4149-8fe1-67dd40db3d46/thanos-sidecar/0.log"
Sep 18 21:10:54.226866 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.226841    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82e84cd2-9062-4149-8fe1-67dd40db3d46/kube-rbac-proxy-web/0.log"
Sep 18 21:10:54.258732 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.258703    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82e84cd2-9062-4149-8fe1-67dd40db3d46/kube-rbac-proxy/0.log"
Sep 18 21:10:54.288117 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.288087    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82e84cd2-9062-4149-8fe1-67dd40db3d46/kube-rbac-proxy-thanos/0.log"
Sep 18 21:10:54.317420 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.317386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_82e84cd2-9062-4149-8fe1-67dd40db3d46/init-config-reloader/0.log"
Sep 18 21:10:54.616085 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.616059    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66766bf99d-mm5sk_d48d29c2-27fe-4fab-9f42-3cd66f7d6730/thanos-query/0.log"
Sep 18 21:10:54.645395 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.645369    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66766bf99d-mm5sk_d48d29c2-27fe-4fab-9f42-3cd66f7d6730/kube-rbac-proxy-web/0.log"
Sep 18 21:10:54.678882 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.678862    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66766bf99d-mm5sk_d48d29c2-27fe-4fab-9f42-3cd66f7d6730/kube-rbac-proxy/0.log"
Sep 18 21:10:54.710767 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.710742    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66766bf99d-mm5sk_d48d29c2-27fe-4fab-9f42-3cd66f7d6730/prom-label-proxy/0.log"
Sep 18 21:10:54.741146 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.741121    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66766bf99d-mm5sk_d48d29c2-27fe-4fab-9f42-3cd66f7d6730/kube-rbac-proxy-rules/0.log"
Sep 18 21:10:54.770340 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:54.770320    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66766bf99d-mm5sk_d48d29c2-27fe-4fab-9f42-3cd66f7d6730/kube-rbac-proxy-metrics/0.log"
Sep 18 21:10:56.901885 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:56.901854    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-clsvj_b0183275-cf60-40a1-b34b-5e5efc74adc9/download-server/0.log"
Sep 18 21:10:57.117164 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117134    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"]
Sep 18 21:10:57.117453 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117439    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd"
Sep 18 21:10:57.117505 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117454    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd"
Sep 18 21:10:57.117505 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117466    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" containerName="gather"
Sep 18 21:10:57.117505 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117471    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" containerName="gather"
Sep 18 21:10:57.117505 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117478    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" containerName="copy"
Sep 18 21:10:57.117505 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117484    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" containerName="copy"
Sep 18 21:10:57.117652 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117553    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" containerName="gather"
Sep 18 21:10:57.117652 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117562    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="907ab4b9-a2a3-4d21-b2c4-02b4596335e8" containerName="copy"
Sep 18 21:10:57.117652 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.117570    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ec22540-100a-462b-a26a-b2fef6511bb0" containerName="switch-graph-c7ffd"
Sep 18 21:10:57.121284 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.121265    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.124004 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.123970    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wnf42\"/\"openshift-service-ca.crt\""
Sep 18 21:10:57.124101 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.124016    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wnf42\"/\"default-dockercfg-6nnkt\""
Sep 18 21:10:57.124522 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.124506    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wnf42\"/\"kube-root-ca.crt\""
Sep 18 21:10:57.132073 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.132051    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"]
Sep 18 21:10:57.196205 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.196131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-sys\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.196205 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.196170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-proc\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.196205 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.196188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-podres\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.196421 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.196264    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-lib-modules\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.196421 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.196294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfkkw\" (UniqueName: \"kubernetes.io/projected/bf6b20f0-737c-4b4f-abe5-970964938336-kube-api-access-gfkkw\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.297594 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.297542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-sys\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.297594 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.297603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-proc\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.297807 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.297629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-podres\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.297807 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.297656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-lib-modules\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.297807 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.297672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-sys\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.297807 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.297678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfkkw\" (UniqueName: \"kubernetes.io/projected/bf6b20f0-737c-4b4f-abe5-970964938336-kube-api-access-gfkkw\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.297807 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.297752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-proc\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.297807 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.297787    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-podres\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.297807 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.297804    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf6b20f0-737c-4b4f-abe5-970964938336-lib-modules\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.306315 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.306287    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfkkw\" (UniqueName: \"kubernetes.io/projected/bf6b20f0-737c-4b4f-abe5-970964938336-kube-api-access-gfkkw\") pod \"perf-node-gather-daemonset-kgjqr\" (UID: \"bf6b20f0-737c-4b4f-abe5-970964938336\") " pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.430797 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.430758    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.462643 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.462567    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-pldzx_a0de78e6-a766-4f67-9e33-fe27cb9b5831/volume-data-source-validator/0.log"
Sep 18 21:10:57.702410 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.702380    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"]
Sep 18 21:10:57.705438 ip-10-0-136-235 kubenswrapper[2561]: W0918 21:10:57.705403    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbf6b20f0_737c_4b4f_abe5_970964938336.slice/crio-2a6817594c464fd6d544aa03be7457e77deb1192882b5d38f970207df2df0791 WatchSource:0}: Error finding container 2a6817594c464fd6d544aa03be7457e77deb1192882b5d38f970207df2df0791: Status 404 returned error can't find the container with id 2a6817594c464fd6d544aa03be7457e77deb1192882b5d38f970207df2df0791
Sep 18 21:10:57.808201 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.808167    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr" event={"ID":"bf6b20f0-737c-4b4f-abe5-970964938336","Type":"ContainerStarted","Data":"ba6685aa5bdb792ef4e4d51d467b7e865b01ccd5dc38dc928584e0d111b777bd"}
Sep 18 21:10:57.808369 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.808222    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr" event={"ID":"bf6b20f0-737c-4b4f-abe5-970964938336","Type":"ContainerStarted","Data":"2a6817594c464fd6d544aa03be7457e77deb1192882b5d38f970207df2df0791"}
Sep 18 21:10:57.808369 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.808288    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:10:57.826796 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:57.826751    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr" podStartSLOduration=0.82673658 podStartE2EDuration="826.73658ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:10:57.824700484 +0000 UTC m=+3033.428878830" watchObservedRunningTime="2026-09-18 21:10:57.82673658 +0000 UTC m=+3033.430914926"
Sep 18 21:10:58.566124 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:58.566088    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zgqnr_55a7ca5f-82b2-4f88-923e-1ba0f52c4808/dns/0.log"
Sep 18 21:10:58.599222 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:58.599193    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zgqnr_55a7ca5f-82b2-4f88-923e-1ba0f52c4808/kube-rbac-proxy/0.log"
Sep 18 21:10:58.682542 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:58.682513    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q24cm_8de51077-e633-44cc-a1da-94c9e2c0139c/dns-node-resolver/0.log"
Sep 18 21:10:59.163650 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:59.163612    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-544f998677-x6rkc_a509bcac-d911-4782-b673-0a256f1ae05d/registry/0.log"
Sep 18 21:10:59.246054 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:10:59.246030    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z94b2_4abd2472-d1ce-46a6-9a61-10c40afc1839/node-ca/0.log"
Sep 18 21:11:00.083386 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:00.083355    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-755486fdf6-jwrgf_4eebb3de-b32f-4225-aa61-08b41feff46d/router/0.log"
Sep 18 21:11:00.480119 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:00.480033    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qs7p2_5166b166-51d6-4fb0-8c0c-ddcf656c6969/serve-healthcheck-canary/0.log"
Sep 18 21:11:00.853208 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:00.853176    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-lgdjd_4c5a757a-6b53-433f-bc4a-35eceaedf6f7/insights-operator/0.log"
Sep 18 21:11:00.854701 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:00.854685    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-lgdjd_4c5a757a-6b53-433f-bc4a-35eceaedf6f7/insights-operator/1.log"
Sep 18 21:11:00.876001 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:00.875982    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b2jts_a5ca3ef4-2a61-48fb-9f33-91626d917571/kube-rbac-proxy/0.log"
Sep 18 21:11:00.900626 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:00.900610    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b2jts_a5ca3ef4-2a61-48fb-9f33-91626d917571/exporter/0.log"
Sep 18 21:11:00.926667 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:00.926644    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b2jts_a5ca3ef4-2a61-48fb-9f33-91626d917571/extractor/0.log"
Sep 18 21:11:03.821288 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:03.821257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wnf42/perf-node-gather-daemonset-kgjqr"
Sep 18 21:11:08.883149 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:08.883066    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-h8lmm_de12d8c2-08ee-4d66-b78a-8b776c1f5430/kube-storage-version-migrator-operator/1.log"
Sep 18 21:11:08.883861 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:08.883843    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-h8lmm_de12d8c2-08ee-4d66-b78a-8b776c1f5430/kube-storage-version-migrator-operator/0.log"
Sep 18 21:11:09.992353 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:09.992323    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9qjz_55add1d8-b559-4fdd-a1b0-826dce56a516/kube-multus-additional-cni-plugins/0.log"
Sep 18 21:11:10.017108 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:10.017085    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9qjz_55add1d8-b559-4fdd-a1b0-826dce56a516/egress-router-binary-copy/0.log"
Sep 18 21:11:10.044203 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:10.044182    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9qjz_55add1d8-b559-4fdd-a1b0-826dce56a516/cni-plugins/0.log"
Sep 18 21:11:10.069308 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:10.069281    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9qjz_55add1d8-b559-4fdd-a1b0-826dce56a516/bond-cni-plugin/0.log"
Sep 18 21:11:10.095319 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:10.095289    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9qjz_55add1d8-b559-4fdd-a1b0-826dce56a516/routeoverride-cni/0.log"
Sep 18 21:11:10.123066 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:10.123039    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9qjz_55add1d8-b559-4fdd-a1b0-826dce56a516/whereabouts-cni-bincopy/0.log"
Sep 18 21:11:10.150405 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:10.150377    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t9qjz_55add1d8-b559-4fdd-a1b0-826dce56a516/whereabouts-cni/0.log"
Sep 18 21:11:10.511281 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:10.511245    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jpmmv_dbffc223-931d-49e0-963a-6f8e3da5e44d/kube-multus/0.log"
Sep 18 21:11:10.577760 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:10.577725    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-84j95_018cb5c7-0ac8-4eea-9866-5611fe0b7644/network-metrics-daemon/0.log"
Sep 18 21:11:10.602069 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:10.602048    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-84j95_018cb5c7-0ac8-4eea-9866-5611fe0b7644/kube-rbac-proxy/0.log"
Sep 18 21:11:11.710445 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:11.710408    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfsh2_a99f3975-9435-41dc-b6ba-ba6368dabf2e/ovn-controller/0.log"
Sep 18 21:11:11.739684 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:11.739652    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfsh2_a99f3975-9435-41dc-b6ba-ba6368dabf2e/ovn-acl-logging/0.log"
Sep 18 21:11:11.768138 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:11.768114    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfsh2_a99f3975-9435-41dc-b6ba-ba6368dabf2e/kube-rbac-proxy-node/0.log"
Sep 18 21:11:11.792085 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:11.792060    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfsh2_a99f3975-9435-41dc-b6ba-ba6368dabf2e/kube-rbac-proxy-ovn-metrics/0.log"
Sep 18 21:11:11.816773 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:11.816749    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfsh2_a99f3975-9435-41dc-b6ba-ba6368dabf2e/northd/0.log"
Sep 18 21:11:11.840311 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:11.840285    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfsh2_a99f3975-9435-41dc-b6ba-ba6368dabf2e/nbdb/0.log"
Sep 18 21:11:11.867733 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:11.867702    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfsh2_a99f3975-9435-41dc-b6ba-ba6368dabf2e/sbdb/0.log"
Sep 18 21:11:11.909867 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:11.909841    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfsh2_a99f3975-9435-41dc-b6ba-ba6368dabf2e/ovnkube-controller/0.log"
Sep 18 21:11:13.164093 ip-10-0-136-235 kubenswrapper[2561]: I0918 21:11:13.164057    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5b59g_3fafbef2-fe0c-4220-a499-d703aa74bb7c/network-check-target-container/0.log"